Run command options
The flyte run command provides the following options:
flyte run [OPTIONS] <PATH>|deployed_task <TASK_NAME>
| Option | Short | Type | Default | Description |
|---|---|---|---|---|
--project |
-p |
text | from config | Project to run tasks in |
--domain |
-d |
text | from config | Domain to run tasks in |
--local |
flag | false |
Run the task locally | |
--copy-style |
choice | `loaded_modules | all | |
--root-dir |
path | current dir | Override source root directory | |
--raw-data-path |
text | Override the output location for offloaded data types. | ||
--service-account |
text | Kubernetes service account. | ||
--name |
text | Name of the run. | ||
--follow |
-f |
flag | false |
Wait and watch logs for the parent action. |
--image |
text | Image to be used in the run (format: name=uri). |
||
--no-sync-local-sys-paths |
flag | false |
Disable synchronization of local sys.path entries. | |
--run-project |
text | from config | Execute deployed task in this project (deployed-task only). |
|
--run-domain |
text | from config | Execute deployed task in this domain (deployed-task only). |
--project, --domain
flyte run --domain <DOMAIN> --project <PROJECT> <PATH>|deployed_task <TASK_NAME>
You can specify --project and --domain which will override any defaults defined in your config.yaml:
flyte run my_example.py my_taskSpecify a target project and domain:
flyte run --project my-project --domain development my_example.py my_task--run-project, --run-domain
flyte run --run-project <PROJECT> --run-domain <DOMAIN> deployed-task <TASK_REF>
When using the deployed-task subcommand, --run-project and --run-domain specify the
project-domain pair in which to execute the task. This lets you run a deployed task in a different project or domain than the one configured in your config.yaml:
flyte run --run-project prod-project --run-domain production deployed-task my_env.my_taskIf not provided, these default to the task.project and task.domain values in your configuration file. These options only apply to the deployed-task subcommand and are ignored for file-based runs.
--local
flyte run --local <PATH> <TASK_NAME>
The --local option runs tasks locally instead of submitting them to the remote Flyte backend:
flyte run --local my_example.py my_task --input "test_data"Compare with remote execution:
flyte run my_example.py my_task --input "test_data"When to use local execution
- Development and testing: Quick iteration without deployment overhead
- Debugging: Full access to local debugging tools and environment
- Resource constraints: When remote resources are unavailable or expensive
- Data locality: When working with large local datasets
--copy-style
flyte run --copy-style [loaded_modules|all|none] <PATH> <TASK_NAME>
The --copy-style option controls code bundling for remote execution.
This applies to the ephemeral preparation step of the flyte run command and works similarly to flyte deploy:
Smart bundling (default) — includes only imported project modules:
flyte run --copy-style loaded_modules my_example.py my_taskInclude all project files:
flyte run --copy-style all my_example.py my_taskNo code bundling (task must be pre-deployed):
flyte run --copy-style none deployed_task my_deployed_taskCopy style options
loaded_modules(default): Bundles only imported Python modules from your projectall: Includes all files in the project directorynone: No bundling; requires permanently deployed tasks
--root-dir
flyte run --root-dir <DIRECTORY> <PATH> <TASK_NAME>
Override the source directory for code bundling and import resolution:
Run from a monorepo root with a specific root directory:
flyte run --root-dir ./services/ml ./services/ml/my_example.py my_taskHandle cross-directory imports:
flyte run --root-dir .. my_example.py my_workflowThis applies to the ephemeral preparation step of the flyte run command.
It works identically to the flyte deploy command’s --root-dir option.
--raw-data-path
flyte run --raw-data-path <PATH> <SOURCE> <TASK_NAME>
Override the default output location for offloaded data types (large objects, DataFrames, etc.):
Use a custom S3 location for large outputs:
flyte run --raw-data-path s3://my-bucket/custom-path/ my_example.py process_large_dataUse a local directory for development:
flyte run --local --raw-data-path ./output/ my_example.py my_taskUse cases
- Custom storage locations: Direct outputs to specific S3 buckets or paths
- Cost optimization: Use cheaper storage tiers for temporary data
- Access control: Ensure outputs go to locations with appropriate permissions
- Local development: Store large outputs locally when testing
--service-account
flyte run --service-account <ACCOUNT_NAME> <PATH> <TASK_NAME>
Specify a Kubernetes service account for task execution:
flyte run --service-account ml-service-account my_example.py train_model
flyte run --service-account data-reader-sa my_example.py load_dataUse cases
- Cloud resource access: Service accounts with permissions for S3, GCS, etc.
- Security isolation: Different service accounts for different workload types
- Compliance requirements: Enforcing specific identity and access policies
--name
flyte run --name <EXECUTION_NAME> <PATH> <TASK_NAME>
Provide a custom name for the execution run:
flyte run --name "daily-training-run-2024-12-02" my_example.py train_model
flyte run --name "experiment-lr-0.01-batch-32" my_example.py hyperparameter_sweepBenefits of custom names
- Easy identification: Find specific runs in the Flyte console
- Experiment tracking: Include key parameters or dates in names
- Automation: Programmatically generate meaningful names for scheduled runs
--follow
flyte run --follow <PATH> <TASK_NAME>
Wait and watch logs for the execution in real-time:
flyte run --follow my_example.py long_running_taskCombine with other options:
flyte run --follow --name "training-session" my_example.py train_modelBehavior
- Log streaming: Real-time output from task execution
- Blocking execution: Command waits until task completes
- Exit codes: Returns appropriate exit code based on task success/failure
--image
flyte run --image <IMAGE_MAPPING> <PATH> <TASK_NAME>
Override container images during ephemeral preparation, same as the equivalent flyte deploy option:
Override a specific named image:
flyte run --image gpu=ghcr.io/org/gpu:v2.1 my_example.py gpu_taskOverride the default image:
flyte run --image ghcr.io/org/custom:latest my_example.py my_taskMultiple image overrides:
flyte run \
--image base=ghcr.io/org/base:v1.0 \
--image gpu=ghcr.io/org/gpu:v2.0 \
my_example.py multi_env_workflowImage mapping formats
- Named mapping:
name=urioverrides images created withImage.from_ref_name("name") - Default mapping:
urioverrides the default “auto” image - Multiple mappings: Use multiple
--imageflags for different image references
--no-sync-local-sys-paths
flyte run --no-sync-local-sys-paths <PATH> <TASK_NAME>
Disable synchronization of local sys.path entries to the remote execution environment during ephemeral preparation.
Identical to the flyte deploy command’s --no-sync-local-sys-paths option:
flyte run --no-sync-local-sys-paths my_example.py my_taskThis advanced option works identically to the deploy command equivalent, useful for:
- Container isolation: Prevent local development paths from affecting remote execution
- Custom environments: When containers have pre-configured Python paths
- Security: Avoiding exposure of local directory structures
Task argument passing
Arguments are passed directly as function parameters:
CLI — arguments as flags:
flyte run my_file.py my_task --name "World" --count 5 --debug trueSDK — arguments as function parameters:
result = flyte.run(my_task, name="World", count=5, debug=True)SDK options
The core flyte run functionality is also available programmatically through the flyte.run() function, with extensive configuration options available via the flyte.with_runcontext() function:
# Run context configuration
result = flyte.with_runcontext(
mode="remote", # "remote", "local"
copy_style="loaded_modules", # Code bundling strategy
version="v1.0.0", # Ephemeral preparation version
dry_run=False, # Preview mode
).run(my_task, name="World")