1.16.16

flytekit.core.array_node

Directory

Classes

Class Description
ArrayNode

Methods

Method Description
array_node() ArrayNode implementation that maps over tasks and other Flyte entities.

Variables

Property Type Description
ARRAY_NODE_SUBNODE_NAME str
TYPE_CHECKING bool

Methods

array_node() 

def array_node(
    target: typing.Union[flytekit.core.launch_plan.LaunchPlan, flytekit.core.task.ReferenceTask, ForwardRef('FlyteLaunchPlan')],
    concurrency: typing.Optional[int],
    min_success_ratio: typing.Optional[float],
    min_successes: typing.Optional[int],
    run_all_sub_nodes: bool,
)

ArrayNode implementation that maps over tasks and other Flyte entities

flyte_entity_call_handler
Parameter Type Description
target typing.Union[flytekit.core.launch_plan.LaunchPlan, flytekit.core.task.ReferenceTask, ForwardRef('FlyteLaunchPlan')] The target Flyte entity to map over
concurrency typing.Optional[int] If specified, this limits the number of mapped tasks than can run in parallel to the given batch size. If the size of the input exceeds the concurrency value, then multiple batches will be run serially until all inputs are processed. If set to 0, this means unbounded concurrency. If left unspecified, this means the array node will inherit parallelism from the workflow
min_success_ratio typing.Optional[float] The minimum ratio of successful executions
min_successes typing.Optional[int] The minimum number of successful executions. If set, this takes precedence over min_success_ratio
run_all_sub_nodes bool If True, all sub-nodes will run to completion even after the failure threshold is met

Returns: A callable function that takes in keyword arguments and returns a Promise created by

flytekit.core.array_node.ArrayNode

Parameters 

class ArrayNode(
    target: typing.Union[flytekit.core.launch_plan.LaunchPlan, flytekit.core.task.ReferenceTask, ForwardRef('FlyteLaunchPlan')],
    bindings: typing.Optional[typing.List[flytekit.models.literals.Binding]],
    concurrency: typing.Optional[int],
    min_successes: typing.Optional[int],
    min_success_ratio: typing.Optional[float],
    metadata: typing.Optional[flytekit.models.core.workflow.NodeMetadata],
    run_all_sub_nodes: bool,
)
Parameter Type Description
target typing.Union[flytekit.core.launch_plan.LaunchPlan, flytekit.core.task.ReferenceTask, ForwardRef('FlyteLaunchPlan')] The target Flyte entity to map over
bindings typing.Optional[typing.List[flytekit.models.literals.Binding]]
concurrency typing.Optional[int] If specified, this limits the number of mapped tasks than can run in parallel to the given batch size. If the size of the input exceeds the concurrency value, then multiple batches will be run serially until all inputs are processed. If set to 0, this means unbounded concurrency. If left unspecified, this means the array node will inherit parallelism from the workflow
min_successes typing.Optional[int] The minimum number of successful executions. If set, this takes precedence over min_success_ratio
min_success_ratio typing.Optional[float] The minimum ratio of successful executions.
metadata typing.Optional[flytekit.models.core.workflow.NodeMetadata] The metadata for the underlying node
run_all_sub_nodes bool If True, all sub-nodes will run to completion even after the failure threshold is met

Properties

Property Type Description
bindings None
bound_inputs None
concurrency None
data_mode None
execution_mode None
flyte_entity None
interface None
is_original_sub_node_interface None
min_success_ratio None
min_successes None
name None
python_interface None
run_all_sub_nodes None
upstream_nodes None

Methods

Method Description
construct_node_metadata()
local_execute()
local_execution_mode()

construct_node_metadata() 

def construct_node_metadata()

local_execute() 

def local_execute(
    ctx: flytekit.core.context_manager.FlyteContext,
    kwargs,
) -> typing.Union[typing.Tuple[flytekit.core.promise.Promise], flytekit.core.promise.Promise, flytekit.core.promise.VoidPromise]
Parameter Type Description
ctx flytekit.core.context_manager.FlyteContext
kwargs **kwargs

local_execution_mode() 

def local_execution_mode()