Skip to main content

Data Flow Pipeline

Use the Data Flow page to design and inspect how data moves from source systems through transformations to downstream consumers.

Data Flow visual graph showing nodes for sources, transformations, and destinations connected by edges

Explore the flow graph

Review the visual graph of nodes and edges representing sources, transformations, and destinations. Confirm that each step is connected as expected.

Configure flow steps

Select a node to configure its properties, such as source table, transformation logic, or destination schema. Validate that inputs and outputs align across the flow.

Validate the data flow

Use the validation action to check for missing connections, type mismatches, or unreachable nodes. Fix issues before saving or executing the flow.

Typical path

StepActionLocation
1Open PipelineMain sidebar
2Select Data FlowPipeline navigation
3Review the flow graphVisual canvas
4Configure or add flow stepsNode editor
5Validate and save the flowFlow actions

What happens next

A validated data flow can be bound to a pipeline definition and scheduled for execution through the Orchestration Workflows.

  • Data Pipeline — define the pipeline that uses this data flow
  • Ingestion — configure source ingestion for flow inputs