Pipeline Overview Pipeline

The Pipeline workspace provides a unified interface for designing, monitoring, and managing data pipelines, ingestion jobs, orchestration workflows, and test suites.

Before creating pipelines, ensure that the correct connections, compute resources, and data sources are imported and configured in the environment.

Choose a pipeline workflow

Scan the cards and select the area that matches your task. Each card routes directly to a focused pipeline management page.

Pipeline pages

📊

Pipeline Dashboard

Monitor pipeline health, execution status, and performance metrics at a glance.

🔧

Data Pipeline

Create and manage end-to-end data pipelines from source to destination.

🌊

Data Flow

Visualise and configure data movement and transformation steps between systems.

📥

Ingestion

Set up and monitor data ingestion jobs from external sources into the platform.

📚

Knowledge Base

Manage reusable pipeline components, templates, and organisational knowledge.

⚙️

Orchestration Workflows

Design and schedule orchestrated workflows that coordinate multiple pipeline stages.

🧪

Test Dashboard

Review test results, coverage, and validation status for pipeline quality assurance.