Data Pipelines
Atlan's Data Pipelines connectors enable you to integrate, catalog, and govern metadata from leading ETL tools and workflow orchestration platforms. These connectors help you document data transformations, track lineage, and manage the complete lifecycle of your data as it moves through various systems.
Key concepts
- ETL: Extract, transform, load processes that move and reshape data between systems
- Orchestration: Platforms that schedule, coordinate, and monitor data workflows
- Lineage: Visual representation of data movement from source to destination
- Transformation: Rules and logic applied to data as it moves through pipelines
Core offerings
Process Tracking
Document ETL processes and monitor data movement across your organization
End-to-End Lineage
Visualize complete data lineage from source through transformation to consumption
Impact Analysis
Understand how changes to pipelines affect downstream systems and reports
Code Integration
Link transformation code and business logic to your data assets in the catalog
Get started
Select your platform
Choose the ETL tool or orchestration platform you want to connect from the sidebar
Set up credentials
Configure authentication and access permissions following the platform-specific guide
Extract metadata
Run the crawler to capture lineage, transformation logic, and pipeline structure
Use the sidebar navigation to browse available connectors, including popular tools like dbt, Fivetran, Apache Airflow, and Azure Data Factory.