115 docs tagged with "lineage"

Propagate data-quality alerts downstream through asset lineage to surface impact across the catalog. Reference for workflow configuration, scope rules, and propagation-behavior settings.

Integrate, catalog, and govern Alteryx assets in Atlan using OpenLineage.

Integrate, catalog, and visualize Amazon MWAA lineage in Atlan.

Integrate, catalog, and visualize Apache Airflow lineage in Atlan.

Integrate, catalog, and visualize Apache Flink lineage in Atlan.

Integrate, catalog, and visualize Apache Spark lineage in Atlan.

Integrate, catalog, and visualize Astronomer lineage in Atlan.

Frequently asked questions about how Atlan lineage differs from Databricks native lineage.

Import lineage relationships between assets from a CSV file using the Lineage Builder app. Create lineage connections that include transformation processes, ETL workflows, dbt models, and custom data pipelines that aren't automatically discovered by connectors.

Data lineage shows the upstream and downstream dependencies of an asset. For a more granular view of these dependencies, you can view column-level lineage.

Capture lineage from Dagster assets by creating a listener in Atlan. Extract data orchestration metadata and asset dependencies from your Dagster instance.

Crawl lineage from AWS SageMaker to catalog machine learning pipelines, jobs, models, and datasets. Extract ML workflow lineage after configuring AWS credentials.

Discover, catalog, and build lineage for AI models registered in the Snowflake Model Registry using Atlan's Snowflake connector.

Create data products to help data consumers discover and work with data assets. Setup requires the products module to be enabled and domain policy permissions for the specific domain or subdomain.

Integrate, catalog, and visualize Dagster lineage in Atlan.

Frequently asked questions about Dagster integration with Atlan

Learn how to connect your data pipelines to Atlan. Explore ETL tools, workflow orchestration, and lineage tracking to build a comprehensive view of your data movement.

Catalog and govern DataStax Enterprise assets in Atlan. Build asset- and column-level lineage for your distributed data.

Atlan supports field-level lineage across most BI sources that have the concept of fields. See [supported BI sources](/product/connections/references/supported-.

View, download, and export lineage reports to analyze data flows and impact. Create CSV impact reports, export lineage graphs as images, and share lineage data to Google Sheets and Microsoft Excel for impact analysis and root cause analysis.

Once you've [connected Atlan with Google Sheets](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-google-sheets), you can download impacted assets in Google Sheets. This can help you assess the downstream impact of any changes made to an upstream asset for [impact analysis](/product/capabilities/lineage/concepts/what-is-lineage#impact-analysis).

How Atlan resolves source fields, target fields, and field-level lineage for Informatica CDI dynamic mapping tasks

Learn how to create missing Power BI tables and columns blocked by Object Level Security and generate upstream lineage to your data warehouse using the PBI OLS Dataset Enricher app with BIM files from S3.

Build upstream lineage between Databricks AI models and the datasets, tables, and functions they depend on.

Learn how to generate lineage between BigQuery external tables and their upstream GCS objects using the GCS to BigQuery External Table Lineage workflow.

Enable query logging and configure your ClickHouse instance so the ClickHouse Miner workflow can extract query history and generate lineage.

Create an ingestion workflow in Atlan to extract Oracle query history and generate lineage for existing Oracle assets.

Enable pg_stat_statements and configure your PostgreSQL instance so the PostgreSQL Miner workflow can extract query history and generate lineage.

Automatically create lineage between assets across two connections when their names match or follow a consistent pattern. The Lineage Generator (no transformations) app creates direct lineage relationships for data flows between databases, warehouses, or storage systems.

Extract lineage from SQL query history stored in Amazon S3 using the Generic Miner app. Generate table-level and column-level lineage for existing connections when source systems don't expose complete query history or when query logs are retained externally.

Learn how to generate column and measure to page lineage for Microsoft Power BI by using the PowerBI Columns/Measures -> Pages lineage app with PBIR project files stored in cloud object storage.

Learn how to generate column-to-dataset lineage for Microsoft Power BI by using the PowerBI Columns -> Dataset lineage app with report.json files stored in cloud object storage.

Capture and visualize lineage from any OpenLineage-emitting system in Atlan

Integrate, catalog, and visualize Google Cloud Composer lineage in Atlan.

Learn about high availability and disaster recovery (ha/dr).

Frequently asked questions about how Atlan constructs lineage for Databricks AI models, including lineage sources, relationships created, and asset behavior.

Frequently asked questions about how Atlan constructs lineage for Snowflake AI models, including the lineage function used, depth, and upstream asset types resolved.

Learn about how can atlan generate upstream lineage from the data warehouse layer?.

Learn about how do you enable data lineage for different data sources?.

Learn about how does a snowflake connection know that a table referenced in lookml is actually the same table?.

Learn about how does atlan handle lineage from spark jobs?.

Learn about how is the atlan lineage graph depicted using power bi measures?.

Learn about how to obtain upstream lineage if i connect to a tableau data asset?.

Learn how to integrate Astronomer/OpenLineage with Atlan by configuring the connection, setting environment variables, and verifying connectivity.

To integrate Google Cloud Composer/OpenLineage with Atlan, complete the following steps. To learn more about OpenLineage, refer to [OpenLineage configuration and facets](/product/connections/references/openlineage-configuration-and-facets).

Frequently asked questions about Talend lineage in Atlan

[Data lineage](/product/capabilities/lineage/how-tos/view-lineage) captures how data moves across your data landscape. This information is useful to:.

Track and visualize data lineage across your data landscape to understand data flow and dependencies.

Use Lakehouse to run advanced lineage analysis across systems and connectors.

Complete configuration reference for the Lineage and asset loader app, including S3 authentication methods, CSV file schema, asset creation controls, and workflow settings.

Complete configuration reference for the Lineage Builder app properties and settings, including CSV file format and asset handling options.

Understand how Atlan filters Databricks lineage data to show only valid lineage relationships.

Export complete lineage information from your metadata lakehouse for reuse across impact, dashboard, and root cause analysis.

Learn how Atlan can generate upstream lineage from the data warehouse layer, including configuration options and behavior.

Use Lakehouse to find all downstream dashboards impacted by upstream data changes.

Use Lakehouse to understand downstream impact before making changes to data assets.

Use Lakehouse to trace upstream dependencies and find the source of data issues.

Use Lakehouse to measure and improve tag coverage and propagation across systems.

Reference documentation for the LINEAGE_ADJACENCY_LIST table containing directed lineage edges between assets and processes

Create lineage and optionally generate assets in Atlan from a source-to-target CSV mapping file stored in Amazon S3. The Lineage and asset loader app reads CSV mappings, creates lineage relationships, and optionally creates missing source or target assets.

Complete configuration reference for the Metadata Propagator app, including propagation direction, attribute selection, filters, and matching behavior.

Catalog Microsoft Dataverse entities and their relationships in Atlan as lineage. Reference for crawler configuration, entity selection, relationship mapping, and sync options.

Once you have [crawled assets from ClickHouse](/apps/connectors/database/clickhouse/how-tos/crawl-clickhouse), you can mine its query history to construct lineage.

Once you have [crawled assets from PostgreSQL](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can mine its query history to construct lineage.

Monitor data domains using the Statistics tab to track data products, enrichment metrics, creation trends, and domain usage. Setup requires the products module enabled and domain owner or admin permissions in Atlan.

Configure OpenLineage integration with Atlan — capture lineage metadata from Airflow, Spark, and other data processing tools.

Complete configuration reference for the Orchestration tasks attribute transfer app, including connector selection, custom metadata mapping, transfer direction, and filter options.

Complete configuration reference for the PBI OLS Dataset Enricher app, including S3 authentication, connection setup, and how it restores Power BI lineage broken by OLS.

Learn about preflight checks for apache airflow.

Propagate metadata like owners, certificates, and tags from upstream assets to downstream dependents automatically using the Metadata Propagator app. The app follows existing lineage relationships to push governance metadata downstream without manual updates.

Learn about provider package versions for openlineage.

Frequently asked questions about BigQuery routines and their relationships with Process assets for lineage generation

Configure Dagster integration with Atlan to enable asset and lineage capture from your Dagster assets

Create helper lineage tables in your warehouse for advanced lineage queries that include direction (upstream/downstream), hop level, and asset names. These tables work with Lakehouse's native LINEAGE_ADJACENCY_LIST table.

The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks lineage extraction, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.

Configure AWS credentials and permissions to connect Atlan to your SageMaker environment.

Override the asset type assigned to assets derived from source system metadata. Reference for supported asset types, qualified-name parsing rules, and configuration options.

Frequently asked questions about Snowflake Stored Procedures and User-defined Functions and their relationships with Process assets for lineage generation

Learn about tag propagation.

Learn about supported tasks, transformations, and lineage generation in the Informatica CDI connector

Learn about tenant logs.

Catalog and govern Teradata assets in Atlan. Optionally mine query history to build lineage.

Propagate operational attributes from orchestration tasks and jobs to connected assets using the Orchestration tasks attribute transfer app. Transfer run status, schedules, run timestamps, and task links to upstream or downstream assets through lineage.

Learn about troubleshooting amazon dynamodb connectivity.

Learn about troubleshooting amazon msk connectivity.

Learn about troubleshooting amazon redshift connectivity.

Learn about troubleshooting apache airflow/openlineage connectivity.

Learn about troubleshooting apache spark/openlineage connectivity.

Learn about troubleshooting domo connectivity.

Learn about troubleshooting fivetran connectivity.

Learn about troubleshooting ibm cognos analytics connectivity.

Learn about troubleshooting microsoft azure cosmos db connectivity.

Learn about troubleshooting microsoft azure data factory connectivity.

Learn about troubleshooting microsoft power bi connectivity.

Learn about troubleshooting mode connectivity.

Learn about troubleshooting MongoDB Atlas connectivity.

Learn about troubleshooting on-premises looker connectivity.

Learn about troubleshooting qlik sense cloud connectivity.

Learn about troubleshooting sigma connectivity.

Learn about troubleshooting sisense connectivity.

Learn about troubleshooting thoughtspot connectivity.

Learn about troubleshooting usage and popularity metrics.

Before using Atlan AI, your admin user must enable Atlan AI in your Atlan workspace.

Event logs help you track and debug events received from supported connectors, providing you with greater observability in Atlan. Event logs are currently stored in Atlan for 7 days.

Explore data flows and transformations using the lineage graph. Navigate upstream and downstream assets, view column-level lineage, perform impact analysis, and visualize metadata context for dependencies and data quality signals.

Learn about what are processes?.

Learn about what do the numbers in lineage view mean?.

Learn about what does atlan crawl from cloudera impala?.

Learn about the Dagster metadata that Atlan captures and visualizes

During a Metabase crawl, Atlan extracts metadata for Collections, Dashboards, and Questions. Reference tables map each Metabase property to its Atlan asset.

During a Sigma crawl, Atlan extracts metadata for Workbooks, Pages, Data Elements, Data Element Fields, and Datasets. Reference tables map each Sigma property to its Atlan asset.

Learn about what is business lineage?.

Learn about what lineage do you support?.

Learn about the lineage relationships that Atlan can map from Microsoft Fabric.

Learn about why is my databricks lineage api not working?.