Skip to main content

61 docs tagged with "data-lineage"

View all tags

Alert propagation

Propagate data-quality alerts downstream through asset lineage to surface impact across the catalog. Reference for workflow configuration, scope rules, and propagation-behavior settings.

Build lineage from CSV

Import lineage relationships between assets from a CSV file using the Lineage Builder app. Create lineage connections that include transformation processes, ETL workflows, dbt models, and custom data pipelines that aren't automatically discovered by connectors.

Column Level Lineage

Data lineage shows the upstream and downstream dependencies of an asset. For a more granular view of these dependencies, you can view column-level lineage.

Create data products

Create data products to help data consumers discover and work with data assets. Setup requires the products module to be enabled and domain policy permissions for the specific domain or subdomain.

Download and export lineage

View, download, and export lineage reports to analyze data flows and impact. Create CSV impact reports, export lineage graphs as images, and share lineage data to Google Sheets and Microsoft Excel for impact analysis and root cause analysis.

Download impacted assets in Google Sheets

Once you've [connected Atlan with Google Sheets](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-google-sheets), you can download impacted assets in Google Sheets. This can help you assess the downstream impact of any changes made to an upstream asset for [impact analysis](/product/capabilities/lineage/concepts/what-is-lineage#impact-analysis).

Generate lineage between assets

Automatically create lineage between assets across two connections when their names match or follow a consistent pattern. The Lineage Generator (no transformations) app creates direct lineage relationships for data flows between databases, warehouses, or storage systems.

Generate lineage from S3 queries

Extract lineage from SQL query history stored in Amazon S3 using the Generic Miner app. Generate table-level and column-level lineage for existing connections when source systems don't expose complete query history or when query logs are retained externally.

Integrate Google Cloud Composer/OpenLineage

To integrate Google Cloud Composer/OpenLineage with Atlan, complete the following steps. To learn more about OpenLineage, refer to [OpenLineage configuration and facets](/product/connections/references/openlineage-configuration-and-facets).

Lineage

[Data lineage](/product/capabilities/lineage/how-tos/view-lineage) captures how data moves across your data landscape. This information is useful to:.

Lineage Builder

Complete configuration reference for the Lineage Builder app properties and settings, including CSV file format and asset handling options.

Metadata Propagator

Complete configuration reference for the Metadata Propagator app, including propagation direction, attribute selection, filters, and matching behavior.

Microsoft Dataverse crawler

Catalog Microsoft Dataverse entities and their relationships in Atlan as lineage. Reference for crawler configuration, entity selection, relationship mapping, and sync options.

Monitor data domains

Monitor data domains using the Statistics tab to track data products, enrichment metrics, creation trends, and domain usage. Setup requires the products module enabled and domain owner or admin permissions in Atlan.

Propagate metadata through lineage

Propagate metadata like owners, certificates, and tags from upstream assets to downstream dependents automatically using the Metadata Propagator app. The app follows existing lineage relationships to push governance metadata downstream without manual updates.

Set up on-premises Databricks lineage extraction

The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks lineage extraction, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.

Source asset type

Override the asset type assigned to assets derived from source system metadata. Reference for supported asset types, qualified-name parsing rules, and configuration options.

View event logs

Event logs help you track and debug events received from supported connectors, providing you with greater observability in Atlan. Event logs are currently stored in Atlan for 7 days.

View lineage

Explore data flows and transformations using the lineage graph. Navigate upstream and downstream assets, view column-level lineage, perform impact analysis, and visualize metadata context for dependencies and data quality signals.

What does Atlan crawl from Metabase?

During a Metabase crawl, Atlan extracts metadata for Collections, Dashboards, and Questions. Reference tables map each Metabase property to its Atlan asset.

What does Atlan crawl from Sigma?

During a Sigma crawl, Atlan extracts metadata for Workbooks, Pages, Data Elements, Data Element Fields, and Datasets. Reference tables map each Sigma property to its Atlan asset.