Skip to main content

107 docs tagged with "lineage"

View all tags

Alert propagation

Complete configuration reference for the alert propagation app properties and settings, including scope, matching options, and propagation behavior.

Alteryx

Integrate, catalog, and govern Alteryx assets in Atlan using OpenLineage.

Build lineage from CSV

Learn how to import lineage relationships between assets from a CSV file using the Lineage Builder app, including transformation processes like dbt models or ETL workflows.

Column Level Lineage

Data lineage shows the upstream and downstream dependencies of an asset. For a more granular view of these dependencies, you can view column-level lineage.

Crawl SageMaker

Configure and run the crawler to extract lineage from your SageMaker machine learning workflows.

Dagster

Integrate, catalog, and visualize Dagster lineage in Atlan.

Data Pipelines

Learn how to connect your data pipelines to Atlan. Explore ETL tools, workflow orchestration, and lineage tracking to build a comprehensive view of your data movement.

DataStax Enterprise

Catalog and govern DataStax Enterprise assets in Atlan. Build asset- and column-level lineage for your distributed data.

Download and export lineage

Understanding the flow of data from the source to its destination is a critical need for many organizations. To help you build trust in your data assets, Atlan allows you to [view](#view-impacted-assets), [download](#download-lineage), and [export](#export-impacted-assets) your impacted assets and share it with others in your organization.

Download impacted assets in Google Sheets

Once you've [connected Atlan with Google Sheets](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-google-sheets), you can download impacted assets in Google Sheets. This can help you assess the downstream impact of any changes made to an upstream asset for [impact analysis](/product/capabilities/lineage/concepts/what-is-lineage#impact-analysis).

Dynamic mapping task lineage

How Atlan resolves source fields, target fields, and field-level lineage for Informatica CDI dynamic mapping tasks

Enrich Power BI OLS datasets

Learn how to create missing Power BI tables and columns blocked by Object Level Security and generate upstream lineage to your data warehouse using the PBI OLS Dataset Enricher app with BIM files from S3.

Generate lineage

Create an ingestion workflow in Atlan to extract Oracle query history and generate lineage for existing Oracle assets.

Generate lineage between assets App

Learn how to generate lineage between assets across two connections in Atlan by matching table names using the Lineage Generator (no transformations) app.

Generate Power BI columns to dataset lineage

Learn how to generate column-to-dataset lineage for Microsoft Power BI by using the PowerBI Columns -> Dataset lineage app with report.json files stored in cloud object storage.

Integrate Astronomer/OpenLineage

Learn how to integrate Astronomer/OpenLineage with Atlan by configuring the connection, setting environment variables, and verifying connectivity.

Integrate Google Cloud Composer/OpenLineage

To integrate Google Cloud Composer/OpenLineage with Atlan, complete the following steps. To learn more about OpenLineage, refer to [OpenLineage configuration and facets](/product/connections/references/openlineage-configuration-and-facets).

Lineage

Frequently asked questions about Talend lineage in Atlan

Lineage

[Data lineage](/product/capabilities/lineage/how-tos/view-lineage) captures how data moves across your data landscape. This information is useful to:.

Lineage

Track and visualize data lineage across your data landscape to understand data flow and dependencies.

Lineage analysis

Use Lakehouse to run advanced lineage analysis across systems and connectors.

Lineage and asset loader

Complete configuration reference for the Lineage and asset loader app, including S3 authentication methods, CSV file schema, asset creation controls, and workflow settings.

Lineage Builder

Complete configuration reference for the Lineage Builder app properties and settings, including CSV file format and asset handling options.

Lineage full export

Export complete lineage information from your metadata lakehouse for reuse across impact, dashboard, and root cause analysis.

LINEAGE view

Reference documentation for the LINEAGE view containing asset and column-level lineage processes

Load lineage and assets from CSV

Learn how to create lineage and assets in Atlan from a source-to-target CSV mapping file using the Lineage and asset loader app.

Metadata Propagator

Complete configuration reference for the Metadata Propagator app, including propagation direction, attribute selection, filters, and matching behavior.

Monitor data domains

The _Statistics_ tab within a data domain helps you take the pulse of what's happening to your data domains in Atlan and gain actionable insights. You can view a summary of data products, track metrics for domain enrichment, view data product creation over time, monitor domain usage, and more.

Orchestration tasks attribute transfer

Complete configuration reference for the Orchestration tasks attribute transfer app, including connector selection, custom metadata mapping, transfer direction, and filter options.

PBI OLS Dataset Enricher

Complete configuration reference for the PBI OLS Dataset Enricher app, including S3 authentication, connection setup, and how it restores Power BI lineage broken by OLS.

Propagate metadata through lineage

Learn how to use the Metadata Propagator app to propagate owners, tags, certificates, and other metadata from source assets to downstream assets through lineage.

Report on glossaries

The [glossary](/product/capabilities/governance/glossary/concepts/what-is-a-glossary) dashboard in the reporting center helps you track your glossaries, categories, and terms. You can view a high-level overview of all your glossaries or use a [variety of filters](/product/capabilities/discovery/how-tos/use-the-filters-menu) to drill down further.

Report on queries

The Insights dashboard in the reporting center helps you track metrics for all your [queries](/product/capabilities/insights/how-tos/query-data) and query runs.

Report on usage and cost

The usage and cost dashboard in the reporting center can help you better understand asset usage and optimize your operations accordingly. You can track storage consumption for your assets, sort asset metrics by popularity, and filter assets by context - all in one dashboard.

Routines and Process assets

Frequently asked questions about BigQuery routines and their relationships with Process assets for lineage generation

Set up Dagster

Configure Dagster integration with Atlan to enable asset and lineage capture from your Dagster assets

Set up on-premises Databricks lineage extraction

In some cases you will not be able to expose your Databricks instance for Atlan to extract and ingest lineage. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.

Set up SageMaker

Configure AWS credentials and permissions to connect Atlan to your SageMaker environment.

Source asset type

Detailed parsing rules and configuration details for all supported source asset types in the Lineage Generator (no transformations) app.

Teradata

Catalog and govern Teradata assets in Atlan. Optionally mine query history to build lineage.

View event logs

Event logs help you track and debug events received from supported connectors, providing you with greater observability in Atlan. Event logs are currently stored in Atlan for 7 days.

view lineage

The [lineage](/product/capabilities/lineage/concepts/what-is-lineage) graph in Atlan provides a granular view of the data flows and transformations for your assets. To learn how to use the lineage graph, complete the following steps.