What are partial assets?

If a supported data source has not been crawled, mined, or cataloged via APIs but is present in lineage, Atlan will create partial assets to provide a complete representation of data lineage. For example, if your orchestration pipelines reference any assets as a source or target that are yet to be cataloged in Atlan, these will be represented as partial assets on the lineage graph.

Key characteristics of partial assets:

• Displayed with a dotted border on the lineage graph.
• Available in the visual representation of lineage in Atlan - lineage or pipeline view.
• You can search for and view a partial asset profile and lineage.
• You can not enrich metadata for partial assets.
• You can view metadata for partial assets in the sidebar.
• You can view and download the impact report for partial assets.
• Column-level lineage for partial assets is supported.

Supported sources

Atlan currently supports the creation of partial assets for the following tools:

• Airflow/OpenLineage
• Amazon MWAA/OpenLineage
• Astronomer/OpenLineage
• Google Cloud Composer/OpenLineage
• Apache Spark/OpenLineage
• Fivetran

View partial assets

There are multiple ways to view partial assets :

Like any asset in Atlan

1. From the left menu of any screen, click Assets.
2. Search for asset by name, or use Atlan discovery filter to find partial assets.
3. Click an asset to open its profile.

From pipeline lineage or lineage graph

1. From the top left of an asset profile, click the Lineage tab to view lineage or the Pipeline tab for orchestration assets.
2. A partial asset is represented with a dotted border on the lineage graph. Select a partial asset to view more details.

• (Optional) Open the asset sidebar to view metadata, lineage, and properties of the partial asset, and navigate to the profile.

3. Hover over the partial asset to view a metadata popover:

• You can view the following details - asset name and type, connection, database, and schema names, and owner, if assigned.
• Click the View impact button to view impacted assets.
• Click the Download impact button to download the lineage report for the asset.

4. Click the view columns menu to view column assets.

• Hover over any column name and then click the curved downward arrow to view impacted assets or click the straight downward arrow to download the impact report directly from the column.

Convert partial assets to catalogued asstes

To convert a partial asset into a fully published asset, complete the following steps in any order:

• If the sourcer is supported, run the crawler for the supported data source of the partial asset.
• Run the orchestration pipeline that initially cataloged the partial asset.