Skip to main content

What does Atlan crawl from dbt Core?

Atlan crawls and maps the following assets and properties from dbt Core. Atlan also supports lineage between the following:

  • dbt models
  • dbt seeds
  • dbt sources
  • SQL tables and views materialized by dbt models, dbt seeds, dbt sources
  • Column-level lineage for these entities

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:

  • Test status - filter dbt tests that passed, failed, or have a warning or error
  • Alias - filter by the name of a dbt model's identifier in the dbt project
  • Unique id - filter by the unique node identifier of a dbt model
  • Project name - filter by dbt project name, only supported for dbt Core version 1.6+
  • Job name - filter by dbt job name
  • Environment name - filter by dbt environment name
  • Job status - filter by dbt job status
  • Last job run - filter by the last run of the dbt job

Atlan's dbt crawler also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

Did you know?

Atlan enables you to sync your dbt tags and update your dbt assets with the synced tags. You can also map other metadata to Atlan's assets through your dbt models.

Tables and views

Atlan maps materialized tables and views from dbt Core to its Table/View asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameasset filter and properties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via dbt files]assetDbtTestStatusAPI and dbt test sidebar

Columns

Atlan maps materialized columns from dbt Core to its Column asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via dbt files]assetDbtTestStatusdbt test sidebar

Models

Atlan maps models from dbt Core to its DbtModel asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
ownersourceCreatedByasset profile and properties sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
raw_sql or raw_codedbtRawSQLoverview sidebar
compiled_sql or compiled_codedbtCompiledSQLoverview sidebar
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
config.materializeddbtMaterializationTypeAPI only
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
statsdbtStatsAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Sources

Atlan maps sources from dbt Core to its DbtSource asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
ownersourceCreatedByasset profile and properties sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameAsset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
statsdbtStatsAPI only
freshnessassetDbtSourceFreshnessCriteriaOverview sidebar
criteriaassetDbtSourceFreshnessCriteriaoverview sidebar
[dynamically generated using accountId, projectId, and uniqueId]sourceURLOverview sidebar

Tests

warning

For dbt Core, upload the run_results.json file to crawl dbt tests. It's recommended to place the file in the same folder as the manifest.json file.

Atlan maps tests from dbt Core to its DbtTest asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter, overview and properties sidebar
packageNameassetDbtPackageNameproperties sidebar
raw_codedbtTestRawCodeoverview sidebar
raw_sqldbtTestRawSQLoverview sidebar
compiled_codedbtTestCompiledCodeoverview sidebar
compiled_sqldbtTestCompiledSQLoverview sidebar
statusdbtTestStatusoverview sidebar
errordbtTestErrorasset profile and overview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Seeds

Atlan maps models from dbt Core to its DbtSeed asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
ownersourceCreatedByasset profile and properties sidebar
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
aliasassetDbtAliasasset filter and properties sidebar
metaassetDbtMetaAPI only
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
statsdbtSeedStatsAPI only
filePathdbtSeedfilePathasset profile and overview sidebar
Was this page helpful?