Skip to main content

What does Atlan crawl from dbt Cloud?

Atlan crawls and maps the following assets and properties from dbt Cloud. Atlan also supports lineage between the following:

  • dbt models
  • dbt seeds
  • dbt sources
  • SQL tables and views materialized by dbt models, dbt seeds, dbt sources
  • Column-level lineage for these entities
warning

Atlan only crawls dbt assets that are in the “applied” (built) state in dbt Cloud. Models must be part of a successful run to be picked up during crawling; models that are only defined in your project files but haven’t been executed won’t be included. For more information about project state, see Project states in dbt Cloud.

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:

  • Test status - filter dbt tests that passed, failed, or have a warning or error
  • Alias - filter by the name of a dbt model's identifier in the dbt project
  • Unique id - filter by the unique node identifier of a dbt model
  • Project name - filter by dbt project name, only supported for dbt Core version 1.6+
  • Job name - filter by dbt job name
  • Environment name - filter by dbt environment name
  • Job status - filter by dbt job status
  • Last job run - filter by the last run of the dbt job

Atlan's dbt connectivity also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

Did you know?

Atlan enables you to sync your dbt tags and update your dbt assets with the synced tags. You can also map other metadata on Atlan's assets through your dbt models.

Tables and views

Atlan maps materialized tables and views from dbt Cloud to its Table/View asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
environment.name (collected via REST API)assetDbtEnvironmentNameasset profile and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via REST API]assetDbtTestStatusAPI and dbt test sidebar

Columns

Atlan maps materialized columns from dbt Cloud to its Column asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via REST API]assetDbtTestStatusdbt test sidebar

Models

Atlan maps models from dbt Cloud to its DbtModel asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
ownersourceCreatedByasset profile and properties sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
environment.name (available via REST API)dbtJobRuns.dbtEnvironmentNameoverview sidebar
environmentIddbtJobRuns.dbtEnvironmentIdAPI only
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
rawCode (available via REST API)dbtRawSQLoverview sidebar
compiledCode (available via REST API)dbtCompiledSQLoverview sidebar
compiledCodedbtJobRuns.dbtCompiledCodeAPI only
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
executionInfo.lastRunStatusdbtJobRuns.dbtModelRunStatusoverview sidebar
job.name (available via REST API)dbtJobRuns.dbtJobNameoverview sidebar
job.status (available via REST API)dbtJobRuns.dbtJobRunStatusoverview sidebar
executionInfo.lastJobDefinitionIddbtJobRuns.dbtJobIdoverview sidebar
executionInfo.lastRunIddbtJobRuns.dbtJobRunIdAPI only
executionInfo.lastRunGeneratedAtdbtJobRuns.dbtJobRunCompletedAtoverview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
materializedTypedbtMaterializationTypeAPI only
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
statsdbtStatsAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Sources

Atlan maps sources from dbt Cloud to its DbtSource asset type.

Source propertyAtlan propertyWhere in Atlan
namenameAsset profile and overview sidebar
descriptiondescriptionAsset profile and overview sidebar
ownersourceCreatedByAsset profile and properties sidebar
aliasassetDbtAliasAsset filter and properties sidebar
uniqueIdassetDbtUniqueIdAsset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameAsset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsAsset filter and overview sidebar
metaassetDbtMetaAPI only
statsdbtStatsAPI only
freshnessassetDbtSourceFreshnessCriteriaOverview sidebar
criteriaassetDbtSourceFreshnessCriteriaoverview sidebar
[dynamically generated using accountId, projectId, and uniqueId]sourceURLOverview sidebar

Tests

Atlan maps tests from dbt Cloud to its DbtTest asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
environmentIddbtJobRuns.dbtEnvironmentIdAPI only
environment.name (available via REST API)dbtJobRuns.dbtEnvironmentNameoverview sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter, overview and properties sidebar
packageNameassetDbtPackageNameproperties sidebar
rawCode (available via REST API)dbtTestRawCodeoverview sidebar
compiledCode (available via REST API)dbtTestCompiledCodeoverview sidebar
compiledCodedbtJobRuns.dbtCompiledCodeAPI only
statusdbtTestStatusoverview sidebar
executionInfo.lastRunStatusdbtJobRuns.dbtTestRunStatusoverview sidebar
errordbtTestErrorasset profile and overview sidebar
executionInfo.lastRunErrordbtTestErroroverview sidebar
job.name (available via REST API)dbtJobRuns.dbtJobNameoverview sidebar
job.status (available via REST API)dbtJobRuns.dbtJobRunStatusoverview sidebar
executionInfo.lastJobDefinitionIddbtJobRuns.dbtJobIdoverview sidebar
executionInfo.lastRunIddbtJobRuns.dbtJobRunIdAPI only
executionInfo.lastRunGeneratedAtdbtJobRuns.dbtJobRunCompletedAtoverview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Seeds

Atlan maps models from dbt Core to its DbtSeed asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
ownersourceCreatedByasset profile and properties sidebar
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
aliasassetDbtAliasasset filter and properties sidebar
metaassetDbtMetaAPI only
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
statsdbtSeedStatsAPI only
filePathdbtSeedfilePathasset profile and overview sidebar
Was this page helpful?