Skip to main content

What does Atlan crawl from dbt Cloud?

Atlan crawls and maps the following assets and properties from dbt Cloud. Atlan also supports lineage between the following:

  • dbt models
  • dbt seeds
  • dbt sources
  • dbt semantic models, measures, dimensions, and entities
  • dbt metrics
  • SQL tables and views materialized by dbt models, dbt seeds, dbt sources
  • Column-level lineage for dbt models, dbt seeds, dbt sources and their materialized counterparts
  • Semantic layer lineage (model → semantic model → metric)
warning

Atlan only crawls dbt assets that are in the "applied" (built) state in dbt Cloud. Models must be part of a successful run to be picked up during crawling; models that are only defined in your project files but haven't been executed won't be included. For more information about project state, see Project states in dbt Cloud.

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:

  • Test status - filter dbt tests that passed, failed, or have a warning or error
  • Alias - filter by the name of a dbt model's identifier in the dbt project
  • Unique id - filter by the unique node identifier of a dbt model
  • Project name - filter by dbt project name, only supported for dbt Core version 1.6+
  • Job name - filter by dbt job name
  • Environment name - filter by dbt environment name
  • Job status - filter by dbt job status
  • Last job run - filter by the last run of the dbt job

Atlan's dbt connectivity also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

Did you know?

Atlan enables you to sync your dbt tags and update your dbt assets with the synced tags. You can also map other metadata on Atlan's assets through your dbt models.

Tables and views

Atlan maps materialized tables and views from dbt Cloud to its Table/View asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
environment.name (collected via REST API)assetDbtEnvironmentNameasset profile and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via REST API]assetDbtTestStatusAPI and dbt test sidebar

Columns

Atlan maps materialized columns from dbt Cloud to its Column asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via REST API]assetDbtTestStatusdbt test sidebar

Models

Atlan maps models from dbt Cloud to its DbtModel asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
ownersourceCreatedByasset profile and properties sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
environment.name (available via REST API)dbtJobRuns.dbtEnvironmentNameoverview sidebar
environmentIddbtJobRuns.dbtEnvironmentIdAPI only
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
rawCode (available via REST API)dbtRawSQLoverview sidebar
compiledCode (available via REST API)dbtCompiledSQLoverview sidebar
compiledCodedbtJobRuns.dbtCompiledCodeAPI only
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
executionInfo.lastRunStatusdbtJobRuns.dbtModelRunStatusoverview sidebar
job.name (available via REST API)dbtJobRuns.dbtJobNameoverview sidebar
job.status (available via REST API)dbtJobRuns.dbtJobRunStatusoverview sidebar
executionInfo.lastJobDefinitionIddbtJobRuns.dbtJobIdoverview sidebar
executionInfo.lastRunIddbtJobRuns.dbtJobRunIdAPI only
executionInfo.lastRunGeneratedAtdbtJobRuns.dbtJobRunCompletedAtoverview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
materializedTypedbtMaterializationTypeAPI only
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
statsdbtStatsAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Sources

Atlan maps sources from dbt Cloud to its DbtSource asset type.

Source propertyAtlan propertyWhere in Atlan
namenameAsset profile and overview sidebar
descriptiondescriptionAsset profile and overview sidebar
ownersourceCreatedByAsset profile and properties sidebar
aliasassetDbtAliasAsset filter and properties sidebar
uniqueIdassetDbtUniqueIdAsset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameAsset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsAsset filter and overview sidebar
metaassetDbtMetaAPI only
statsdbtStatsAPI only
freshnessassetDbtSourceFreshnessCriteriaOverview sidebar
criteriaassetDbtSourceFreshnessCriteriaoverview sidebar
[dynamically generated using accountId, projectId, and uniqueId]sourceURLOverview sidebar

Tests

Atlan maps tests from dbt Cloud to its DbtTest asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
environmentIddbtJobRuns.dbtEnvironmentIdAPI only
environment.name (available via REST API)dbtJobRuns.dbtEnvironmentNameoverview sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter, overview and properties sidebar
packageNameassetDbtPackageNameproperties sidebar
rawCode (available via REST API)dbtTestRawCodeoverview sidebar
compiledCode (available via REST API)dbtTestCompiledCodeoverview sidebar
compiledCodedbtJobRuns.dbtCompiledCodeAPI only
statusdbtTestStatusoverview sidebar
executionInfo.lastRunStatusdbtJobRuns.dbtTestRunStatusoverview sidebar
errordbtTestErrorasset profile and overview sidebar
executionInfo.lastRunErrordbtTestErroroverview sidebar
job.name (available via REST API)dbtJobRuns.dbtJobNameoverview sidebar
job.status (available via REST API)dbtJobRuns.dbtJobRunStatusoverview sidebar
executionInfo.lastJobDefinitionIddbtJobRuns.dbtJobIdoverview sidebar
executionInfo.lastRunIddbtJobRuns.dbtJobRunIdAPI only
executionInfo.lastRunGeneratedAtdbtJobRuns.dbtJobRunCompletedAtoverview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Seeds

Atlan maps seeds from dbt Cloud to its DbtSeed asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
ownersourceCreatedByasset profile and properties sidebar
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
aliasassetDbtAliasasset filter and properties sidebar
metaassetDbtMetaAPI only
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
statsdbtSeedStatsAPI only
filePathdbtSeedfilePathasset profile and overview sidebar

Semantic models

Atlan maps semantic models from dbt Cloud to its DbtSemanticModel asset type. Semantic models are containers for measures, entities, and dimensions that define the structure of your metrics layer.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
unique_idassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only

Measures, dimensions, and entities

Atlan maps measures, dimensions, and entities from dbt Cloud to their respective asset types: DbtMeasure, DbtDimension, and DbtEntity.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
exprsemanticExpressionoverview sidebar
aggsemanticTypeoverview sidebar (measures only)
typesemanticTypeoverview sidebar (dimensions and entities only)

Metrics

Atlan maps metrics from dbt Cloud to its DbtMetric asset type. Metrics are calculated business metrics that can be simple aggregations, cumulative calculations, derived expressions, ratios, or conversion rates.

Source propertyAtlan propertyWhere in Atlan
labelnameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
nameassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
typemetricTypeoverview sidebar
formulametricSQLoverview sidebar
filterdbtMetricFilteroverview sidebar
windowdbtMetricWindowoverview sidebar
cumulative_type_params.period_aggdbtMetricCumulativePeriodAggoverview sidebar
conversion_type_params.calculationdbtMetricConversionCalculationoverview sidebar

Metric lineage

Atlan creates DbtProcess assets to visualize how metrics are calculated from upstream dependencies. Atlan captures the following lineage relationships for dbt Semantic Layer assets:

SourceTarget
ModelSemantic Model
MeasureMetric
Semantic ModelMetric
MetricMetric
Source propertyAtlan propertyWhere in Atlan
formulasqloverview sidebar
[dynamically generated]dbtUpstreamContextsoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextNameoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextQualifiedNameoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextTypeoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextAliasoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextFilteroverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextOffsetWindowoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextOffsetToGrainoverview sidebar
Was this page helpful?