Skip to main content

What does Atlan crawl from dbt Core?

Atlan crawls and maps the following assets and properties from dbt Core. Atlan also supports lineage between the following:

  • dbt models
  • dbt seeds
  • dbt sources
  • dbt semantic models, measures, dimensions, and entities
  • dbt metrics
  • SQL tables and views materialized by dbt models, dbt seeds, dbt sources
  • Column-level lineage for dbt models, dbt seeds, dbt sources and their materialized counterparts
  • Semantic layer lineage (model → semantic model → metric)

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:

  • Test status - filter dbt tests that passed, failed, or have a warning or error
  • Alias - filter by the name of a dbt model's identifier in the dbt project
  • Unique id - filter by the unique node identifier of a dbt model
  • Project name - filter by dbt project name, only supported for dbt Core version 1.6+
  • Job name - filter by dbt job name
  • Environment name - filter by dbt environment name
  • Job status - filter by dbt job status
  • Last job run - filter by the last run of the dbt job

Atlan's dbt crawler also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

Did you know?

Atlan enables you to sync your dbt tags and update your dbt assets with the synced tags. You can also map other metadata to Atlan's assets through your dbt models.

Tables and views

Atlan maps materialized tables and views from dbt Core to its Table/View asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameasset filter and properties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via dbt files]assetDbtTestStatusAPI and dbt test sidebar

Columns

Atlan maps materialized columns from dbt Core to its Column asset type.

Source propertyAtlan propertyWhere in Atlan
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[collected via dbt files]assetDbtTestStatusdbt test sidebar

Models

Atlan maps models from dbt Core to its DbtModel asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
ownersourceCreatedByasset profile and properties sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
raw_sql or raw_codedbtRawSQLoverview sidebar
compiled_sql or compiled_codedbtCompiledSQLoverview sidebar
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
config.materializeddbtMaterializationTypeAPI only
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
statsdbtStatsAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Sources

Atlan maps sources from dbt Core to its DbtSource asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
ownersourceCreatedByasset profile and properties sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameAsset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
statsdbtStatsAPI only
freshnessassetDbtSourceFreshnessCriteriaOverview sidebar
criteriaassetDbtSourceFreshnessCriteriaoverview sidebar
[dynamically generated using accountId, projectId, and uniqueId]sourceURLOverview sidebar

Tests

warning

For dbt Core, upload the run_results.json file to crawl dbt tests. It's recommended to place the file in the same folder as the manifest.json file.

Atlan maps tests from dbt Core to its DbtTest asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
aliasassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter, overview and properties sidebar
packageNameassetDbtPackageNameproperties sidebar
raw_codedbtTestRawCodeoverview sidebar
raw_sqldbtTestRawSQLoverview sidebar
compiled_codedbtTestCompiledCodeoverview sidebar
compiled_sqldbtTestCompiledSQLoverview sidebar
statusdbtTestStatusoverview sidebar
errordbtTestErrorasset profile and overview sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
[dynamically generated using accountId, projectId, and uniqueId]sourceURLoverview sidebar

Seeds

Atlan maps seeds from dbt Core to its DbtSeed asset type.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
executeCompletedAtsourceUpdatedAtasset profile and properties sidebar
ownersourceCreatedByasset profile and properties sidebar
statusdbtJobRuns.dbtModelRunStatusoverview sidebar
aliasassetDbtAliasasset filter and properties sidebar
metaassetDbtMetaAPI only
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
statsdbtSeedStatsAPI only
filePathdbtSeedfilePathasset profile and overview sidebar

Semantic models

Atlan maps semantic models from dbt Core to its DbtSemanticModel asset type. Semantic models are containers for measures, entities, and dimensions that define the structure of your metrics layer.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
unique_idassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only

Measures, dimensions, and entities

Atlan maps measures, dimensions, and entities from dbt Core to their respective asset types: DbtMeasure, DbtDimension, and DbtEntity.

Source propertyAtlan propertyWhere in Atlan
namenameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
exprsemanticExpressionoverview sidebar
aggsemanticTypeoverview sidebar (measures only)
typesemanticTypeoverview sidebar (dimensions and entities only)

Metrics

Atlan maps metrics from dbt Core to its DbtMetric asset type. Metrics are calculated business metrics that can be simple aggregations, cumulative calculations, derived expressions, ratios, or conversion rates.

Source propertyAtlan propertyWhere in Atlan
labelnameasset profile and overview sidebar
descriptiondescriptionasset profile and overview sidebar
nameassetDbtAliasasset filter and properties sidebar
uniqueIdassetDbtUniqueIdasset filter and overview sidebar
accountNameassetDbtAccountNameasset qualified name
projectNameassetDbtProjectNameasset filter and overview sidebar
packageNameassetDbtPackageNameproperties sidebar
tagsassetDbtTagsasset filter and overview sidebar
metaassetDbtMetaAPI only
typemetricTypeoverview sidebar
formulametricSQLoverview sidebar
filterdbtMetricFilteroverview sidebar
windowdbtMetricWindowoverview sidebar
cumulative_type_params.period_aggdbtMetricCumulativePeriodAggoverview sidebar
conversion_type_params.calculationdbtMetricConversionCalculationoverview sidebar

Metric lineage

Atlan creates DbtProcess assets to visualize how metrics are calculated from upstream dependencies. Atlan captures the following lineage relationships for dbt Semantic Layer assets:

SourceTarget
ModelSemantic Model
MeasureMetric
Semantic ModelMetric
MetricMetric
Source propertyAtlan propertyWhere in Atlan
formulasqloverview sidebar
[dynamically generated]dbtUpstreamContextsoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextNameoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextQualifiedNameoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextTypeoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextAliasoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextFilteroverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextOffsetWindowoverview sidebar
[dynamically generated]dbtUpstreamContexts[].dbtInputContextOffsetToGrainoverview sidebar
Was this page helpful?