What does Atlan crawl from dbt Core?

Atlan crawls and maps the following assets and properties from dbt Core. Atlan also supports lineage between the following:

• dbt models
• SQL tables materialized from dbt source tables and dbt models
• SQL tables materialized from dbt source tables and SQL tables materialized by dbt models
• SQL tables materialized by dbt models
• Column-lineage for all of the above

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:

• Test status - filter dbt tests that passed, failed, or have a warning
• Alias - filter by the name of a dbt model's identifier in the dbt project
• Unique id - filter by the unique node identifier of a dbt model
• Account name - filter by dbt account name
• Project name - filter by dbt project name, only supported for dbt Core version 1.6+
• Job name - filter by dbt job name
• Package name - filter by dbt package name
• Environment name - filter by dbt environment name
• Job status - filter by dbt job status
• Last job run - filter by the last run of the dbt job
• Last job run (created at) - filter by when a job run was created
• Last job run (updated at) - filter by when a job run was completed
• Last job run (dequeued at) - filter by when the dbt job scheduler dequeued a job from the wait queue and triggered a run
• Last job run (started at) - filter by when the latest job run started after the job scheduler triggered a run

Atlan's dbt crawler also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

Did you know?

Atlan allows you to sync your dbt tags and update your dbt assets with the synced tags. It's also possible to map other metadata on Atlan's assets through your dbt models.

Tables

Atlan maps tables from dbt Core to its Table asset type.

Source property	Atlan property	Where in Atlan
description	description	asset profile and overview sidebar
config (alias)	alias	asset filter and properties sidebar
stats (row_count)	rowCount	asset profile and filter, overview sidebar
stats (bytes)	sizeBytes	asset filter and overview sidebar
stats (last_modified)	sourceUpdatedAt	asset profile and properties sidebar

Source property	Atlan dbt-specific property	Where in Atlan
project (name)	assetDbtProjectName	asset filter and overview sidebar
uniqueId	assetDbtUniqueId	asset filter and overview sidebar
raw_sql or raw_code	dbtRawSQL	overview sidebar
tags	assetDbtTags	asset filter and overview sidebar
packageName	assetDbtPackageName	asset filter and properties sidebar
alias	assetDbtAlias	asset filter and properties sidebar
description	description	asset profile and overview sidebar
created_at	sourceCreatedAt	asset profile, overview and properties sidebar
compiled_sql or compiled_code	dbtCompiledSQL	overview sidebar
freshness_data (criteria)	assetDbtSourceFreshnessCriteria	overview sidebar

Columns

Atlan maps columns from dbt Core to its Column asset type.

Source property	Atlan property	Where in Atlan
description	description	asset profile and overview sidebar

Source property	Atlan dbt-specific property	Where in Atlan
meta	assetDbtMeta	API only
tags	assetDbtTags	asset filter and overview sidebar
packageName	assetDbtPackageName	asset filter and properties sidebar
description	description	asset profile and overview sidebar
created_at	sourceCreatedAt	asset profile, overview and properties sidebar

Models

Atlan maps models from dbt Core to its Model asset type.

Source property	Atlan property	Where in Atlan
name	name	asset profile and overview sidebar
description	description	asset profile and overview sidebar
executeCompletedAt	sourceUpdatedAt	asset profile and properties sidebar
owner	sourceCreatedBy	asset profile and properties sidebar
status	dbtJobRuns.dbtModelRunStatus	overview sidebar

Source property	Atlan dbt-specific property	Where in Atlan
alias	assetDbtAlias	asset filter and properties sidebar
meta	assetDbtMeta	API only
uniqueId	assetDbtUniqueId	asset filter and overview sidebar
raw_sql or raw_code	dbtRawSQL	overview sidebar
compiled_sql or compiled_code	dbtCompiledSQL	overview sidebar
stats	dbtStats	API only
config.materialized	dbtMaterializationType	API only

Sources

Atlan maps sources from dbt Core to its DbtSource asset type.

Source property	Atlan property	Where in Atlan
name	name	asset profile and overview sidebar
description	description	asset profile and overview sidebar
owner	sourceCreatedBy	asset profile and properties sidebar

Source property	Atlan dbt-specific property	Where in Atlan
alias	assetDbtAlias	asset filter and properties sidebar
meta	assetDbtMeta	API only
uniqueId	assetDbtUniqueId	asset filter and overview sidebar
tags	assetDbtTags	asset filter and overview sidebar
criteria	assetDbtSourceFreshnessCriteria	overview sidebar
stats	dbtStats	API only
state	dbtState	API only

Tests

danger

For dbt Core, you need to upload the run_results.json file to crawl dbt tests. We recommend uploading the file to the same folder as the manifest.json file.

Atlan maps tests from dbt Core to its Test asset type.

Source property	Atlan property	Where in Atlan
name	name	asset profile and overview sidebar
description	description	asset profile and overview sidebar

Source property	Atlan dbt-specific property	Where in Atlan
name	assetDbtAlias	asset filter and properties sidebar
meta	assetDbtMeta	API only
uniqueId	assetDbtUniqueId	asset filter and overview sidebar
tags	assetDbtTags	asset filter and overview sidebar
status	dbtTestStatus	asset profile
state	dbtTestState	API only
error	dbtTestError	asset profile and overview sidebar
raw_code	dbtTestRawCode	overview sidebar
raw_sql	dbtTestRawSQL	overview sidebar
compiled_code	dbtTestCompiledCode	API only
compiled_sql	dbtTestCompiledSQL	API only
language	dbtTestLanguage	asset profile and overview sidebar