What does Atlan crawl from dbt Cloud?
Atlan crawls and maps the following assets and properties from dbt Cloud. Atlan also supports lineage between the following:
- dbt models
- dbt seeds
- dbt sources
- SQL tables and views materialized by dbt models, dbt seeds, dbt sources
- Column-level lineage for these entities
Atlan only crawls dbt assets that are in the “applied” (built) state in dbt Cloud. Models must be part of a successful run to be picked up during crawling; models that are only defined in your project files but haven’t been executed won’t be included. For more information about project state, see Project states in dbt Cloud.
Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:
Test status- filter dbt tests that passed, failed, or have a warning or errorAlias- filter by the name of a dbt model's identifier in the dbt projectUnique id- filter by the unique node identifier of a dbt modelProject name- filter by dbt project name, only supported for dbt Core version 1.6+Job name- filter by dbt job nameEnvironment name- filter by dbt environment nameJob status- filter by dbt job statusLast job run- filter by the last run of the dbt job
Atlan's dbt connectivity also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.
Atlan enables you to sync your dbt tags and update your dbt assets with the synced tags. You can also map other metadata on Atlan's assets through your dbt models.
Tables and views
Atlan maps materialized tables and views from dbt Cloud to its Table/View asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
description | description | asset profile and overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
environment.name (collected via REST API) | assetDbtEnvironmentName | asset profile and overview sidebar |
accountName | assetDbtAccountName | asset qualified name |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | properties sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
meta | assetDbtMeta | API only |
| [collected via REST API] | assetDbtTestStatus | API and dbt test sidebar |
Columns
Atlan maps materialized columns from dbt Cloud to its Column asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
description | description | asset profile and overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset qualified name |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | properties sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
meta | assetDbtMeta | API only |
| [collected via REST API] | assetDbtTestStatus | dbt test sidebar |
Models
Atlan maps models from dbt Cloud to its DbtModel asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
owner | sourceCreatedBy | asset profile and properties sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
accountName | assetDbtAccountName | asset qualified name |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | properties sidebar |
rawCode (available via REST API) | dbtRawSQL | overview sidebar |
compiledCode (available via REST API) | dbtCompiledSQL | overview sidebar |
compiledCode | dbtJobRuns.dbtCompiledCode | API only |
status | dbtJobRuns.dbtModelRunStatus | overview sidebar |
executionInfo.lastRunStatus | dbtJobRuns.dbtModelRunStatus | overview sidebar |
job.name (available via REST API) | dbtJobRuns.dbtJobName | overview sidebar |
job.status (available via REST API) | dbtJobRuns.dbtJobRunStatus | overview sidebar |
executionInfo.lastJobDefinitionId | dbtJobRuns.dbtJobId | overview sidebar |
executionInfo.lastRunId | dbtJobRuns.dbtJobRunId | API only |
executionInfo.lastRunGeneratedAt | dbtJobRuns.dbtJobRunCompletedAt | overview sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
meta | assetDbtMeta | API only |
materializedType | dbtMaterializationType | API only |
executeCompletedAt | sourceUpdatedAt | asset profile and properties sidebar |
stats | dbtStats | API only |
| [dynamically generated using accountId, projectId, and uniqueId] | sourceURL | overview sidebar |
Sources
Atlan maps sources from dbt Cloud to its DbtSource asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | Asset profile and overview sidebar |
description | description | Asset profile and overview sidebar |
owner | sourceCreatedBy | Asset profile and properties sidebar |
alias | assetDbtAlias | Asset filter and properties sidebar |
uniqueId | assetDbtUniqueId | Asset filter and overview sidebar |
accountName | assetDbtAccountName | asset qualified name |
projectName | assetDbtProjectName | Asset filter and overview sidebar |
packageName | assetDbtPackageName | properties sidebar |
tags | assetDbtTags | Asset filter and overview sidebar |
meta | assetDbtMeta | API only |
stats | dbtStats | API only |
freshness | assetDbtSourceFreshnessCriteria | Overview sidebar |
criteria | assetDbtSourceFreshnessCriteria | overview sidebar |
| [dynamically generated using accountId, projectId, and uniqueId] | sourceURL | Overview sidebar |
Tests
Atlan maps tests from dbt Cloud to its DbtTest asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | overview sidebar |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset qualified name |
projectName | assetDbtProjectName | asset filter, overview and properties sidebar |
packageName | assetDbtPackageName | properties sidebar |
rawCode (available via REST API) | dbtTestRawCode | overview sidebar |
compiledCode (available via REST API) | dbtTestCompiledCode | overview sidebar |
compiledCode | dbtJobRuns.dbtCompiledCode | API only |
status | dbtTestStatus | overview sidebar |
executionInfo.lastRunStatus | dbtJobRuns.dbtTestRunStatus | overview sidebar |
error | dbtTestError | asset profile and overview sidebar |
executionInfo.lastRunError | dbtTestError | overview sidebar |
job.name (available via REST API) | dbtJobRuns.dbtJobName | overview sidebar |
job.status (available via REST API) | dbtJobRuns.dbtJobRunStatus | overview sidebar |
executionInfo.lastJobDefinitionId | dbtJobRuns.dbtJobId | overview sidebar |
executionInfo.lastRunId | dbtJobRuns.dbtJobRunId | API only |
executionInfo.lastRunGeneratedAt | dbtJobRuns.dbtJobRunCompletedAt | overview sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
meta | assetDbtMeta | API only |
| [dynamically generated using accountId, projectId, and uniqueId] | sourceURL | overview sidebar |
Seeds
Atlan maps models from dbt Core to its DbtSeed asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
executeCompletedAt | sourceUpdatedAt | asset profile and properties sidebar |
owner | sourceCreatedBy | asset profile and properties sidebar |
status | dbtJobRuns.dbtModelRunStatus | overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
stats | dbtSeedStats | API only |
filePath | dbtSeedfilePath | asset profile and overview sidebar |