What does Atlan crawl from dbt Cloud?
Atlan crawls and maps the following assets and properties from dbt Cloud. Atlan also supports lineage between the following:
- dbt models
- dbt seeds
- dbt sources
- SQL tables and views materialized by dbt models, dbt seeds, dbt sources
- Column-level lineage for these entities
Atlan only crawls dbt assets that are in the “applied” (built) state in dbt Cloud. Models must be part of a successful run to be picked up during crawling; models that are only defined in your project files but haven’t been executed won’t be included. For more information about project state, see Project states in dbt Cloud.
Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:
Test status
- filter dbt tests that passed, failed, or have a warning or errorAlias
- filter by the name of a dbt model's identifier in the dbt projectUnique id
- filter by the unique node identifier of a dbt modelProject name
- filter by dbt project name, only supported for dbt Core version 1.6+Environment name
- filter by dbt environment nameJob status
- filter by dbt job statusLast job run
- filter by the last run of the dbt job
Atlan's dbt connectivity also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.
Atlan enables you to sync your dbt tags and update your dbt assets with the synced tags. It's also possible to map other metadata on Atlan's assets through your dbt models.
Tables
Atlan maps tables from dbt Cloud to its Table
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
description | description | asset profile and overview sidebar |
[collected via REST API] | assetDbtTestStatus | API only |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset filter |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
environment.name (collected via REST API) | assetDbtEnvironmentName | API only |
Columns
Atlan maps columns from dbt Cloud to its Column
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
description | description | asset profile and overview sidebar |
[collected via REST API] | assetDbtTestStatus | API only |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset filter |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
Models
Atlan maps models from dbt Cloud to its Model
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
owner | sourceCreatedBy | asset profile and properties sidebar |
[dynamically generated using accountId, projectId, and uniqueId] | sourceURL | overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset filter |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
rawCode (available via REST API) | dbtRawSQL | overview sidebar |
compiledCode (available via REST API) | dbtCompiledSQL | overview sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
materializedType | dbtMaterializationType | API only |
stats | dbtStats | API only |
executionInfo.lastRunStatus | dbtJobRuns.dbtModelRunStatus | overview sidebar |
job.status (available via REST API) | dbtJobRuns.dbtJobRunStatus | overview sidebar |
job.name (available via REST API) | dbtJobRuns.dbtJobName | overview sidebar |
executionInfo.lastJobDefinitionId | dbtJobRuns.dbtJobId | overview sidebar |
executionInfo.lastRunId | dbtJobRuns.dbtJobRunId | API only |
executionInfo.lastRunGeneratedAt | dbtJobRuns.dbtJobRunCompletedAt | overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | overview sidebar |
compiledCode | dbtJobRuns.dbtCompiledCode | API only |
Sources
Atlan maps sources from dbt Cloud to its DbtSource
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name | name | Asset profile and overview sidebar |
description | description | Asset profile and overview sidebar |
owner | sourceCreatedBy | Asset profile and properties sidebar |
[dynamically generated using accountId, projectId, and uniqueId] | sourceURL | Overview sidebar |
alias | assetDbtAlias | Asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | Asset filter and overview sidebar |
accountName | assetDbtAccountName | Asset filter |
projectName | assetDbtProjectName | Asset filter and overview sidebar |
packageName | assetDbtPackageName | Asset filter and properties sidebar |
tags | assetDbtTags | Asset filter and overview sidebar |
stats | dbtStats | API only |
freshness | assetDbtSourceFreshnessCriteria | Overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | Overview sidebar |
Tests
Atlan maps tests from dbt Cloud to its Test
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
[dynamically generated using accountId, projectId, and uniqueId] | sourceURL | overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
account (name) | assetDbtAccountName | asset filter |
project (name) | assetDbtProjectName | asset filter, overview and properties sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
rawCode (available via REST API) | dbtTestRawCode | overview sidebar |
compiledCode (available via REST API) | dbtTestCompiledCode | overview sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
stats | dbtStats | API only |
executionInfo.lastRunError | dbtTestError | overview sidebar |
executionInfo.lastRunStatus | dbtJobRuns.dbtTestRunStatus | overview sidebar |
job.status (available via REST API) | dbtJobRuns.dbtJobRunStatus | overview sidebar |
job.name (available via REST API) | dbtJobRuns.dbtJobName | overview sidebar |
executionInfo.lastJobDefinitionId | dbtJobRuns.dbtJobId | overview sidebar |
executionInfo.lastRunId | dbtJobRuns.dbtJobRunId | API only |
executionInfo.lastRunGeneratedAt | dbtJobRuns.dbtJobRunCompletedAt | overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | overview sidebar |
compiledCode | dbtJobRuns.dbtCompiledCode | API only |
Seeds
Atlan maps models from dbt Core to its Seed
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
executeCompletedAt | sourceUpdatedAt | asset profile and properties sidebar |
owner | sourceCreatedBy | asset profile and properties sidebar |
status | dbtJobRuns.dbtModelRunStatus | overview sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
stats | dbtSeedStats | API only |
filePath | dbtSeedfilePath | asset profile and overview sidebar |