What does Atlan crawl from dbt Cloud?
Atlan crawls and maps the following assets and properties from dbt Cloud. Atlan also supports lineage between the following:
danger
Atlan only crawls dbt assets that are in the “applied” (built) state in dbt Cloud. Models must be part of a successful run to be picked up during crawling; models that are only defined in your project files but haven’t been executed won’t be included. For more information about project state, see Project states in dbt Cloud.
- dbt models
- SQL tables materialized from dbt source tables and dbt models
- SQL tables materialized from dbt source tables and SQL tables materialized by dbt models
- SQL tables materialized by dbt models
- Column-lineage for all of the above
Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:
- Test status - filter dbt tests that passed, failed, or have a warning
- Alias - filter by the name of a dbt model's identifier in the dbt project
- Unique id - filter by the unique node identifier of a dbt model
- Account name - filter by dbt account name
- Project name - filter by dbt project name
- Job name - filter by dbt job name
- Package name - filter by dbt package name
- Environment name - filter by dbt environment name
- Job status - filter by dbt job status
- Last job run - filter by the last run of the dbt job
- Last job run (created at) - filter by when a job run was created
- Last job run (updated at) - filter by when a job run was completed
- Last job run (dequeued at) - filter by when the dbt job scheduler dequeued a job from the wait queue and triggered a run
- Last job run (started at) - filter by when the latest job run started after the job scheduler triggered a run
Atlan's dbt connectivity also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.
Did you know?
Atlan allows you to sync your dbt tags and update your dbt assets with the synced tags. It is also possible to map other metadata on Atlan's assets through your dbt models.
Tables
Atlan maps tables from dbt Cloud to its Table asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
description | description | asset profile and overview sidebar |
| [collected via REST API] | assetDbtTestStatus | API only |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset filter |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
environment.name (collected via REST API) | assetDbtEnvironmentName | API only |
Columns
Atlan maps columns from dbt Cloud to its Column asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
description | description | asset profile and overview sidebar |
| [collected via REST API] | assetDbtTestStatus | API only |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset filter |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
Models
Atlan maps models from dbt Cloud to its Model asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
owner | sourceCreatedBy | asset profile and properties sidebar |
| [dynamically generated using accountId, projectId, and uniqueId] | sourceURL | overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
accountName | assetDbtAccountName | asset filter |
projectName | assetDbtProjectName | asset filter and overview sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
rawCode (available via REST API) | dbtRawSQL | overview sidebar |
compiledCode (available via REST API) | dbtCompiledSQL | overview sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
materializedType | dbtMaterializationType | API only |
stats | dbtStats | API only |
executionInfo.lastRunStatus | dbtJobRuns.dbtModelRunStatus | overview sidebar |
job.status (available via REST API) | dbtJobRuns.dbtJobRunStatus | overview sidebar |
job.name (available via REST API) | dbtJobRuns.dbtJobName | overview sidebar |
executionInfo.lastJobDefinitionId | dbtJobRuns.dbtJobId | overview sidebar |
executionInfo.lastRunId | dbtJobRuns.dbtJobRunId | API only |
executionInfo.lastRunGeneratedAt | dbtJobRuns.dbtJobRunCompletedAt | overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | overview sidebar |
compiledCode | dbtJobRuns.dbtCompiledCode | API only |
Sources
Atlan maps sources from dbt Cloud to its DbtSource asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | Asset profile and overview sidebar |
description | description | Asset profile and overview sidebar |
owner | sourceCreatedBy | Asset profile and properties sidebar |
| [dynamically generated using accountId, projectId, and uniqueId] | sourceURL | Overview sidebar |
alias | assetDbtAlias | Asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | Asset filter and overview sidebar |
accountName | assetDbtAccountName | Asset filter |
projectName | assetDbtProjectName | Asset filter and overview sidebar |
packageName | assetDbtPackageName | Asset filter and properties sidebar |
tags | assetDbtTags | Asset filter and overview sidebar |
stats | dbtStats | API only |
freshness | assetDbtSourceFreshnessCriteria | Overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | Overview sidebar |
Tests
Atlan maps tests from dbt Cloud to its Test asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
| [dynamically generated using accountId, projectId, and uniqueId] | sourceURL | overview sidebar |
alias | assetDbtAlias | asset filter and properties sidebar |
meta | assetDbtMeta | API only |
uniqueId | assetDbtUniqueId | asset filter and overview sidebar |
account (name) | assetDbtAccountName | asset filter |
project (name) | assetDbtProjectName | asset filter, overview and properties sidebar |
packageName | assetDbtPackageName | asset filter and properties sidebar |
rawCode (available via REST API) | dbtTestRawCode | overview sidebar |
compiledCode (available via REST API) | dbtTestCompiledCode | overview sidebar |
tags | assetDbtTags | asset filter and overview sidebar |
stats | dbtStats | API only |
executionInfo.lastRunError | dbtTestError | overview sidebar |
executionInfo.lastRunStatus | dbtJobRuns.dbtTestRunStatus | overview sidebar |
job.status (available via REST API) | dbtJobRuns.dbtJobRunStatus | overview sidebar |
job.name (available via REST API) | dbtJobRuns.dbtJobName | overview sidebar |
executionInfo.lastJobDefinitionId | dbtJobRuns.dbtJobId | overview sidebar |
executionInfo.lastRunId | dbtJobRuns.dbtJobRunId | API only |
executionInfo.lastRunGeneratedAt | dbtJobRuns.dbtJobRunCompletedAt | overview sidebar |
environmentId | dbtJobRuns.dbtEnvironmentId | API only |
environment.name (available via REST API) | dbtJobRuns.dbtEnvironmentName | overview sidebar |
compiledCode | dbtJobRuns.dbtCompiledCode | API only |