Skip to main content

What does Atlan crawl from Google Cloud Dataplex

Atlan crawls aspect metadata from your Google Cloud Dataplex Catalog, including aspect details, fields, labels, and timestamps attached to your data assets.

Aspects

Aspects are custom metadata schemas attached to assets in Dataplex Catalog. Atlan crawls aspect details including fields, labels, and timestamps.

Source fieldAtlan fieldDescription
Aspect listassetGCPDataplexAspectListArray of aspect names attached to the asset
Aspect field listassetGCPDataplexAspectFieldListArray of formatted aspect field strings (format: aspectName|||fieldName|||fieldValue)
Aspect full nameassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectFullNameFully qualified name of the aspect
Aspect display nameassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectDisplayNameHuman-readable display name of the aspect
Aspect typeassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectTypeAspect type path (for example, projects/{project}/locations/{location}/aspectTypes/{aspectType})
Aspect type labelsassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectTypeLabelsLabels associated with the aspect type (key-value pairs)
Aspect created atassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectCreatedAtTimestamp when the aspect was created
Aspect updated atassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectUpdatedAtTimestamp when the aspect was last updated
Aspect fieldsassetGCPDataplexAspectDetails.{aspectName}.assetGCPDataplexAspectFieldsObject containing aspect field values (key-value pairs)

Metadata details

Atlan stores additional metadata about the Dataplex sync process.

Source fieldAtlan fieldDescription
Last sync run atassetGCPDataplexMetadataDetails.assetGCPDataplexLastSyncRunAtTimestamp of the last successful sync from Dataplex

See also