What does Atlan crawl from Google Cloud Dataplex
Atlan crawls comprehensive aspect metadata from your Google Cloud Dataplex Catalog, including aspect details, fields, labels, and timestamps attached to your data assets.
Aspects
Aspects are custom metadata schemas attached to assets in Dataplex Catalog. Atlan crawls aspect details including fields, labels, and timestamps.
| Source field | Atlan field | Description |
|---|---|---|
| Aspect list | assetV3GCPDataplexAspectList | Array of aspect names attached to the asset |
| Aspect field list | assetV3GCPDataplexAspectFieldList | Array of formatted aspect field strings (format: `aspectName |
| Aspect full name | assetV3GCPDataplexAspectDetails.{aspectName}.assetV3GCPDataplexAspectFullName | Full qualified name of the aspect |
| Aspect type | assetV3GCPDataplexAspectDetails.{aspectName}.assetV3GCPDataplexAspectType | Aspect type path (for example, projects/{project}/locations/{location}/aspectTypes/{aspectType}) |
| Aspect type labels | assetV3GCPDataplexAspectDetails.{aspectName}.assetV3GCPDataplexAspectTypeLabels | Labels associated with the aspect type (key-value pairs) |
| Aspect created at | assetV3GCPDataplexAspectDetails.{aspectName}.assetV3GCPDataplexAspectCreatedAt | Timestamp when the aspect was created |
| Aspect updated at | assetV3GCPDataplexAspectDetails.{aspectName}.assetV3GCPDataplexAspectUpdatedAt | Timestamp when the aspect was last updated |
| Aspect fields | assetV3GCPDataplexAspectDetails.{aspectName}.assetV3GCPDataplexAspectFields | Object containing aspect field values (key-value pairs) |
Metadata details
Atlan stores additional metadata about the Dataplex sync process.
| Source field | Atlan field | Description |
|---|---|---|
| Last sync run at | assetV3GCPDataplexMetadataDetails.assetV3GCPDataplexLastSyncRunAt | Timestamp of the last successful sync from Dataplex |
See also
- Set up Dataplex: Configure Dataplex connection and authentication