Skip to main content

What does Atlan crawl from Amazon S3

This document provides complete details on the S3 assets and properties that Atlan crawls and maps during the S3 cataloging process. Atlan supports two ingestion modes with different property coverage.

Buckets

Atlan maps buckets from S3 to its S3Bucket asset type.

Source PropertyAtlan PropertyIngestion Mode
Bucket NamenameDirect, Inventory
Object Counts3ObjectCountDirect, Inventory
Console URLsourceURLDirect
RegionawsRegionDirect
ServerSideEncryptionConfigurations3EncryptionDirect
Versioning Statuss3BucketVersioningEnabledDirect

Objects

Atlan maps objects from S3 to its S3Object asset type.

Source PropertyAtlan PropertyIngestion Mode
Object NamenameDirect, Inventory
Object Keys3ObjectKeyDirect, Inventory
Bucket Names3BucketNameDirect, Inventory
Object Size (bytes)s3ObjectSizeDirect, Inventory
LastModifiedDates3ObjectLastModifiedTimeDirect, Inventory
StorageClasss3ObjectStorageClassDirect, Inventory
ETags3ETagDirect, Inventory
Console URLsourceURLDirect
RegionawsRegionDirect
Content Types3ObjectContentTypeDirect
Content Dispositions3ObjectContentDispositionDirect
Version IDs3ObjectVersionIdDirect

See also