What does Atlan crawl from Amazon S3
This document provides complete details on the S3 assets and properties that Atlan crawls and maps during the S3 cataloging process. Atlan supports two ingestion modes with different property coverage.
Buckets
Atlan maps buckets from S3 to its S3Bucket
asset type.
Source Property | Atlan Property | Ingestion Mode |
---|---|---|
Bucket Name | name | Direct, Inventory |
Object Count | s3ObjectCount | Direct, Inventory |
Console URL | sourceURL | Direct |
Region | awsRegion | Direct |
ServerSideEncryptionConfiguration | s3Encryption | Direct |
Versioning Status | s3BucketVersioningEnabled | Direct |
Objects
Atlan maps objects from S3 to its S3Object
asset type.
Source Property | Atlan Property | Ingestion Mode |
---|---|---|
Object Name | name | Direct, Inventory |
Object Key | s3ObjectKey | Direct, Inventory |
Bucket Name | s3BucketName | Direct, Inventory |
Object Size (bytes) | s3ObjectSize | Direct, Inventory |
LastModifiedDate | s3ObjectLastModifiedTime | Direct, Inventory |
StorageClass | s3ObjectStorageClass | Direct, Inventory |
ETag | s3ETag | Direct, Inventory |
Console URL | sourceURL | Direct |
Region | awsRegion | Direct |
Content Type | s3ObjectContentType | Direct |
Content Disposition | s3ObjectContentDisposition | Direct |
Version ID | s3ObjectVersionId | Direct |
See also
- Set up S3: Configure AWS permissions and environment
- Crawl S3 assets: Step-by-step guide for setting up S3 crawling