What does Atlan crawl from Amazon S3
This document provides complete details on the S3 assets and properties that Atlan crawls and maps during the S3 cataloging process. Atlan supports two ingestion modes with different property coverage.
Buckets
Atlan maps buckets from S3 to its S3Bucket asset type.
| Source Property | Atlan Property | Ingestion Mode |
|---|---|---|
| Bucket Name | name | Direct, Inventory |
| Object Count | s3ObjectCount | Direct, Inventory |
| Console URL | sourceURL | Direct |
| Region | awsRegion | Direct |
| Account ID | awsAccountId | Direct |
| ServerSideEncryptionConfiguration | s3Encryption | Direct |
| Versioning Status | s3BucketVersioningEnabled | Direct |
| Bucket Tags | awsTags | Direct |
| Bucket Creation Date | sourceCreatedAt | Direct |
Objects
Atlan maps objects from S3 to its S3Object asset type.
| Source Property | Atlan Property | Ingestion Mode |
|---|---|---|
| Object Name | name | Direct, Inventory |
| Object Key | s3ObjectKey | Direct, Inventory |
| Bucket Name | s3BucketName | Direct, Inventory |
| Object Size (bytes) | s3ObjectSize | Direct, Inventory |
| LastModifiedDate | s3ObjectLastModifiedTime | Direct, Inventory |
| StorageClass | s3ObjectStorageClass | Direct, Inventory |
| ETag | s3ETag | Direct, Inventory |
| Object Lock Retain Until Date | s3ObjectLockRetainUntil | Direct, Inventory |
| Object Lock Mode | s3ObjectLockMode | Direct, Inventory |
| Object Lock Legal Hold Status | s3ObjectLockLegalHoldEnabled | Direct, Inventory |
| Object Owner ID | awsOwnerId | Direct, Inventory |
| Console URL | sourceURL | Direct |
| Region | awsRegion | Direct |
| Content Type | s3ObjectContentType | Direct |
| Account ID | awsAccountId | Direct |
| Content Disposition | s3ObjectContentDisposition | Direct |
| Version ID | s3ObjectVersionId | Direct |
| Object Tags | awsTags | Direct |
| Object Owner Name | awsOwnerName | Direct |
See also
- Set up S3: Configure AWS permissions and environment
- Crawl S3 assets: Step-by-step guide for setting up S3 crawling