Skip to main content

10 docs tagged with "s3"

View all tags

Amazon S3

Integrate, catalog, and govern Amazon S3 assets in Atlan.

Crawl S3 assets

Configure and run the S3 crawler to catalog your Amazon S3 buckets and objects in Atlan.

Generate lineage with Generic Miner

Configure and run Generic Miner to extract table-level and column-level lineage from SQL query history stored in Atlan's object store, Amazon S3, Google Cloud Storage, or Azure Blob Storage—without a live connection to the source system.

Import assets from S3

Bulk import or update asset metadata in Atlan using a CSV file stored in Amazon S3. The Asset Import app supports direct CSV import from S3 buckets, enabling you to create or update connections, databases, schemas, tables, and columns in one workflow.

Lineage and asset loader

Complete configuration reference for the Lineage and asset loader app, including S3 authentication methods, CSV file schema, asset creation controls, and workflow settings.

Load lineage and assets from CSV

Create lineage and optionally generate assets in Atlan from a source-to-target CSV mapping file stored in Amazon S3. The Lineage and asset loader app reads CSV mappings, creates lineage relationships, and optionally creates missing source or target assets.

Mine queries through cloud object storage

Prepare SQL query history files and configure cloud object storage access so Generic Miner can extract lineage from query logs stored in Atlan's object store, Amazon S3, Google Cloud Storage, or Azure Blob Storage.

S3 Inventory Report Structure

Expected folder structure and format for S3 inventory reports used by Atlan's S3 crawler for inventory-based ingestion.