What does Atlan crawl from Iceberg

✦TL;DR

Learn what assets and metadata Atlan crawls from Iceberg data lakehouse.

||

Your AI can read this via Docs MCPInstall MCP →Connect

Atlan crawls metadata from your Iceberg catalog, including catalogs, namespaces (with nested namespace support), tables, and columns (including nested columns).

Lineage

Atlan establishes the following lineage between Iceberg assets:

• Catalog -> Namespaces: Each catalog contains multiple namespaces.
• Namespace -> Tables: Each namespace contains multiple tables.
• Namespace -> Namespaces: Nested namespaces have parent-child relationships.
• Table -> Columns: Each table contains multiple columns.
• Column -> Columns: Nested columns have parent-child relationships (for STRUCT, LIST, and MAP types).

Assets

Atlan crawls the following Iceberg assets and metadata fields.

IcebergCatalog

Iceberg catalogs represent the top-level catalog instances that contain namespaces and tables.

Source field	Atlan field	Description
catalog_name	name	Catalog name
catalog_name	qualifiedName	Unique qualified name for the catalog
catalog_type	icebergCatalogType	Type of catalog (for example, rest)
uri	icebergUri	REST catalog URI
iceberg_warehouse	icebergWarehouse	Warehouse identifier
scope	icebergScope	Access scope configuration
total_namespaces	schemaCount	Number of namespaces in the catalog
iceberg_catalog_properties	icebergCatalogProperties	Catalog configuration properties

IcebergNamespace

Namespaces represent logical containers for organizing tables within a catalog. Iceberg supports nested namespaces.

Source field	Atlan field	Description
namespace_str	name	Namespace name (leaf segment for nested namespaces)
namespace_str	qualifiedName	Unique qualified name for the namespace
namespace_hierarchy	icebergNamespaceHierarchy	Ordered namespace hierarchy path
namespace_str	icebergParentNamespaceQualifiedName	Parent namespace qualified name (for nested namespaces)
table_count	tableCount	Number of tables in the namespace

IcebergTable

Iceberg tables represent table assets with metadata including partitions, snapshots, and table-level properties.

Source field	Atlan field	Description
table_name	name	Table name
table_name + namespace context	qualifiedName	Unique qualified name for the table
table_uuid	assetSourceId	Source identifier for the table
location	externalLocation	Storage location of table data
location	externalLocationRegion	Parsed storage region (when derivable)
schema_fields	columnCount	Number of columns
snapshots.summary.total-records	rowCount	Number of records
snapshots.summary.total-files-size	sizeBytes	Table size in bytes
partitions	isPartitioned	Whether the table is partitioned
current_snapshot_id	icebergCurrentSnapshotId	Current snapshot identifier
last_updated_ms	sourceUpdatedAt	Last updated timestamp on source
source_created_at	sourceCreatedAt	Created timestamp on source
format_version	icebergFormatVersion	Iceberg format version
properties	icebergTableProperties	Table-level properties
partitions	icebergTablePartitions	Partition specification details
snapshots	icebergSnapshots	Snapshot metadata

IcebergColumn

Columns represent table fields, including nested field metadata for complex types.

Source field	Atlan field	Description
column_name	name	Column name
column_name / column_path + table context	qualifiedName	Unique qualified name for the column
data_type	dataType	Column data type
nullable	isNullable	Whether the column accepts null values
is_partition	isPartition	Whether the column is a partition column
description	description	Column description
sub_type	subType	Nested subtype marker
column_depth_level	columnDepthLevel	Nesting depth level
column_order	order	Column order within parent scope
nested_column_order	nestedColumnOrder	Hierarchical order for nested fields
nested_column_count	nestedColumnCount	Number of child columns
parent_column_name	parentColumnName	Parent column name
parent_column_qualified_name	parentColumnQualifiedName	Parent column qualified name
column_hierarchy	columnHierarchy	Ancestor hierarchy for nested columns