What does Atlan crawl from Amazon Athena?
Atlan extracts metadata for Databases, Schemas, Tables, Views, and Columns from Amazon Athena and maps each property to its internal asset model. The tables below list which Amazon Athena properties are read and how they appear on the corresponding Atlan asset.
Databases
Atlan maps databases from Amazon Athena to its Database asset type.
| Source property | Atlan property |
|---|---|
| TABLE_CATALOG | name |
| SCHEMA_COUNT | schemaCount |
Schemas
Atlan maps schemas from Amazon Athena to its Schema asset type.
| Source property | Atlan property |
|---|---|
| TABLE_SCHEMA | name |
| TABLE_COUNT | tableCount |
| VIEW_COUNT | viewsCount |
| TABLE_CATALOG | databaseName |
| CreateTime (via Glue) | sourceCreatedAt |
Tables
Atlan maps tables from Amazon Athena to its Table asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| recordCount (via Glue) | rowCount |
| sizeKey (via Glue) | sizeBytes |
| TABLE_TYPE | subType |
| StorageDescriptor Location (via Glue) | externalLocation |
| StorageDescriptor typeOfData (via Glue) | externalLocationFormat |
| StorageDescriptor Columns and COLUMN_COUNT | certificateStatus (DEPRECATED) if Athena JDBC and Glue API do not have the same column count |
| PartitionKeys (via Glue) | isPartitioned |
| PartitionData (via Glue) | partitionCount |
| PartitionData (via Glue) | partitionList |
| CreatedBy (via Glue) | sourceCreatedBy |
| CreateTime or CreationTime (via Glue) | sourceCreatedAt |
| UpdateTime or LastAccessTime (via Glue) | sourceUpdatedAt |
Views
Atlan maps views from Amazon Athena to its View asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| VIEW_DEFINITION | definition |
| StorageDescriptor Columns and COLUMN_COUNT | certificateStatus (DEPRECATED) if Athena JDBC and Glue API do not have the same column count |
| recordCount (via Glue) | rowCount |
| PartitionKeys (via Glue) | isPartitioned |
| PartitionData (via Glue) | partitionCount |
| PartitionData (via Glue) | partitionList |
| CreatedBy (via Glue) | sourceCreatedBy |
| CreateTime or CreationTime (via Glue) | sourceCreatedAt |
| UpdateTime or LastAccessTime (via Glue) | sourceUpdatedAt |
Columns
Atlan maps columns from Amazon Athena to its Column asset type.
| Source property | Atlan property |
|---|---|
| COLUMN_NAME | name |
| REMARKS | description |
| ORDINAL_POSITION | order |
| TYPE_NAME | dataType |
| NULLABLE | isNullable |
| IS_PARTITION | isPartition |
| PARTITION_ORDER | partitionOrder |
| PRIMARY_KEY | isPrimary |
| DECIMAL_DIGITS | precision |