What does Atlan crawl from Amazon Athena?
Atlan crawls and maps the following assets and properties from Amazon Athena.
Databases
Atlan maps databases from Amazon Athena to its Database asset type.
| Source property | Atlan property |
|---|---|
| TABLE_CATALOG | name |
| SCHEMA_COUNT | schemaCount |
Schemas
Atlan maps schemas from Amazon Athena to its Schema asset type.
| Source property | Atlan property |
|---|---|
| TABLE_SCHEMA | name |
| TABLE_COUNT | tableCount |
| VIEW_COUNT | viewsCount |
| TABLE_CATALOG | databaseName |
| CreateTime (via Glue) | sourceCreatedAt |
Tables
Atlan maps tables from Amazon Athena to its Table asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| recordCount (via Glue) | rowCount |
| sizeKey (via Glue) | sizeBytes |
| TABLE_TYPE | subType |
| StorageDescriptor Location (via Glue) | externalLocation |
| StorageDescriptor typeOfData (via Glue) | externalLocationFormat |
| StorageDescriptor Columns and COLUMN_COUNT | certificateStatus (DEPRECATED) if Athena JDBC and Glue API do not have the same column count |
| PartitionKeys (via Glue) | isPartitioned |
| PartitionData (via Glue) | partitionCount |
| PartitionData (via Glue) | partitionList |
| CreatedBy (via Glue) | sourceCreatedBy |
| CreateTime or CreationTime (via Glue) | sourceCreatedAt |
| UpdateTime or LastAccessTime (via Glue) | sourceUpdatedAt |
Views
Atlan maps views from Amazon Athena to its View asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| VIEW_DEFINITION | definition |
| StorageDescriptor Columns and COLUMN_COUNT | certificateStatus (DEPRECATED) if Athena JDBC and Glue API do not have the same column count |
| recordCount (via Glue) | rowCount |
| PartitionKeys (via Glue) | isPartitioned |
| PartitionData (via Glue) | partitionCount |
| PartitionData (via Glue) | partitionList |
| CreatedBy (via Glue) | sourceCreatedBy |
| CreateTime or CreationTime (via Glue) | sourceCreatedAt |
| UpdateTime or LastAccessTime (via Glue) | sourceUpdatedAt |
Columns
Atlan maps columns from Amazon Athena to its Column asset type.
| Source property | Atlan property |
|---|---|
| COLUMN_NAME | name |
| REMARKS | description |
| ORDINAL_POSITION | order |
| TYPE_NAME | dataType |
| NULLABLE | isNullable |
| IS_PARTITION | isPartition |
| PARTITION_ORDER | partitionOrder |
| PRIMARY_KEY | isPrimary |
| DECIMAL_DIGITS | precision |