What does Atlan crawl from Cloudera Impala?
Atlan crawls and maps the following assets and properties from Cloudera Impala. This integration helps you understand and govern data stored in Impala by organizing metadata into Atlan asset types and enabling downstream visibility, including lineage.
Lineage
Atlan supports the following lineage in Cloudera Impala.
- Asset-level and field-level lineage for
Tables → Views - Asset-level and field-level lineage for
Views → Views
Schema
Atlan maps databases from Cloudera Impala schema to its Schema asset type.
| Source property | Atlan property |
|---|---|
owner | sourceOwners |
comment | description |
external_location | schemaExternalLocation |
Tables
Atlan maps Cloudera Impala tables to its Tables asset type.
| Source property | Atlan property |
|---|---|
rows | rowCount |
sizeBytes | sizeBytes |
owner | sourceOwners |
stats.partitionCount (Only applicable for Kudu tables) | partitionCount |
OutputFormat (Not available for Impala-managed Kudu tables for Impala 3.3+) | externalLocationFormat |
Location | externalLocation |
Table Type | subType |
comment | description |
table_query | tableDefinition |
Views
Atlan maps tables from Cloudera Impala views to its Views asset type.
| Source property | Atlan property |
|---|---|
rows | rowCount |
sizeBytes | sizeBytes |
owner | sourceOwners |
Table Type | subType |
KUDU (only set for Kudu tables) | tableType |
comment | description |
VIEW_DEFINITION | definition |
Columns
Atlan maps columns from Cloudera Impala to its Column asset type.
| Source property | Atlan property |
|---|---|
column_name | name |
ENCODING (only applicable for Kudu table types) | columnEncoding |
COMPRESSION (only applicable for Kudu table types) | columnCompression |
PRIMARY_KEY (only applicable for Kudu tables) | isPrimary |
ISNULLABLE | isNullable |
TYPE | dataType |
COMMENT | description |