What does Atlan crawl from CrateDB?
Complete list of CrateDB assets and metadata properties extracted by Atlan during crawling
CrateDB uses a single-cluster architecture where all data is stored within one logical database. Unlike traditional databases that support multiple databases, CrateDB organizes data using schemas within a single cluster. This affects how Atlan maps CrateDB assets:
- Database: Represents the single CrateDB cluster
- Schemas: Organize tables, views, and other objects within the cluster
- Tables/Views: Store the actual data and metadata
Once you have crawled CrateDB, you can use connector-specific filters for quick asset discovery. Atlan extracts and maps the following assets and properties from CrateDB during crawling.
Databases
Atlan maps databases from CrateDB to its Database asset type.
| Source property | Atlan property | Description |
|---|---|---|
TABLE_CATALOG | name | Database name |
SCHEMA_COUNT | schemaCount | Number of schemas in the database |
Schemas
Atlan maps schemas from CrateDB to its Schema asset type.
| Source property | Atlan property | Description |
|---|---|---|
TABLE_SCHEMA | name | Schema name |
TABLE_COUNT | tableCount | Number of tables in the schema |
VIEW_COUNT | viewsCount | Number of views in the schema |
'crate' (literal) | databaseName | Database name |
Tables
Atlan maps tables from CrateDB to its Table asset type.
| Source property | Atlan property | Description |
|---|---|---|
TABLE_NAME | name | Table name |
REMARKS | description | Table description |
COLUMN_COUNT | columnCount | Number of columns in the table |
ROW_COUNT | rowCount | Number of rows in the table |
SIZE_BYTES | sizeBytes | Table size in bytes |
IS_PARTITIONED | isPartitioned | Whether the table is partitioned |
PARTITION_STRATEGY | partitionStrategy | Partitioning strategy used |
PARTITION_COUNT | partitionCount | Number of partitions |
Table partitions
Atlan maps table partitions from CrateDB to its TablePartition asset type.
| Source property | Atlan property | Description |
|---|---|---|
TABLE_NAME | name | Partition name |
PARTITION_STRATEGY | partitionStrategy | Partitioning strategy |
ROW_COUNT | rowCount | Number of rows in the partition |
SIZE_BYTES | sizeBytes | Partition size in bytes |
PARTITION_COUNT | partitionCount | Number of sub-partitions |
COLUMN_COUNT | columnCount | Number of columns in the partition |
Views
Atlan maps views from CrateDB to its View asset type.
| Source property | Atlan property | Description |
|---|---|---|
TABLE_NAME | name | View name |
REMARKS | description | View description |
COLUMN_COUNT | columnCount | Number of columns in the view |
VIEW_DEFINITION | definition | SQL definition of the view |
Columns
Atlan maps columns from CrateDB to its Column asset type.
| Source property | Atlan property | Description |
|---|---|---|
COLUMN_NAME | name | Column name |
REMARKS | description | Column description |
ORDINAL_POSITION | order | Column position in the table |
DATA_TYPE | dataType | Data type of the column |
IS_NULLABLE | isNullable | Whether the column accepts NULL values |
IS_PARTITION_COLUMN | isPartition | Whether the column is used for partitioning |
PARTITION_ORDER | partitionOrder | Order of the column in partitioning |
IS_PRIMARY_KEY | isPrimary | Whether the column is part of the primary key |
COLUMN_DEFAULT | defaultValue | Default value for the column |
IS_GENERATED | is_generated | Whether the column is atuomatically generated |