What does Atlan crawl from CrateDB?
CrateDB uses a single-cluster architecture where all data is stored within one logical database. Unlike traditional databases that support multiple databases, CrateDB organizes data using schemas within a single cluster. This affects how Atlan maps CrateDB assets:
- Database: Represents the single CrateDB cluster
- Schemas: Organize tables, views, and other objects within the cluster
- Tables/Views: Store the actual data and metadata
Once you have crawled CrateDB, you can use connector-specific filters for quick asset discovery. Atlan extracts and maps the following assets and properties from CrateDB during crawling.
Databases
Atlan maps databases from CrateDB to its Database
asset type.
Source property | Atlan property | Description |
---|---|---|
TABLE_CATALOG | name | Database name |
SCHEMA_COUNT | schemaCount | Number of schemas in the database |
Schemas
Atlan maps schemas from CrateDB to its Schema
asset type.
Source property | Atlan property | Description |
---|---|---|
TABLE_SCHEMA | name | Schema name |
TABLE_COUNT | tableCount | Number of tables in the schema |
VIEW_COUNT | viewsCount | Number of views in the schema |
'crate' (literal) | databaseName | Database name |
Tables
Atlan maps tables from CrateDB to its Table
asset type.
Source property | Atlan property | Description |
---|---|---|
TABLE_NAME | name | Table name |
REMARKS | description | Table description |
COLUMN_COUNT | columnCount | Number of columns in the table |
ROW_COUNT | rowCount | Number of rows in the table |
SIZE_BYTES | sizeBytes | Table size in bytes |
IS_PARTITIONED | isPartitioned | Whether the table is partitioned |
PARTITION_STRATEGY | partitionStrategy | Partitioning strategy used |
PARTITION_COUNT | partitionCount | Number of partitions |
Table partitions
Atlan maps table partitions from CrateDB to its TablePartition
asset type.
Source property | Atlan property | Description |
---|---|---|
TABLE_NAME | name | Partition name |
PARTITION_STRATEGY | partitionStrategy | Partitioning strategy |
ROW_COUNT | rowCount | Number of rows in the partition |
SIZE_BYTES | sizeBytes | Partition size in bytes |
PARTITION_COUNT | partitionCount | Number of sub-partitions |
COLUMN_COUNT | columnCount | Number of columns in the partition |
Views
Atlan maps views from CrateDB to its View
asset type.
Source property | Atlan property | Description |
---|---|---|
TABLE_NAME | name | View name |
REMARKS | description | View description |
COLUMN_COUNT | columnCount | Number of columns in the view |
VIEW_DEFINITION | definition | SQL definition of the view |
Columns
Atlan maps columns from CrateDB to its Column
asset type.
Source property | Atlan property | Description |
---|---|---|
COLUMN_NAME | name | Column name |
REMARKS | description | Column description |
ORDINAL_POSITION | order | Column position in the table |
DATA_TYPE | dataType | Data type of the column |
IS_NULLABLE | isNullable | Whether the column accepts NULL values |
IS_PARTITION_COLUMN | isPartition | Whether the column is used for partitioning |
PARTITION_ORDER | partitionOrder | Order of the column in partitioning |
IS_PRIMARY_KEY | isPrimary | Whether the column is part of the primary key |
COLUMN_DEFAULT | defaultValue | Default value for the column |
IS_GENERATED | is_generated | Whether the column is atuomatically generated |