Skip to main content

What does Atlan crawl from CrateDB?

CrateDB uses a single-cluster architecture where all data is stored within one logical database. Unlike traditional databases that support multiple databases, CrateDB organizes data using schemas within a single cluster. This affects how Atlan maps CrateDB assets:

  • Database: Represents the single CrateDB cluster
  • Schemas: Organize tables, views, and other objects within the cluster
  • Tables/Views: Store the actual data and metadata

Once you have crawled CrateDB, you can use connector-specific filters for quick asset discovery. Atlan extracts and maps the following assets and properties from CrateDB during crawling.

Databases

Atlan maps databases from CrateDB to its Database asset type.

Source propertyAtlan propertyDescription
TABLE_CATALOGnameDatabase name
SCHEMA_COUNTschemaCountNumber of schemas in the database

Schemas

Atlan maps schemas from CrateDB to its Schema asset type.

Source propertyAtlan propertyDescription
TABLE_SCHEMAnameSchema name
TABLE_COUNTtableCountNumber of tables in the schema
VIEW_COUNTviewsCountNumber of views in the schema
'crate' (literal)databaseNameDatabase name

Tables

Atlan maps tables from CrateDB to its Table asset type.

Source propertyAtlan propertyDescription
TABLE_NAMEnameTable name
REMARKSdescriptionTable description
COLUMN_COUNTcolumnCountNumber of columns in the table
ROW_COUNTrowCountNumber of rows in the table
SIZE_BYTESsizeBytesTable size in bytes
IS_PARTITIONEDisPartitionedWhether the table is partitioned
PARTITION_STRATEGYpartitionStrategyPartitioning strategy used
PARTITION_COUNTpartitionCountNumber of partitions

Table partitions

Atlan maps table partitions from CrateDB to its TablePartition asset type.

Source propertyAtlan propertyDescription
TABLE_NAMEnamePartition name
PARTITION_STRATEGYpartitionStrategyPartitioning strategy
ROW_COUNTrowCountNumber of rows in the partition
SIZE_BYTESsizeBytesPartition size in bytes
PARTITION_COUNTpartitionCountNumber of sub-partitions
COLUMN_COUNTcolumnCountNumber of columns in the partition

Views

Atlan maps views from CrateDB to its View asset type.

Source propertyAtlan propertyDescription
TABLE_NAMEnameView name
REMARKSdescriptionView description
COLUMN_COUNTcolumnCountNumber of columns in the view
VIEW_DEFINITIONdefinitionSQL definition of the view

Columns

Atlan maps columns from CrateDB to its Column asset type.

Source propertyAtlan propertyDescription
COLUMN_NAMEnameColumn name
REMARKSdescriptionColumn description
ORDINAL_POSITIONorderColumn position in the table
DATA_TYPEdataTypeData type of the column
IS_NULLABLEisNullableWhether the column accepts NULL values
IS_PARTITION_COLUMNisPartitionWhether the column is used for partitioning
PARTITION_ORDERpartitionOrderOrder of the column in partitioning
IS_PRIMARY_KEYisPrimaryWhether the column is part of the primary key
COLUMN_DEFAULTdefaultValueDefault value for the column
IS_GENERATEDis_generatedWhether the column is atuomatically generated