What does Atlan crawl from Starburst Enterprise?
Atlan crawls and maps the following assets and properties from Starburst Enterprise. The connector extracts metadata from two categories of assets: catalog assets and domains and data products.
Catalog assets
Databases (catalogs)
Atlan maps catalogs from Starburst Enterprise to its Database asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Catalog name | name | Asset profile and overview sidebar |
| Connector type | connectorType | Asset profile |
| Connector name | connectorName | Asset profile |
| State | state | Asset profile |
| Schema count | schemaCount | Asset profile and overview sidebar |
Schemas
Atlan maps schemas from Starburst Enterprise to its Schema asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Schema name | name | Asset profile and overview sidebar |
| Table count | tableCount | Asset profile and overview sidebar |
| View count | viewsCount | Asset profile and overview sidebar |
| Catalog name | databaseName | Asset profile |
Tables
Atlan maps tables from Starburst Enterprise to its Table asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Table name | name | Asset profile and overview sidebar |
| Description (COMMENT) | description | Asset profile and overview sidebar |
| Column count | columnCount | Asset profile and overview sidebar |
Views
Atlan maps views from Starburst Enterprise to its View asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| View name | name | Asset profile and overview sidebar |
| Description (COMMENT) | description | Asset profile and overview sidebar |
| View definition (SQL) | definition | Asset profile |
| Column count | columnCount | Asset profile and overview sidebar |
Materialized views
Atlan maps materialized views from Starburst Enterprise to its MaterialisedView asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| View name | name | Asset profile and overview sidebar |
| View definition (SQL) | definition | Asset profile |
| Column count | columnCount | Asset profile and overview sidebar |
Starburst Enterprise's INFORMATION_SCHEMA tables report materialized views as BASE TABLE. The connector queries system.metadata.materialized_views separately to correctly identify and classify materialized views.
Columns
Atlan maps columns from Starburst Enterprise to its Column asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Column name | name | Asset profile and overview sidebar |
| Description (COMMENT) | description | Asset profile and overview sidebar |
| Data type | dataType | Asset profile and overview sidebar |
| Ordinal position | order | Asset profile |
| Is nullable | isNullable | Asset profile |
| Default value | defaultValue | Asset profile |
Domains and data products
Data domains
Atlan maps Starburst Enterprise domains to its DataDomain asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Domain name | name | Asset profile and overview sidebar |
| Description | description | Asset profile and overview sidebar |
| Type (PUBLIC/PRIVATE) | type | Asset profile |
Data products
Atlan maps Starburst Enterprise data products to its DataProduct asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Product name | name | Asset profile and overview sidebar |
| Summary | summary | Asset profile |
| Description | description | Asset profile and overview sidebar |
| Status (Published/Draft) | status | Asset profile and overview sidebar |
| Catalog name | catalogName | Asset profile |
| Schema name | schemaName | Asset profile |
| Owners | owners | Asset profile |
| Visibility | visibility | Asset profile |
| Average rating | Custom Metadata: Starburst Data Product Ratings (Starburst Data Product Average Rating) | Asset profile |
| Rating count | Custom Metadata: Starburst Data Product Ratings (Starburst Data Product Rating Count) | Asset profile |
Datasets
Atlan maps Starburst Enterprise datasets (views and materialized views within a data product) to its StarburstDataset asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Dataset name | name | Asset profile and overview sidebar |
| Description | description | Asset profile and overview sidebar |
| View definition (SQL) | starburstViewDefinition | Asset profile |
| Is materialized | starburstIsMaterialized | Asset profile |
| Column count | columnCount | Asset profile and overview sidebar |
| Data product name | starburstDataProductName | Asset profile |
| Linked SQL qualified name | starburstSqlQualifiedName | Asset profile |
Dataset columns
Atlan maps columns within Starburst Enterprise datasets to its StarburstDatasetColumn asset type.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
| Column name | name | Asset profile and overview sidebar |
| Data type | dataType | Asset profile and overview sidebar |
| Description | description | Asset profile and overview sidebar |
| Ordinal position | order | Asset profile |
| Data product name | starburstDataProductName | Asset profile |
| Linked SQL column qualified name | starburstSqlColumnQualifiedName | Asset profile |
Lineage
The connector provides view and materialized view SQL definitions to Atlan's Query Intelligence service for lineage parsing. This enables Atlan to trace data dependencies from source tables through views.
Supported lineage sources:
- View definitions (SQL
CREATE VIEWstatements) - Materialized view definitions
See also
- Data Product integration: Understand how SQL and data product assets are extracted and linked
- Crawl Starburst Enterprise: Configure and run the crawler