Databricks
Overview: Catalog Databricks workspaces, databases, schemas, and tables in Atlan. Gain visibility into lineage, usage, and governance for your Databricks assets.
Get started
Follow these steps to connect and catalog Databricks assets in Atlan:
Guides
Lineage & usage
- Extract lineage and usage from Databricks: Extract lineage and usage metrics from your Databricks assets.
Tag management
- Manage Databricks tags: Configure and manage tags in Databricks.
On-premises
- Set up on-premises Databricks access: Configure Atlan to access on-premises Databricks environments.
- Set up on-premises Databricks lineage extraction: Prepare for offline lineage extraction from on-premises Databricks.
- Extract on-premises Databricks lineage: Step-by-step instructions for extracting lineage from on-premises Databricks.
- Crawl on-premises Databricks: Crawl metadata from on-premises Databricks environments.
Private networking
- Set up an AWS private network link to Databricks: Establish a secure, private network connection to Databricks on AWS.
- Set up an Azure private network link to Databricks: Establish a secure, private network connection to Databricks on Azure.
References
- What does Atlan crawl from Databricks: Learn about the Databricks assets and metadata that Atlan discovers and catalogs.
- Preflight checks for Databricks: Verify prerequisites before setting up the Databricks connector.
Troubleshooting
- Troubleshooting connectivity: Resolve common Databricks connection issues and errors.