Set up on-premises Databricks access
Offline extraction sunset
The Docker-based databricks-extractor offline tool has been sunset and is no longer available. For on-premises or network-restricted Databricks environments, use one of the supported approaches below.
In some cases you won't be able to expose your Databricks instance for Atlan to crawl and ingest metadata. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.
Supported approaches
For Databricks instances that you can't expose to Atlan directly, use one of the following supported approaches:
- Agent extraction with Self-Deployed Runtime - Atlan's agent executes metadata extraction within your own environment. See Self-Deployed Runtime and the Agent extraction method section of the Databricks crawler guide.
- Secure Agent - Fetch metadata from Databricks through Atlan's Secure Agent, running inside your network. See How to configure Secure Agent for workflow execution.
- Direct connectivity via private link - Expose Databricks to Atlan over a private link:
If you have an existing setup that relies on the sunset offline extractor, contact your Atlan Account team to plan your migration.