Preflight checks for Databricks
Before running the Databricks crawler, you can run preflight checks to perform the necessary technical validations. The following preflight checks will be completed:
JDBC
Schemas
✅ Check successful
❌ Check failed for $missingObjectName
Rest API (Unity Catalog)
The REST API extraction method for crawling Databricks metadata is deprecated. Use the system tables extraction method instead. The preflight checks below apply only to the deprecated REST API method.
User login/UC enabled
✅ Check successful
❌ Source returned error
For example: {"error_code":"403","message":"Invalid access token."}
Catalog
✅ Check successful
❌ Check failed for $missingObjectName catalog
Databricks lineage and usage (miner)
Once you have crawled assets from Databricks, you can extract lineage and usage and popularity metrics.
Login
✅ Check successful
❌ Check failed
For example: {"error_code":"403","message":"Invalid access token."}
Lineage API (Deprecated)
The REST API lineage extraction method is deprecated. Use the system tables method instead.
✅ Check successful. Lineage API is enabled.
❌ Check failed
For example: Lineage is not enabled for this Databricks account: 47258391-b3c8-4ff9-a0d9-5afc02443806
Query history API endpoint check (Deprecated)
✅ Check successful
❌ Check failed