Skip to main content

Enable data quality on connection Private Preview

Enable data quality on your Databricks connection in Atlan to start monitoring data quality. This guide helps you configure the connection with the necessary credentials and permissions.

Prerequisites​

Before you begin, complete the following steps:

  • Set up Databricks for data quality completed
  • Have the service principal credentials created during Databricks setup
  • Identify the Databricks connection where you want to enable data quality

Enable data quality​

Follow these steps to enable data quality on your Databricks connection.

  1. Turn on the data quality feature:

    Enable Data Quality

    • Navigate to Settings in Atlan
    • Find the Labs section
    • Turn on the Data Quality toggle

  2. Select your connection and configure credentials:

    IMPORTANT

    Currently, you can only enable data quality on one connection in Atlan. If you wish to enable it on another connection, raise a support request.

    1. Navigate to Governance > Data Quality
    2. Select your Databricks connection from the list
    3. Click Enable data quality for your selected connection
    4. Enter the following credential details:
      • Client ID: The service principal client ID created in Databricks setup
      • Client Secret: The service principal client secret
      • Tenant ID: The tenant ID (Azure only)
      • Workspace URL: Your Databricks workspace URL
      • SQL Warehouse: Your preferred SQL warehouse for DQ operations
    5. Click Run permissions check to verify:
      • Credentials have necessary permissions in Databricks
      • Databricks setup completed correctly
    6. Click Update to save the credentials

Next steps​

After completing these steps:

  • Atlan takes approximately 10 minutes to complete the setup in the background
  • Once finished, you'll see data quality options available on your Databricks assets
  • You can start creating data quality rules on tables and views

Need help​

If you have questions or need assistance with enabling data quality on your connection, reach out to Atlan Support by submitting a support request.

See also​