Skip to main content

Ingest data quality metadata

After you configure authentication credentials in Bigeye, create an ingestion workflow in Atlan to fetch data quality metadata. This workflow enriches your existing assets with data quality insights at the table and column level.

Prerequisites​

Before you begin, make sure you have:

  • Completed Set up Bigeye
  • The following credentials:
    • Host: The base URL of your Bigeye instance
    • Username: The email address associated with the user
    • Personal API Key: The API key for a user that has at least Edit access to the target workspace
    • Workspace ID: The Bigeye workspace ID. You can find this in Settings > Workspaces in your Bigeye instance

Create ingestion workflow​

Create an ingestion workflow to fetch data quality metadata from Bigeye and enrich your existing assets. Configure authentication credentials and provide the workspace ID to identify the workspace to target when interacting with the Bigeye API.

  1. In the top right of any screen in Atlan, click New and then click New workflow.

  2. From the list of packages, select Bigeye and then click Setup Workflow.

Configure credentials​

Provide your Bigeye API credentials to authenticate the connection.

  1. Enter the base URL of your Bigeye instance in Host.

  2. Enter the username in Username.

  3. Enter the API key in Personal API Key.

  4. Click Test Authentication to verify connectivity to Bigeye.

  5. After authentication succeeds, click Next at the bottom of the screen.

Verify source mapping and user access​

Verify user permissions and that at least one source contains a connection mapping.

  1. Enter the Bigeye workspace ID in Workspace ID.

  2. Click Check to verify user permissions and that at least one source contains a connection mapping.

Run ingestion​

Run the ingestion workflow to sync data quality metadata from Bigeye to your existing assets.

  1. To check for any permissions or other configuration issues before running the workflow, click Check to run the Preflight checks.

  2. Choose how to run the ingestion:

    • Click Run to start a one-time sync of data quality metadata
    • Click Schedule & Run to set up automated recurring syncs

After ingestion completes, your existing Atlan assets are enriched with data quality metadata from Bigeye.

Need help​

If you have questions or need assistance with the integration process, reach out to Atlan Support by submitting a request.

See also​