Skip to main content

Crawl Hightouch

Configure and run the Hightouch crawler to extract metadata from your reverse ETL models and syncs, establishing comprehensive lineage between your data warehouse sources and operational business tools.

Prerequisites​

Before you begin, make sure you have:

Create crawler workflow​

Follow these steps to create a workflow in Atlan that captures metadata from Hightouch.

  1. In Atlan, select New > New Workflow.
  2. From the package list, choose Hightouch Assets.
  3. Select Setup Workflow.

Configure authentication​

Provide your Hightouch API credentials to authenticate the connection.

  1. For API Key, enter the API key you generated during setup.
  2. Click Test Authentication to verify the connection.

Configure connection​

To complete the Hightouch connection configuration:

  1. Provide a Connection Name that represents your source environment. For example, you might use values like production, development, or analytics.
  2. To change the users able to manage this connection, change the users or groups listed under Connection Admins. If you don't specify any user or group, nobody can manage the connection - not even admins.
  3. Under Include/Exclude Filters, specify regular expressions that match Model names for ingestion inclusion/exclusion. This lets you control which models are cataloged in Atlan.
  4. Click Next to proceed.

Run crawler​

To run the Hightouch crawler, after completing the previous steps:

  1. To check for any permissions or other configuration issues before running the crawler, click Preflight checks.
  2. You can either:
    • To run the crawler once immediately, at the bottom of the screen, click the Run button.
    • To schedule the crawler to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the Schedule Run button.

Once the crawler has completed running, you see Hightouch models and syncs as distinct assets in Atlan, with comprehensive lineage established between your data warehouse sources and operational business tools! 🎉

See also​