Skip to main content

Set up Fivetran

Set up the Fivetran Platform Connector to sync metadata and logs from all Fivetran connectors in your account to a supported destination. This enables Atlan to extract and catalog Fivetran assets, including connectors, destinations, and transformations.

Prerequisites​

Before you begin, make sure you have:

  • Fivetran Account Administrator access (required to create, view, edit, and delete destinations and connectors)
  • Fivetran Enterprise plan or higher (contact your Atlan representative if you need access to a trial period)
  • A supported destination configured in Fivetran (Amazon Redshift, Databricks, Google BigQuery, PostgreSQL, or Snowflake)

Create destination​

Databricks authentication

If you're setting up Fivetran with Databricks as the destination, you must use basic authentication for the Databricks connection. Other authentication methods aren't supported.

The Fivetran Platform Connector delivers logs and account or destination metadata to a schema in your destination. Fivetran automatically adds this connector to every new destination you create. You need to set up at least one destination to receive the log events.

Atlan supports the following destinations. Refer to Fivetran documentation to configure them:

If you have already configured a destination in Fivetran, skip to the next section.

Configure platform connector​

Once you have set up a supported destination, configure the Fivetran Platform Connector account-wide:

  1. Follow the steps in the Fivetran Platform Connector setup guide from Fivetran. You must configure the Fivetran Platform Connector on an account level, not at the connector level.

  2. Verify that the connector has run successfully in Fivetran at least once before proceeding to crawl in Atlan.

  3. Verify that the warehouse credentials or role configured in Atlan have the necessary permissions to query tables in <Fivetran_destination_database>.<FPC_schema_name>. Refer to the Fivetran documentation for available FPC_schema_name values.

  4. Grant the required permissions to access these tables. Refer to the relevant guide for your destination:

Excluding columns

Atlan recommends not excluding any columns from the Fivetran Platform Connector, as this can impact the successful execution of the Fivetran enrichment package.

This configuration enables you to sync all the metadata and logs for all connectors in your account to a single destination.

Next steps​

  • Crawl Fivetran: Configure and run the crawler to extract metadata from Fivetran