## Crawl Fivetran

URL: https://docs.atlan.com/apps/connectors/etl-tools/fivetran/how-tos/crawl-fivetran

> Enrich Atlan with Fivetran metadata to track data pipeline lineage and transformations. Configure the Fivetran Platform Connector and connect a supported data warehouse destination.

Atlan crawls Fivetran to catalog data pipelines and transformations and to build source-to-destination lineage.

Establish a connection between Atlan and your [Fivetran](https://docs.atlan.com/llms/connectors/fivetran/set-up-fivetran/llms.txt) instance to enrich your workspace with metadata about data pipelines and transformations. This enables you to track lineage, understand data movements, and govern your ETL processes. The [Fivetran Platform Connector](https://docs.atlan.com/llms/connectors/fivetran/set-up-fivetran/llms.txt) must be configured and running in your Fivetran environment. Review the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) for metadata enrichment workflows before starting.

## Select the source

To select Fivetran as your source:

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **Fivetran Enrichment** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

## Provide credentials

In order to run this package, you must ensure the following:

- The [Fivetran Platform Connector is set up](https://docs.atlan.com/llms/connectors/fivetran/set-up-fivetran/llms.txt) and has run successfully in Fivetran at least once.
- Fivetran logs are stored in a destination supported by Atlan.
- The above destination has been crawled in Atlan.

To use the Fivetran Platform Connector:

1. For _Atlan Connection_, Atlan will use the credentials of your selected connection to read the Fivetran Platform Connector tables associated with that connection. You can either:
 - Create a connection in Atlan for the [destination warehouse you configured](https://docs.atlan.com/llms/connectors/fivetran/set-up-fivetran/llms.txt) while setting up the Fivetran Platform Connector in Fivetran. This connection in Atlan must have access to the Fivetran tables created by the Fivetran Platform Connector. Atlan supports the following destinations:
 - [Amazon Redshift](https://docs.atlan.com/llms/connectors/amazon-redshift/crawl-amazon-redshift/llms.txt)
 - [Databricks](https://docs.atlan.com/llms/connectors/databricks/set-up-databricks/llms.txt)
 - [Google BigQuery](https://docs.atlan.com/llms/connectors/google-bigquery/crawl-google-bigquery/llms.txt)
 - [PostgreSQL](https://docs.atlan.com/llms/connectors/postgresql/crawl-postgresql/llms.txt)
 - [Snowflake](https://docs.atlan.com/llms/connectors/snowflake/crawl-snowflake/llms.txt)
 - If you have already created a connection in Atlan, select the connection to extract. (To select a connection, the crawler must have already run for a supported destination.)

 :::warning

 If you have an existing connection, you _must_ ensure that the user or other access permissions configured for that connection allow access to the Fivetran tables created by the Fivetran Platform Connector or update them accordingly.

 :::

2. For _Fivetran Platform Schema_, select the [destination schema where Fivetran logs are stored](https://docs.atlan.com/llms/connectors/fivetran/set-up-fivetran/llms.txt). You can only select one schema and must ensure that the connection above has access to [all Fivetran log tables stored in this destination schema](https://fivetran.com/docs/logs/fivetran-platform#schemainformation).

3. Once successful, at the bottom of the screen, click **Next**.

## Configure the connection

To complete the Fivetran connection configuration:

1. Provide a _Connection Name_ that represents your source environment. For example, you might use values like `production`, `development`, `gold`, or `analytics`.

2. (Optional) To change the users able to manage this connection, change the users or groups listed under _Connection Admins_.

 :::warning

 If you do not specify any user or group, nobody will be able to manage the connection - not even admins.

 :::

## Run the enrichment

You can now enrich Atlan with Fivetran metadata:

1. To check for any [permissions or other configuration issues](https://docs.atlan.com/llms/connectors/fivetran/preflight-checks-for-fivetran/llms.txt) before running the enrichment, click **Preflight checks**.

2. You can either:
 - To run the crawler once immediately, at the bottom of the screen, click the **Run** button.
 - To schedule the crawler to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the **Schedule & Run** button.

Once the enrichment has completed running, you will see lineage extended upstream from your data platform, warehouse, or lake! 🎉

---