## Crawl Microsoft Azure Data Factory

URL: https://docs.atlan.com/apps/connectors/etl-tools/microsoft-azure-data-factory/how-tos/crawl-microsoft-azure-data-factory

> Once you have [configured the Microsoft Azure Data Factory permissions](/apps/connectors/etl-tools/microsoft-azure-data-factory/how-tos/set-up-microsoft-.

Extract metadata from your [Microsoft Azure Data Factory](https://docs.atlan.com/llms/connectors/microsoft-azure-data-factory/set-up-microsoft-azure-data-factory/llms.txt) environment into Atlan to catalog pipelines, datasets, and activities. After configuring the necessary permissions, you can establish a connection and crawl to extract lineage information.

To crawl metadata from Microsoft Azure Data Factor

y, review the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) and then complete the following steps.

## Select source

To select Microsoft Azure Data Factory as your source:

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **Azure Data Factory Assets** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

## Provide credentials

To enter your Microsoft Azure Data Factory credentials:

1. For _Extraction method_, _Direct_ is the default selection.

2. For _Authentication_, _Service Principal_ is the default selection.

3. For _Client ID_, enter the [application (client) ID you copied](https://docs.atlan.com/llms/connectors/microsoft-azure-data-factory/set-up-microsoft-azure-data-factory/llms.txt) for the service principal.

4. For _Client Secret_, enter the [client secret you copied](https://docs.atlan.com/llms/connectors/microsoft-azure-data-factory/set-up-microsoft-azure-data-factory/llms.txt) for the service principal.

5. For _Tenant ID_, enter the [directory (tenant) ID you copied](https://docs.atlan.com/llms/connectors/microsoft-azure-data-factory/set-up-microsoft-azure-data-factory/llms.txt) for the service principal.

6. Click the **Test Authentication** button to confirm connectivity to Microsoft Azure Data Factory.

7. Once authentication is successful, navigate to the bottom of the screen and click **Next**.

## Configure connection

To complete the Microsoft Azure Data Factory connection configuration:

1. Provide a _Connection Name_ that represents your source environment. For example, you might use values like `production`,`development`,`gold`, or `analytics`.

2. (Optional) To change the users who are able to manage this connection, change the users or groups listed under _Connection Admins_.

 :::warning

 If you don't specify any user or group, no one can manage the connection - not even admins.

 :::

3. Navigate to the bottom of the screen and click **Next** to proceed.

## Run crawler

To run the Microsoft Azure Data Factory crawler, after completing the earlier steps:

1. To check for any [permissions or other configuration issues](https://docs.atlan.com/llms/connectors/microsoft-azure-data-factory/preflight-checks-for-microsoft-azure-data-factory/llms.txt) before running the crawler, click **Preflight checks**.

2. You can either:
 - To run the crawler once immediately, at the bottom of the screen, click the **Run** button.
 - To schedule the crawler to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the **Schedule & Run** button.

Once the crawler has completed running, you can see the assets on Atlan's asset page! 🎉

---