
## Crawl Looker

URL: https://docs.atlan.com/apps/connectors/business-intelligence/looker/how-tos/crawl-looker

> Once you have configured the [Looker user permissions](/apps/connectors/business-intelligence/looker/how-tos/set-up-looker), you can establish a connection between Atlan and Looker.

Once you have configured the [Looker user permissions](https://docs.atlan.com/llms/connectors/looker/set-up-looker/llms.txt), you can establish a connection between Atlan and Looker.

To crawl metadata from Looker, review the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) and then complete the following steps.

## Select source

To select Looker as your source:

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **Looker Assets** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

## Configure extraction

Select your extraction method and provide the connection details.

:::warning Offline extraction sunset
The offline extraction method has been sunset and is no longer available. For on-premises or network-restricted environments, use the **Agent** extraction method with [Self-Deployed Runtime](https://docs.atlan.com/llms/platform/self-deployed-runtime/llms.txt).
:::

### Direct

In **Direct** extraction, Atlan connects to Looker and crawls metadata directly.

 - For _Host Name_, enter the full URL for your Looker API host, including the `https://`.
 - For _Port_, keep _443_ for Looker instances created after July 7, 2020, or switch to _19999_ for older instances.
 - For _Client ID_, enter the client ID you generated when [setting up user permissions](https://docs.atlan.com/llms/connectors/looker/set-up-looker/llms.txt).
 - For _Client Secret_, enter the client secret you generated when [setting up user permissions](https://docs.atlan.com/llms/connectors/looker/set-up-looker/llms.txt).
 - Click **Test Authentication** to confirm connectivity to Looker using these details.

**Field level lineage**

To enable field-level lineage, select a clone method for your Looker project Git repositories:

 - For _Private SSH Key_, paste the [private SSH key for the key you configured in GitHub](https://docs.atlan.com/llms/connectors/looker/set-up-looker/llms.txt).
 - For _Passphrase for the private key_, enter the passphrase that protects the key, if any. (If the key isn't protected by a passphrase, leave this blank.)
 - For _SSH Known Hosts_, add any value that needs to be hardcoded in the `~/.ssh/known-hosts` file before cloning your project Git repositories using SSH. (If not required, leave this blank.)

### HTTPS

- For _Git Username_, enter the username associated with your access token. If your Git provider doesn't require a specific username, enter `oauth2`.
 - For _Git Token_, enter a valid access token for your Git provider account. For more details, see [HTTPS token for lineage](https://docs.atlan.com/llms/connectors/looker/set-up-looker/llms.txt).

### Agent

In **Agent** extraction, the Secure Agent executes metadata extraction within your organization’s environment.

1. Select the **Agent** tab.

2. Store sensitive information in the secret store configured with the Secure Agent and reference the secrets in the corresponding fields. For details on individual fields, including field-level lineage configuration, refer to the [Direct extraction tab](#configure-extraction).

3. Complete the Secure Agent configuration by following the instructions in the [How to configure Secure Agent for workflow execution](https://docs.atlan.com/llms/platform/secure-agent/configure-secure-agent-for-workflow-execution/llms.txt) guide.

4. Click **Next** after completing the configuration.

## Configure connection

To complete the Looker connection configuration:

1. Provide a _Connection Name_ that represents your source environment. For example, you might want to use values like `production`, `development`, `gold`, or `analytics`.

2. (Optional) To change the users able to manage this connection, change the users or groups listed under _Connection Admins_.

 :::warning

 If you don't specify any user or group, nobody can manage the connection - not even admins.

 :::

3. At the bottom of the screen, click the **Next** button to proceed.

## Configure crawler

Before running the Looker crawler, you can further configure it. (These options are only available when using the [direct extraction method](#configure-extraction).)

### Configure metadata

You can override the defaults for any of these options:

- Looker folders contain saved content, such as [dashboards](https://docs.atlan.com/llms/connectors/looker/what-does-atlan-crawl-from-looker/llms.txt), [looks](https://docs.atlan.com/llms/connectors/looker/what-does-atlan-crawl-from-looker/llms.txt), and [tiles](https://docs.atlan.com/llms/connectors/looker/what-does-atlan-crawl-from-looker/llms.txt):
 - To select the Looker folders you want to include in crawling, click **Include Folders**. (Defaults to all folders, if none are specified.)
 - To select the Looker folders you want to exclude from crawling, click **Exclude Folders**. (Defaults to no folders, if none are specified.)
- Looker projects contain LookML files, such as [models](https://docs.atlan.com/llms/connectors/looker/what-does-atlan-crawl-from-looker/llms.txt), [views](https://docs.atlan.com/llms/connectors/looker/what-does-atlan-crawl-from-looker/llms.txt), and [explores](https://docs.atlan.com/llms/connectors/looker/what-does-atlan-crawl-from-looker/llms.txt):
 - To select the Looker projects you want to include in crawling, click **Include Projects**. (Defaults to all projects, if none are specified.)
 - To select the Looker projects you want to exclude from crawling, click **Exclude Projects**. (Defaults to no projects, if none are specified.)

:::info **Did you know?**
 If a folder or project appears in both the include and exclude filters, the exclude filter takes precedence.

:::

### Configure advanced settings

- For _Use Field Level Lineage_, click **True** to enable crawling field-level lineage for Looker or click **False** to disable it.

## Run crawler

To run the Looker crawler, after completing the previous steps:

1. To check for any [permissions or other configuration issues](https://docs.atlan.com/llms/connectors/looker/preflight-checks-for-looker/llms.txt) before running the crawler, click **Preflight checks**.

2. You can either:
 - To run the crawler once immediately, at the bottom of the screen, click the **Run** button.
 - To schedule the crawler to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the **Schedule Run** button.

Once the crawler has completed running, the assets appear in Atlan's asset page! 🎉

---
