## Crawl ThoughtSpot

URL: https://docs.atlan.com/apps/connectors/business-intelligence/thoughtspot/how-tos/crawl-thoughtspot

> Extract metadata from ThoughtSpot to catalog pinboards, answers, and liveboards. Discover and govern your BI assets after configuring permissions.

Extract metadata from your [ThoughtSpot](https://docs.atlan.com/llms/connectors/thoughtspot/set-up-thoughtspot/llms.txt) environment into Atlan to catalog pinboards, answers, and liveboards. After configuring the necessary permissions, you can establish a connection and crawl to extract usage and lineage information.

To crawl metadata from ThoughtSpot, review the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) and then complete the following steps.

## Select source

To select ThoughtSpot as your source:

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **ThoughtSpot Assets** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

## Provide your credentials

Choose your extraction method:

:::warning Offline extraction sunset
The offline extraction method has been sunset and is no longer available. For on-premises or network-restricted environments, use the **Agent** extraction method with [Self-Deployed Runtime](https://docs.atlan.com/llms/platform/self-deployed-runtime/llms.txt).
:::

- In **Direct** extraction, Atlan connects to your database and crawls metadata directly.
- In **Agent** extraction, Atlan’s secure agent executes metadata extraction within the organization's environment.

### Direct extraction method

To enter your ThoughtSpot credentials:

1. For _Extraction method_, **Direct** is the default selection.

2. For _Hostname_, enter the hostname of your ThoughtSpot cloud instance in the following format - `<company_name>.thoughtspot.cloud`.

3. For _Authentication_, select the method you configured when [setting up the ThoughtSpot access permissions](https://docs.atlan.com/llms/connectors/thoughtspot/set-up-thoughtspot/llms.txt):
 - For _Basic _Authentication__, enter the [username and password you created](https://docs.atlan.com/llms/connectors/thoughtspot/set-up-thoughtspot/llms.txt).
 - For _Trusted Authentication_, enter the username of your ThoughtSpot instance and the [secret key you created](https://docs.atlan.com/llms/connectors/thoughtspot/set-up-thoughtspot/llms.txt).
4. Click the **Test Authentication** button to confirm connectivity to ThoughtSpot.

5. Once authentication is successful, navigate to the bottom of the screen and click **Next**.

### Agent extraction method

Atlan supports using a Secure Agent for fetching metadata from ThoughtSpot. To use a Secure Agent, follow these steps:

1. Select the **Agent** tab.

2. Configure the ThoughtSpot data source by adding the secret keys for your secret store. For details on the required fields, refer to the [Direct extraction](#direct-extraction-method) section.

3. Complete the Secure Agent configuration by following the instructions in the [How to configure Secure Agent for workflow execution](https://docs.atlan.com/llms/platform/secure-agent/configure-secure-agent-for-workflow-execution/llms.txt) guide.

4. Click **Next** after completing the configuration.

## Configure connection

To complete the ThoughtSpot connection configuration:

1. Provide a _Connection Name_ that represents your source environment. For example, you might use values like `production`,`development`,`gold`, or `analytics`.

2. (Optional) To change the users who are able to manage this connection, change the users or groups listed under _Connection Admins_.

 :::warning

 If you don't specify any user or group, no one can manage the connection - not even admins.

 :::

3. Navigate to the bottom of the screen and click **Next** to proceed.

## Configure crawler

Before running the ThoughtSpot crawler, you can further configure it.

On the _Metadata_ page, you can override the defaults for any of these options:

- To select the assets you want to include in crawling, click **Include tags**. (This defaults to all assets, if none are specified.)
- To select the assets you want to exclude from crawling, click **Exclude tags**. (This defaults to no assets, if none specified.)
- For _Assets without tags_, keep the default option **Yes** to skip crawling assets without [tags](https://docs.thoughtspot.com/seekwell/latest/tags-and-search) or click **No** to enable crawling them.

:::info **Did you know?** 
 If an asset appears in both the include and exclude filters, the exclude filter takes precedence.

:::

## Run crawler

To run the ThoughtSpot crawler, after completing the previous steps:

1. To check for any permissions or other configuration issues before running the crawler, click **Preflight checks**.

2. You can either:
 - To run the crawler once immediately, at the bottom of the screen, click the **Run** button.
 - To schedule the crawler to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the **Schedule Run** button.

Once the crawler has completed running, the assets appear on Atlan's asset page! 🎉

---