## Crawl DataStax Enterprise

URL: https://docs.atlan.com/apps/connectors/database/datastax-enterprise/how-tos/crawl-datastax-enterprise

> Extract metadata from DataStax Enterprise to catalog databases, tables, columns, and keyspaces. Discover and govern your NoSQL data assets after configuring user permissions.

Extract metadata from your [DataStax Enterprise](https://docs.atlan.com/llms/connectors/datastax-enterprise/set-up-datastax-enterprise/llms.txt) cluster into Atlan to catalog databases, tables, and keyspaces. After configuring the necessary user permissions, you can establish a connection and crawl your NoSQL environment to extract asset-level details.

To crawl metadata from DataStax Enterprise, review

 the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) and then complete the following steps.

## Select the source

To select DataStax Enterprise as your source:

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **DataStax Enterprise Assets** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

## Provide credentials

- In **Direct** extraction, Atlan connects to DataStax Enterprise and crawls metadata directly.
- In **Agent** extraction, Atlan's secure agent executes metadata extraction within the organization's environment.

### Direct extraction method

To enter your DataStax Enterprise credentials:

1. For _Host Name_, enter the host name of your DataStax Enterprise instance.

2. For _Port_, enter the port number of your DataStax Enterprise instance.

3. For _Authentication_, **Basic** authentication, enter the _Username_ and _Password_ you use to log in to DataStax Enterprise.

4. (Optional) For _SSL_, keep the default _Enabled_ to use HTTPS or click **Disabled** to use HTTP.

5. (Optional) For _SSL certificate_, this is only required if [your DataStax Enterprise instance uses a self-signed or an internal CA SSL certificate](https://docs.atlan.com/llms/connectors/datastax-enterprise/set-up-datastax-enterprise/llms.txt), paste a [supported SSL certificate in the recommended format](https://docs.atlan.com/llms/catalog/connector-capabilities/provide-ssl-certificates/llms.txt).

6. At the bottom of the form, click the **Test Authentication** button to confirm connectivity to DataStax Enterprise using these details.

7. When successful, at the bottom of the screen click the **Next** button.

### Agent extraction method

Atlan supports using a Secure Agent for fetching metadata from DataStax Enterprise. To use a Secure Agent, follow these steps:

1. Select the **Agent** tab.

2. Configure the DataStax Enterprise data source by adding the secret keys for your secret store. For details on the required fields, refer to the Direct extraction section.

3. Complete the Secure Agent configuration by following the instructions in the [How to configure Secure Agent for workflow execution](https://docs.atlan.com/llms/platform/secure-agent/configure-secure-agent-for-workflow-execution/llms.txt) guide.

4. Click **Next** after completing the configuration.

## Configure the connection

To complete the DataStax Enterprise connection configuration:

1. Provide a _Connection Name_ that represents your source environment. For example, you might want to use values like `production`, `development`, `gold`, or `analytics`.

2. (Optional) To change the users able to manage this connection, change the users or groups listed under _Connection Admins_.

 :::warning

 If you do not specify any user or group, nobody will be able to manage the connection - not even admins.

 :::

## Configure the crawler

Before running the DataStax Enterprise crawler, you can further configure it.

1. On the _Metadata_ page, you can override the defaults for any of these options:
 - To select the DataStax Enterprise keyspaces you want to include in crawling, click **Include Keyspaces**. (This will default to all assets, if none are specified.)
 - To select the DataStax Enterprise keyspaces you want to exclude from crawling, click **Exclude Keyspaces**. (This will default to no assets, if none are specified.)
 - To have the crawler ignore DataStax Enterprise keyspaces based on a naming convention, specify a regular expression in the _Exclude Keyspaces Regex_ field.
2. To check for any [permissions or other configuration issues](https://docs.atlan.com/llms/connectors/datastax-enterprise/preflight-checks-for-datastax-enterprise/llms.txt) before running the crawler, click **Preflight checks**.

:::info **Did you know?** 
 If a keyspace appears in both the include and exclude filters, the exclude filter takes precedence. (The _Exclude Keyspace Regex_ also takes precedence.)

:::

Once the crawler has completed running, you will see the assets in Atlan's asset page! 🎉

---