## Crawl SAP Datasphere

URL: https://docs.atlan.com/apps/connectors/data-warehouses/sap-datasphere/how-tos/crawl-sap-datasphere

> Create a SAP Datasphere crawler workflow in Atlan to extract metadata from your tenant.

# Crawl SAP Datasphere 

Create a SAP Datasphere crawler workflow in Atlan to extract metadata from your tenant. The workflow configures the connection, extraction method, and crawl scope.

## Prerequisites

Before you begin:

* Complete [Set up SAP Datasphere](https://docs.atlan.com/llms/connectors/sap-datasphere/set-up-sap-datasphere/llms.txt) so the OAuth client and database user are configured in your tenant.
* Review the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) for connection workflows.

## Create crawler workflow

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **SAP Datasphere Assets** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

### Configure extraction

Select your extraction method and provide the connection details. Every connection uses one OAuth client (SAP Datasphere APIs) and one database user (SAP HANA Cloud SQL endpoint).

### Direct

In **Direct** extraction, Atlan connects to your tenant and crawls metadata directly.

1. Enter your SAP Datasphere OAuth details:
 - **Datasphere Tenant URL**: Enter your tenant base URL.
 - **OAuth Token URL**: Enter the OAuth 2.0 token endpoint for the tenant.
 - **OAuth Client ID** and **OAuth Client Secret**: Enter the credentials for the [OAuth client you created](https://docs.atlan.com/llms/connectors/sap-datasphere/set-up-sap-datasphere/llms.txt).

2. Enter your SAP HANA connection details:
 - **SAP HANA Host**: Enter the SQL endpoint host for the database backing your tenant.
 - **SAP HANA Port**: Enter the port for the SQL endpoint (default is `443`).
 - **SAP HANA User** and **SAP HANA Password**: Enter the [database user you created](https://docs.atlan.com/llms/connectors/sap-datasphere/set-up-sap-datasphere/llms.txt).

3. Click **Test Authentication** to confirm connectivity to both the SAP Datasphere API and the SAP HANA endpoint.

4. When successful, at the bottom of the screen click **Next**.

### Agent

In **Agent** extraction, Self-Deployed Runtime executes metadata extraction within your organization's environment.

1. Install Self-Deployed Runtime if you haven't already:
 - [Install via Docker Compose](https://docs.atlan.com/llms/platform/self-deployed-runtime/install-on-docker-compose/llms.txt)
 - [Install on Kubernetes](https://docs.atlan.com/llms/platform/self-deployed-runtime/install-on-kubernetes/llms.txt)
2. Select the **Agent** tab.

3. Enter the SAP Datasphere and SAP HANA connection details as reachable from within your network.

4. Store sensitive information in the secret store configured with the Self-Deployed Runtime and reference the secrets in the corresponding fields. For more information, see [Secret management](https://docs.atlan.com/llms/platform/self-deployed-runtime/secret-management/llms.txt).

5. Click **Next** after completing the configuration.

### Configure connection

Complete the SAP Datasphere connection configuration:

1. Enter a **Connection Name** that represents your source environment (for example, `production`, `development`, or `analytics`).

2. Under **Connection Admins**, add the users or groups that can manage this connection. If you leave this empty, no one can manage the connection, including admins.

3. At the bottom of the screen, click **Next**.

### Configure crawler

Configure crawl scope before running the crawler. SAP Datasphere assets are organized by **space**:

* Click **Include Spaces** to choose which spaces to include (default is all if none are specified).
* Click **Exclude Spaces** to choose which spaces to exclude (default is none). If a space matches both include and exclude, the exclude filter takes precedence.

### Run crawler

Configure the frequency of crawler runs: choose to run the crawler immediately or schedule it to run at an interval.

1. In Direct mode only, click **Preflight checks** to validate [connectivity and configuration](https://docs.atlan.com/llms/connectors/sap-datasphere/preflight-checks-for-sap-datasphere/llms.txt) before running.

2. At the bottom of the screen, click **Run** to run once, or **Schedule Run** to run hourly, daily, weekly, or monthly.

After the crawler completes, assets appear in the asset page.

## See also

* [What does Atlan crawl from SAP Datasphere](https://docs.atlan.com/llms/connectors/sap-datasphere/what-does-atlan-crawl-from-sap-datasphere/llms.txt): Assets and metadata discovered
* [Preflight checks for SAP Datasphere](https://docs.atlan.com/llms/connectors/sap-datasphere/preflight-checks-for-sap-datasphere/llms.txt): Prerequisites and validation

---