Crawl SAP Datasphere
Create a SAP Datasphere crawler workflow in Atlan to extract metadata from your tenant. The workflow configures the connection, extraction method, and crawl scope.
Prerequisites
Before you begin:
- Complete Set up SAP Datasphere so the OAuth client and database user are configured in your tenant.
- Review the order of operations for connection workflows.
Create crawler workflow
-
In your Atlan workspace, click Connectors in the left sidebar.
- If you are using the Old UI (Classic), click New Workflow in the top navigation.
-
Click Marketplace.
-
Search for SAP Datasphere Assets and select it.
-
Click Install.
-
Once installation completes, click Setup Workflow on the same tile.
Configure extraction
Select your extraction method and provide the connection details. Every connection uses one OAuth client (SAP Datasphere APIs) and one database user (SAP HANA Cloud SQL endpoint).
- Direct
- Agent
In Direct extraction, Atlan connects to your tenant and crawls metadata directly.
-
Enter your SAP Datasphere OAuth details:
- Datasphere Tenant URL: Enter your tenant base URL.
- OAuth Token URL: Enter the OAuth 2.0 token endpoint for the tenant.
- OAuth Client ID and OAuth Client Secret: Enter the credentials for the OAuth client you created.
-
Enter your SAP HANA connection details:
- SAP HANA Host: Enter the SQL endpoint host for the database backing your tenant.
- SAP HANA Port: Enter the port for the SQL endpoint (default is
443). - SAP HANA User and SAP HANA Password: Enter the database user you created.
-
Click Test Authentication to confirm connectivity to both the SAP Datasphere API and the SAP HANA endpoint.
-
When successful, at the bottom of the screen click Next.
In Agent extraction, Self-Deployed Runtime executes metadata extraction within your organization's environment.
-
Install Self-Deployed Runtime if you haven't already:
-
Select the Agent tab.
-
Enter the SAP Datasphere and SAP HANA connection details as reachable from within your network.
-
Store sensitive information in the secret store configured with the Self-Deployed Runtime and reference the secrets in the corresponding fields. For more information, see Secret management.
-
Click Next after completing the configuration.
Configure connection
Complete the SAP Datasphere connection configuration:
-
Enter a Connection Name that represents your source environment (for example,
production,development, oranalytics). -
Under Connection Admins, add the users or groups that can manage this connection. If you leave this empty, no one can manage the connection, including admins.
-
At the bottom of the screen, click Next.
Configure crawler
Configure crawl scope before running the crawler. SAP Datasphere assets are organized by space:
- Click Include Spaces to choose which spaces to include (default is all if none are specified).
- Click Exclude Spaces to choose which spaces to exclude (default is none). If a space matches both include and exclude, the exclude filter takes precedence.
Run crawler
Configure the frequency of crawler runs: choose to run the crawler immediately or schedule it to run at an interval.
-
In Direct mode only, click Preflight checks to validate connectivity and configuration before running.
-
At the bottom of the screen, click Run to run once, or Schedule Run to run hourly, daily, weekly, or monthly.
After the crawler completes, assets appear in the asset page.
See also
- What does Atlan crawl from SAP Datasphere: Assets and metadata discovered
- Preflight checks for SAP Datasphere: Prerequisites and validation