## Crawl Talend assets

URL: https://docs.atlan.com/apps/connectors/etl-tools/talend/how-tos/crawl-talend

> Crawl metadata from Talend to catalog jobs, components, and transformations. Extract transformation lineage from project files in GitHub or Atlassian Stash repositories.

Create a workflow in Atlan to discover and catalog [Talend](https://docs.atlan.com/llms/connectors/talend/set-up-talend/llms.txt) assets from project files stored in a GitHub or Atlassian Stash repository. Each workflow connects to one repository. To catalog assets from multiple repositories, create a separate workflow for each. Review the [order of operations](https://docs.atlan.com/llms/catalog/connector-capabilities/order-workflows/llms.txt) for metadata enrichment workflows before starting.

## Prerequisites

Before you begin, make sure you have:

- [Completed Talend connector setup](https://docs.atlan.com/llms/connectors/talend/set-up-talend/llms.txt)
- Repository URL and personal access token ready
- Branch name containing your Talend project files

## Create crawler workflow

1. In your Atlan workspace, click **Connectors** in the left sidebar.
 * If you are using the **Old UI (Classic)**, click **New Workflow** in the top navigation.

2. Click **Marketplace**.

3. Search for **Talend Connector** and select it.

4. Click **Install**.

5. Once installation completes, click **Setup Workflow** on the same tile.

5. Select **GitHub Cloud Store** as the cloud store type. Both GitHub and Atlassian Stash (Bitbucket Server) are supported through this connection type.

### Configure connection

Enter the repository URL, access token, and connection settings for this workflow.

1. Enter your repository details:
 - **Repository URL**: Enter the repository path ending with `.git`, for example `github.com/organization/repository.git`. The `https://` prefix is added automatically.
 - **Git access token**: Enter your personal access token with read permissions.
 - **Branch name**: Enter the branch to crawl, for example `main` or `master`.
 - **Talend project path**: If your Talend projects are in a subdirectory, enter the path, for example `talend_projects/`. Leave this blank to crawl from the repository root.
2. Enter a **Connection name** to identify this Talend connection in Atlan, for example `production-talend`.

3. To change who manages this connection, update the users or groups listed under **Connection admins**.

### Run crawler

Choose to run the crawler once immediately or schedule it to run at a recurring interval.

1. Click **Run** to run once, or **Schedule & Run** to run hourly, daily, weekly, or monthly.

2. Monitor progress in the workflow execution details.

After the crawler completes, assets appear in Atlan. Navigate to **Assets** and filter by **Talend** to browse projects, jobs, components, and component fields.

## See also

[What does Atlan crawl from Talend](https://docs.atlan.com/llms/connectors/talend/what-does-atlan-crawl-from-talend/llms.txt): Review the Talend asset types and metadata Atlan extracts

## Need help

If you encounter issues while crawling Talend assets, see [Connection and authentication issues](https://docs.atlan.com/llms/connectors/talend/connection-and-authentication-issues/llms.txt). For additional assistance, contact Atlan support by [submitting a request](https://docs.atlan.com/support/submit-request).

---