Crawl Microsoft Fabric

Discover and catalog Microsoft Fabric workspaces, reports, dashboards, and datasets in Atlan.

Prerequisites

Before you begin, make sure you have:

• Set up Microsoft Fabric with the required permissions
• Admin access to your Atlan instance
• Microsoft Fabric service principal credentials (tenant ID, client ID, and client secret)
• If using Agent extraction: Self-Deployed Runtime deployed and configured. Complete the Secure Agent configuration by following the instructions in the How to configure Secure Agent for workflow execution guide.

Create crawler workflow

To crawl metadata from Microsoft Fabric, review the order of operations and then complete the following steps.

1. In the top right of any screen, navigate to New and then click New Workflow.
2. From the list of packages, select Fabric Assets and click Setup Workflow.

Configure authentication

Atlan offers two extraction methods to connect to Microsoft Fabric. Select the method that best fits your security and infrastructure requirements.

Direct

Atlan connects directly to Microsoft Fabric to crawl metadata.

1. For Authentication, enter the service principal credentials you configured when setting up Microsoft Fabric:
   • Tenant ID
   • Client ID
   • Client Secret
2. Click Test Authentication to confirm connectivity to Microsoft Fabric.
3. Once successful, click Next.

Agent

Use Atlan's Secure Agent to extract metadata from within your organization's environment. This method is ideal for environments with strict network security requirements.

1. Install Self-Deployed Runtime if you haven't already:
   • Install via Docker Compose
   • Install on Kubernetes
2. Select the Agent tab.
3. Store sensitive information in the secret store configured with the Self-Deployed Runtime and reference the secrets in the corresponding fields. For more information, see Configure secrets for workflow execution.
4. Complete the Secure Agent configuration by following the instructions in the How to configure Secure Agent for workflow execution guide.
5. Click Next after completing the configuration.

Configure connection

1. Provide a Connection Name that represents your source environment. For example, you might want to use values like production, development, gold, or analytics.
2. (Optional) To change the users able to manage this connection, change the users or groups listed under Connection Admins. If you don't specify any user or group, nobody can manage the connection, including admins.
3. Click Next to proceed.

Configure crawler

Configure the Microsoft Fabric crawler to specify which workspaces to include or exclude. If a workspace appears in both the include and exclude filters, the exclude filter takes precedence.

• Include Workspaces: Select Microsoft Fabric workspaces to include. Defaults to all workspaces when left blank.
• Exclude Workspaces: Select workspaces to exclude. No workspaces are excluded by default.

Run crawler

1. To check for any permissions or configuration issues before running the crawler, click Preflight checks.

2. You can either:

   • To run the crawler once immediately, click Run.
   • To schedule the crawler to run hourly, daily, weekly, or monthly, click Schedule Run.

Once the crawler has completed running, you can see the assets in Atlan's asset page! 🎉

See also

• What does Atlan crawl from Microsoft Fabric: Understand the metadata and assets that Atlan discovers from your Microsoft Fabric instance
• What lineage does Atlan extract from Microsoft Fabric: Learn about the lineage relationships that Atlan can map from Microsoft Fabric