Skip to main content

Crawl Microsoft Fabric

Discover and catalog Microsoft Fabric workspaces, reports, dashboards, and datasets in Atlan.

Prerequisites​

Before you begin, make sure you have:

  • Set up Microsoft Fabric with the required permissions
  • Admin access to your Atlan instance
  • Microsoft Fabric service principal credentials (tenant ID, client ID, and client secret)

Create crawler workflow​

To crawl metadata from Microsoft Fabric, review the order of operations and then complete the following steps.

  1. In the top right of any screen, navigate to New and then click New Workflow.
  2. From the list of packages, select Fabric Assets and click Setup Workflow.

Configure authentication​

  1. For Authentication, enter the service principal credentials you configured when setting up Microsoft Fabric:
    • Tenant ID
    • Client ID
    • Client Secret
  2. Click Test Authentication to confirm connectivity to Microsoft Fabric.
  3. Once successful, click Next.

Configure connection​

  1. Provide a Connection Name that represents your source environment. For example, you might want to use values like production, development, gold, or analytics.
  2. (Optional) To change the users able to manage this connection, change the users or groups listed under Connection Admins. If you don't specify any user or group, nobody can manage the connection, including admins.
  3. Click Next to proceed.

Configure crawler​

Configure the Microsoft Fabric crawler to specify which workspaces to include or exclude. If a workspace appears in both the include and exclude filters, the exclude filter takes precedence.

  • Include Workspaces: Select Microsoft Fabric workspaces to include. Defaults to all workspaces when left blank.
  • Exclude Workspaces: Select workspaces to exclude. No workspaces are excluded by default.

Run crawler​

  1. To check for any permissions or configuration issues before running the crawler, click Preflight checks.

  2. You can either:

    • To run the crawler once immediately, click Run.
    • To schedule the crawler to run hourly, daily, weekly, or monthly, click Schedule Run.

Once the crawler has completed running, you can see the assets in Atlan's asset page! 🎉

See also​