Skip to main content

Crawl SQL Server Integration Services (SSIS) assets

Create a workflow in Atlan to discover and catalog SQL Server Integration Services (SSIS) assets from project files stored in Azure Blob Storage. The workflow extracts metadata from your SSIS project files and creates assets in Atlan for projects, packages, tasks, and components.

Prerequisites​

Before you begin, verify you have:

  • Completed the Set up SQL Server Integration Services guide
  • SSIS project files uploaded to Azure Blob Storage using the required folder structure
  • Azure Blob Storage connection details ready:
    • Storage Account Name: The name of your Azure Storage Account
    • Container Name: The name of the blob container containing your SSIS files
    • Azure Tenant ID: Your Azure Active Directory tenant ID
    • Client ID: The application (client) ID of your Azure service principal
    • Client Secret: The client secret value for authentication

Create crawler workflow​

Create a new workflow in Atlan to connect to your SSIS project files in Azure Blob Storage.

  1. Log in to Atlan.
  2. In the top right of any screen, navigate to New and then click New Workflow.
  3. In the Marketplace tab, search for or locate SSIS Connector.
  4. Select SSIS Connector to open the workflow setup.
  5. Select ADLS as the cloud object store type.

Configure authentication​

Configure Azure Blob Storage authentication credentials and test the connection.

  1. Enter your Azure Blob Storage details in the connection form:
    • Storage Account Name: Enter the name of your Azure Storage Account (for example, mystorageaccount)
    • Container Name: Enter the name of the blob container containing your SSIS files (for example, ssis-files)
    • Azure Tenant ID: Enter your Azure Active Directory tenant ID (a GUID format, for example, 12345678-1234-1234-1234-123456789012)
    • Client ID: Enter the application (client) ID of your Azure service principal
    • Client Secret: Enter the client secret value for the service principal
  2. Select Test Authentication to verify the connection. Atlan validates:
    • Azure authentication using the provided credentials
    • Access to the specified storage account
    • Access to the specified container
  3. Wait for the authentication test to complete. You see a success message if the credentials are valid and access is confirmed.
  4. If authentication fails, verify:
    • The service principal has the Storage Blob Data Reader role on the storage account
    • The tenant ID, client ID, and client secret are correct
    • The storage account name and container name match exactly
  5. After successful authentication, select Next to proceed to connection configuration.

Configure connection​

Complete connection configuration with additional settings.

  1. Enter a Connection name that represents your SSIS environment (for example, production-ssis or development-ssis). This name appears in Atlan to identify this SSIS connection.
  2. To change who can manage this connection, modify the users or groups listed under Connection Admins. If you don't specify any user or group, nobody can manage the connection, not even admins.
  3. Review your configuration and select Next to proceed.

Run crawler​

Run the workflow to extract metadata from your SSIS project files and create assets in Atlan.

  1. To check for any permissions or configuration issues before running, select Preflight checks. The preflight checks verify:
    • Azure authentication is working
    • Container access is available
    • Required files are present in the expected structure
  2. After preflight checks pass (or to skip them), choose how to run the workflow:
    • Run: Execute the crawler once immediately
    • Schedule & Run: Schedule the crawler to run on a recurring schedule (hourly, daily, weekly, or monthly)
  3. Select your preferred option to start the workflow. The workflow begins processing your SSIS project files. You can monitor progress in the workflow execution details.
  4. After the workflow completes, SSIS assets appear in Atlan.

Need help​

If you encounter issues while crawling SSIS assets, see Task and crawl issues for solutions to common workflow failures. For additional assistance, contact Atlan support by submitting a request.

See also​