Mine Microsoft Azure Synapse Analytics
Atlan currently only supports mining query history for dedicated SQL pools with the Microsoft Azure Synapse Analytics miner. Mining query history for serverless SQL pools is currently not supported.
Once you have crawled assets from Microsoft Azure Synapse Analytics, you can mine query history to construct lineage.
To mine lineage from Microsoft Azure Synapse Analy
tics, review the order of operations and then complete the following steps.
Select the miner
To select the Microsoft Azure Synapse Analytics miner:
- In the top navigation, click Marketplace.
- Search for Synapse Miner and select it.
- Click Install.
- Once installation completes, click Setup Workflow on the same tile.
If you navigated away before installation completed, go to New > New Workflow and select Synapse Miner to proceed.
Configure miner
To configure the Microsoft Azure Synapse Analytics miner:
- For Connection, select the connection to mine. (To select a connection, the crawler must have already run.)
- For Miner Extraction Method, choose your extraction method:
- In Query History, Atlan connects to your database and mines query history directly.
- In Offline, you will need to first mine query history yourself and make it available in S3.
Run the miner
To run the Microsoft Azure Synapse Analytics miner, after completing the steps above:
- To run the miner once, immediately, at the bottom of the screen, click the Run button.
- To schedule the miner to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the Schedule & Run button.
Once the miner has completed running, you will see lineage for Microsoft Azure Synapse Analytics assets that were created in Microsoft Azure Synapse Analytics! 🎉