6 docs tagged with "miner"

Enable query logging and configure your ClickHouse instance so the ClickHouse Miner workflow can extract query history and generate lineage.

Enable pg_stat_statements and configure your PostgreSQL instance so the PostgreSQL Miner workflow can extract query history and generate lineage.

Configure and run Generic Miner to extract table-level and column-level lineage from SQL query history stored in Atlan's object store, Amazon S3, Google Cloud Storage, or Azure Blob Storage—without a live connection to the source system.

Once you have [crawled assets from ClickHouse](/apps/connectors/database/clickhouse/how-tos/crawl-clickhouse), you can mine its query history to construct lineage.

Once you have [crawled assets from PostgreSQL](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can mine its query history to construct lineage.

Prepare SQL query history files and configure cloud object storage access so Generic Miner can extract lineage from query logs stored in Atlan's object store, Amazon S3, Google Cloud Storage, or Azure Blob Storage.