Skip to main content

5 docs tagged with "miner"

View all tags

Generate lineage

Enable query logging and configure your ClickHouse instance so the ClickHouse Miner workflow can extract query history and generate lineage.

Generate lineage

Enable pg_stat_statements and configure your PostgreSQL instance so the PostgreSQL Miner workflow can extract query history and generate lineage.

Generate lineage from S3 queries

Extract lineage from SQL query history stored in Amazon S3 using the Generic Miner app. Generate table-level and column-level lineage for existing connections when source systems don't expose complete query history or when query logs are retained externally.

Mine ClickHouse

Once you have [crawled assets from ClickHouse](/apps/connectors/database/clickhouse/how-tos/crawl-clickhouse), you can mine its query history to construct lineage.

Mine PostgreSQL

Once you have [crawled assets from PostgreSQL](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can mine its query history to construct lineage.