Skip to main content

477 docs tagged with "connectors"

View all tags

Attach a tag

Atlan lets users add [tags](/product/capabilities/governance/tags/concepts/what-are-tags) to assets. You can use them to identify key characteristics of assets or group them together for usage or data protection.

Automate data profiling

Create profiling playbooks to scan data assets at scale, identify data quality issues, and improve asset quality. Setup requires admin user permissions in Atlan.

Bidirectional metadata sync

Understand how Atlan synchronizes metadata bidirectionally with AWS SageMaker Unified Studio, including reverse sync capabilities.

Bulk enrich metadata

Atlan enables you to use spreadsheet tools to collaborate on assets with your team, make bulk metadata updates, and sync changes back to Atlan.

Can I connect to any source with an ODBC/JDBC driver?

A number of Atlan's [supported connectors](/product/connections/references/connectors-and-capabilities) use a JDBC- or REST API-based approach for metadata extraction. If you are attempting to connect to a source with no native integration, [contact Atlan support](/support/submit-request) to share more details about your use case.

Can I turn off sample data preview for the entire organization?

Atlan recommends that you turn off sample data preview at a connection level. For example, you can configure the [Snowflake crawler](/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake) to prevent users from previewing any Snowflake data.

Connect on-premises databases to Kubernetes

You can configure and use [Atlan's metadata-extractor tool](/apps/connectors/database/on-premises-databases/how-tos/set-up-on-premises-database-access) to extract metadata from on-premises databases with Kubernetes deployment architecture, as an alternative to using Docker Compose.

Connection issues

Resolve common connection and authentication issues when setting up CrateDB connector

Connectivity models

Understand Atlan's three connectivity models—Direct, Private Link, and SDR—and how each one determines where traffic flows, who manages infrastructure, and what your network security requires.

Connectors

Learn how to connect your data sources to Atlan. Explore supported connectors, integration patterns, and best practices for unified catalog management.

Crawl Aiven Kafka

Extract metadata from Aiven Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring permissions.

Crawl AlloyDB for PostgreSQL

Extract metadata from your AlloyDB for PostgreSQL database and establish a connection between Atlan and your database

Crawl Amazon Athena

To crawl metadata from Amazon Athena, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.

Crawl Amazon DynamoDB

Extract metadata from Amazon DynamoDB to catalog tables, items, and attributes. Extract asset information and column-level details after configuring AWS permissions.

Crawl Amazon MSK

To crawl metadata from Amazon MSK, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.

Crawl Amazon QuickSight

Extract metadata from Amazon QuickSight to catalog dashboards, analyses, and datasets. Discover and govern your BI assets after configuring permissions.

Crawl Amazon Redshift

Once you have configured the [Amazon Redshift access permissions](/apps/connectors/data-warehouses/amazon-redshift/how-tos/set-up-amazon-redshift), you can establish a connection between Atlan and Amazon Redshift.

Crawl Anaplan

Crawl metadata from Anaplan to catalog workspaces, models, dimensions, and planning modules. Extract model structure and planning asset information after configuring user access.

Crawl Apache Kafka

Crawl metadata from Apache Kafka to catalog topics, consumer groups, and clusters. Extract schema information from Confluent Schema Registry after configuring cluster permissions.

Crawl AWS Glue

Crawl metadata from AWS Glue Data Catalog to catalog jobs, workflows, tables, and data transformations. Extract lineage information after configuring AWS access permissions.

Crawl BigID

Configure and run the Atlan BigID workflow to crawl metadata from BigID.

Crawl ClickHouse

Create a ClickHouse crawler workflow in Atlan to extract metadata from your database.

Crawl CrateDB

Configure and run the CrateDB crawler to extract metadata from your database

Crawl Cyera

Crawl classification metadata from Cyera to enrich assets with data sensitivity and privacy information. Extract data sensitivity classifications and security issues.

Crawl Dagster assets

Capture lineage from Dagster assets by creating a listener in Atlan. Extract data orchestration metadata and asset dependencies from your Dagster instance.

Crawl Databricks

Crawl metadata from Databricks to catalog tables, schemas, views, and volumes. Extract lineage and column information after configuring access permissions and authentication.

Crawl Databricks AI models

Discover and catalog AI models registered in the Databricks Unity Catalog Model Registry using Atlan's Databricks connector.

Crawl DataStax Enterprise

Extract metadata from DataStax Enterprise to catalog databases, tables, columns, and keyspaces. Discover and govern your NoSQL data assets after configuring user permissions.

Crawl dbt

Configure and run the crawler to extract metadata from your dbt Cloud or dbt Core projects.

Crawl Domo

Extract metadata from Domo to catalog dashboards, datasets, cards, and pages. Discover and govern your BI assets after configuring permissions.

Crawl Dremio

Crawl metadata from Dremio to catalog physical datasets, virtual datasets, folders, and spaces. Extract lineage and asset information from your data lakehouse.

Crawl Fivetran

Enrich Atlan with Fivetran metadata to track data pipeline lineage and transformations. Configure the Fivetran Platform Connector and connect a supported data warehouse destination.

Crawl Google BigQuery

Crawl metadata from Google BigQuery to catalog datasets, tables, views, and columns. Extract lineage and asset details after completing prerequisite setup.

Crawl Hightouch

Crawl metadata from Hightouch to catalog models and syncs. Extract reverse ETL lineage between data warehouse sources and operational business tools after configuring API credentials.

Crawl Hive

Extract metadata from Hive to catalog databases, tables, views, and columns. Extract lineage and asset information after configuring user permissions.

Crawl IBM Cognos Analytics

Extract metadata from IBM Cognos Analytics to catalog reports, queries, and dashboards. Discover and govern your BI assets after configuring user permissions.

Crawl Iceberg

Crawl metadata from Iceberg to catalog tables, namespaces, and columns. Extract table metadata and lineage from your Iceberg data lakehouse catalogs.

Crawl Informatica CDI assets

Crawl metadata from Informatica Cloud Data Integration to catalog projects, workflows, tasks, and mappings. Extract data transformation lineage after configuring cloud access.

Crawl Looker

Once you have configured the [Looker user permissions](/apps/connectors/business-intelligence/looker/how-tos/set-up-looker), you can establish a connection between Atlan and Looker.

Crawl Matillion

Crawl metadata from Matillion to catalog jobs, tasks, pipelines, and transformations. Extract lineage information after configuring user permissions and connectivity.

Crawl Metabase

Once you have [configured the Metabase user permissions](/apps/connectors/business-intelligence/metabase/how-tos/set-up-metabase), you can establish a connection between Atlan and Metabase.

Crawl Microsoft Azure Cosmos DB

Extract metadata from Microsoft Azure Cosmos DB to catalog databases, containers, and documents. Discover and govern your NoSQL data assets after configuring permissions.

Crawl Microsoft Azure Data Factory

Once you have [configured the Microsoft Azure Data Factory permissions](/apps/connectors/etl-tools/microsoft-azure-data-factory/how-tos/set-up-microsoft-.

Crawl Microsoft Azure Event Hubs

Extract metadata from Microsoft Azure Event Hubs to catalog topics, partitions, and consumer groups. Discover and govern your messaging infrastructure after configuring permissions.

Crawl Microsoft Azure Synapse Analytics

Extract metadata from Microsoft Azure Synapse Analytics to catalog databases, schemas, tables, and views. Discover and govern your cloud data warehouse assets after configuring permissions.

Crawl Microsoft Fabric

Crawl metadata from Microsoft Fabric to catalog workspaces, reports, dashboards, and datasets. Extract lineage and analytics information from your Fabric environment.

Crawl Microsoft Power BI

Once you have configured the [Microsoft Power BI user permissions](/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi), you can establish a connection between Atlan and Microsoft Power BI.

Crawl Microsoft SQL Server

Crawl metadata from Microsoft SQL Server to catalog databases, schemas, tables, and views. Extract column details and enable data discovery, lineage tracking, and governance after configuring user permissions.

Crawl Microsoft SSRS

Crawl metadata from SQL Server Reporting Services (SSRS) to catalog reports, datasets, and data sources. Extract report definitions, lineage, and data model information.

Crawl MicroStrategy

Extract metadata from MicroStrategy to catalog reports, dashboards, and metrics. Discover and govern your BI assets after configuring authentication.

Crawl Mode

Once you have [configured the Mode user permissions](/apps/connectors/business-intelligence/mode/how-tos/set-up-mode), you can establish a connection between Atlan and Mode.

Crawl MongoDB (self-managed)

Once you have [configured the MongoDB permissions](/apps/connectors/database/mongodb/onprem/how-tos/set-up-mongodb-onprem), you can establish a connection between Atlan and MongoDB.

Crawl MongoDB Atlas

Configure MongoDB Atlas connection and run the crawler to extract metadata from MongoDB into Atlan.

Crawl Monte Carlo

Once you have [configured the Monte Carlo permissions](/apps/connectors/observability/monte-carlo/how-tos/set-up-monte-carlo), you can establish a connection between Atlan and Monte Carlo.

Crawl MySQL

To crawl metadata from MySQL, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.

Crawl NetSuite

Crawl metadata from NetSuite to catalog record types, record fields, and business processes. Extract enterprise data structure after configuring access credentials.

Crawl on-premises databases

Extract metadata from on-premises databases to catalog tables, schemas, and views. Discover and govern your database assets after configuring the metadata-extractor tool.

Crawl on-premises Databricks

The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks environments, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.

Crawl on-premises IBM Cognos Analytics

Extract metadata from on-premises IBM Cognos Analytics to catalog reports, queries, and dashboards. Discover and govern your BI assets after configuring extractor tool.

Crawl on-premises Kafka

Extract metadata from on-premises Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring extractor tool.

Crawl on-premises Looker

Extract metadata from on-premises Looker to catalog dashboards, looks, explores, and data sources. Discover and govern your BI assets after configuring extractor tool.

Crawl on-premises Tableau

Extract metadata from on-premises Tableau to catalog workbooks, dashboards, and sheets. Discover and govern your BI assets after configuring extractor tool.

Crawl on-premises ThoughtSpot

Extract metadata from on-premises ThoughtSpot to catalog pinboards, answers, and liveboards. Discover and govern your BI assets after configuring extractor tool.

Crawl Oracle

Crawl metadata from Oracle Database to catalog schemas, tables, views, and columns. Extract lineage and asset information after configuring user permissions and database connectivity.

Crawl PostgreSQL

Configure and run PostgreSQL metadata extraction workflows to catalog databases, schemas, tables, views, and columns in Atlan.

Crawl PrestoSQL

Once you have configured the [PrestoSQL user permissions](/apps/connectors/database/prestosql/how-tos/set-up-prestosql), you can establish a connection between Atlan and PrestoSQL.

Crawl Qlik Sense Cloud

Extract metadata from Qlik Sense Cloud to catalog applications, sheets, and visualizations. Discover and govern your BI assets after configuring permissions.

Crawl Qlik Sense Enterprise on Windows

Extract metadata from Qlik Sense Enterprise on Windows to catalog applications, sheets, and visualizations. Discover and govern your BI assets after configuring permissions.

Crawl Qualytics

Crawl metadata from Qualytics to capture data quality checks, anomalies, and scores. Enrich your assets with comprehensive quality insights from quality rules and validations.

Crawl Redash

Once you have [configured the Redash permissions](/apps/connectors/business-intelligence/redash/how-tos/set-up-redash), you can establish a connection between Atlan and Redash.

Crawl Redpanda Kafka

Extract metadata from Redpanda Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring permissions.

Crawl SageMaker

Crawl lineage from AWS SageMaker to catalog machine learning pipelines, jobs, models, and datasets. Extract ML workflow lineage after configuring AWS credentials.

Crawl Salesforce

Extract metadata from Salesforce to catalog objects, fields, and relationships. Discover and govern your CRM data assets after configuring user permissions.

Crawl SAP Datasphere

Configure and run the crawler to extract metadata from SAP Datasphere spaces, views, analytical models, and columns into Atlan.

Crawl SAP HANA

Extract metadata from SAP HANA to catalog databases, schemas, tables, views, and columns. Discover and govern your enterprise data assets after configuring user permissions.

Crawl Sigma

Once you have [configured the Sigma permissions](/apps/connectors/business-intelligence/sigma/how-tos/set-up-sigma), you can establish a connection between Atlan and Sigma.

Crawl Sisense

Extract metadata from Sisense to catalog dashboards, widgets, and datasets. Discover and govern your BI assets after configuring permissions.

Crawl Snowflake

To crawl metadata from Snowflake, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.

Crawl Snowflake AI models

Discover, catalog, and build lineage for AI models registered in the Snowflake Model Registry using Atlan's Snowflake connector.

Crawl Soda

Once you have [configured the Soda permissions](/apps/connectors/observability/soda/how-tos/set-up-soda), you can establish a connection between Atlan and Soda.

Crawl Starburst Enterprise

Crawl metadata from Starburst Enterprise to catalog catalogs, schemas, tables, and data products. Extract domain definitions and lineage information after configuring user permissions.

Crawl Tableau

Crawl metadata from Tableau to catalog workbooks, dashboards, sheets, and data sources. Extract lineage and usage information after configuring user permissions.

Crawl Talend assets

Crawl metadata from Talend to catalog jobs, components, and transformations. Extract transformation lineage from project files in GitHub or Atlassian Stash repositories.

Crawl Teradata

Extract metadata from Teradata to catalog databases, tables, views, and columns. Extract query lineage and asset information after configuring user permissions.

Crawl ThoughtSpot

Extract metadata from ThoughtSpot to catalog pinboards, answers, and liveboards. Discover and govern your BI assets after configuring permissions.

Crawl Trino

Crawl metadata from Trino to catalog schemas, tables, views, and columns. Extract distributed query lineage and asset information after configuring user permissions.

Create README templates

Admin users in Atlan can create, curate, and manage README templates from the governance center. Once admin users have created the templates, other users will be able to select these templates and [enrich their assets with READMEs](/product/integrations). They will also be able to see a rich preview of each template before adding the relevant documentation.

Data Pipelines

Learn how to connect your data pipelines to Atlan. Explore ETL tools, workflow orchestration, and lineage tracking to build a comprehensive view of your data movement.

Deployment architecture

The Atlan Secure Agent is a Kubernetes-based application that runs within a customer's environment. It acts as a gateway between the single-tenant Atlan SaaS and external systems like Snowflake, Tableau, and other data sources. This document explains the Secure Agent's deployment architecture, key components, communication flows, and security considerations.

Direct connectivity

Understand how Atlan connects directly to your data sources over the internet to extract metadata

Does Atlan require an admin user in Salesforce?

No. However, it is recommended that a Salesforce administrator establishes a [connection between Atlan and Salesforce](/apps/connectors/crm/salesforce/how-tos/set-up-salesforce). To learn more, see [here](/apps/connectors/crm/salesforce/troubleshooting/troubleshooting-salesforce-connectivity).

Domain-assets linking

Link AWS SageMaker Unified Studio assets to Atlan Data Domains for unified governance.

Download impacted assets in Google Sheets

Once you've [connected Atlan with Google Sheets](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-google-sheets), you can download impacted assets in Google Sheets. This can help you assess the downstream impact of any changes made to an upstream asset for [impact analysis](/product/capabilities/lineage/concepts/what-is-lineage#impact-analysis).

Dynamic mapping task lineage

How Atlan resolves source fields, target fields, and field-level lineage for Informatica CDI dynamic mapping tasks

Enable Azure AD for SSO

SSO group mappings are triggered every time a user authenticates in Atlan. A user may need to log out and then log into Atlan again to view the changes. If a user is added to a new group or removed from an existing one in Azure AD, the updates will also be reflected in Atlan. To ensure that the sync is successful, the groups that the user belongs to should be mapped in Atlan, and if a group name has changed in Azure AD, you will need to update the group name in Atlan as well. For any questions about group mapping sync, head over [here](/product/integrations/identity-management/sso/troubleshooting/troubleshooting-sso).

Enable Google for SSO

SSO group mappings are triggered every time a user authenticates in Atlan. A user may need to log out and then log into Atlan again to view the changes. If a user is added to a new group or removed from an existing one in Google, the updates will also be reflected in Atlan. To ensure that the sync is successful, the groups that the user belongs to should be mapped in Atlan, and if a group name has changed in Google, you will need to update the group name in Atlan as well. For any questions about group mapping sync, head over [here](/product/integrations/identity-management/sso/troubleshooting/troubleshooting-sso).

Enable JumpCloud for SSO

SSO group mappings are triggered every time a user authenticates in Atlan. A user may need to log out and then log into Atlan again to view the changes. If a user is added to a new group or removed from an existing one in JumpCloud, the updates will also be reflected in Atlan. To ensure that the sync is successful, the groups that the user belongs to should be mapped in Atlan, and if a group name has changed in JumpCloud, you will need to update the group name in Atlan as well. For any questions about group mapping sync, head over [here](/product/integrations/identity-management/sso/troubleshooting/troubleshooting-sso).

Enable Okta for SSO

SSO group mappings are triggered every time a user authenticates in Atlan. A user may need to log out and then log into Atlan again to view the changes. If a user is added to a new group or removed from an existing one in Okta, the updates will also be reflected in Atlan. To ensure that the sync is successful, the groups that the user belongs to should be mapped in Atlan, and if a group name has changed in Okta, you will need to update the group name in Atlan as well. For any questions about group mapping sync, head over [here](/product/integrations/identity-management/sso/troubleshooting/troubleshooting-sso).

Enable OneLogin for SSO

SSO group mappings are triggered every time a user authenticates in Atlan. A user may need to log out and then log into Atlan again to view the changes. If a user is added to a new group or removed from an existing one in OneLogin, the updates will also be reflected in Atlan. To ensure that the sync is successful, the groups that the user belongs to should be mapped in Atlan, and if a group name has changed in OneLogin, you will need to update the group name in Atlan as well. For any questions about group mapping sync, head over [here](/product/integrations/identity-management/sso/troubleshooting/troubleshooting-sso).

Enable SAML 2.0 for SSO

SSO group mappings are triggered every time a user authenticates in Atlan. A user may need to log out and then log into Atlan again to view the changes. If a user is added to a new group or removed from an existing one in SAML 2.0, the updates will also be reflected in Atlan. To ensure that the sync is successful, the groups that the user belongs to should be mapped in Atlan, and if a group name has changed in SAML 2.0, you will need to update the group name in Atlan as well. For any questions about group mapping sync, head over [here](/product/integrations/identity-management/sso/troubleshooting/troubleshooting-sso).

Enable Snowflake OAuth

Atlan supports [Snowflake OAuth-based authentication](https://docs.snowflake.com/user-guide/oauth-snowflake-overview) for [Snowflake](/apps/connectors/data-ware.

Enable SSO for Amazon Redshift

You will need to [create a client application in Okta](https://help.okta.com/en-us/Content/Topics/Apps/Apps_App_Integration_Wizard_OIDC.htm) to use for [configuring the identity provider in AWS](/apps/connectors/data-warehouses/amazon-redshift/how-tos/enable-sso-for-amazon-redshift).

Enable Okta for SCIM provisioning

You can automate the process of provisioning and deprovisioning your Okta users and groups in Atlan with System for Cross-domain Identity Management (SCIM).

Enrich Atlan through dbt

Beyond the default mapped [dbt Cloud](/apps/connectors/etl-tools/dbt/references/what-does-atlan-crawl-from-dbt-cloud) or [dbt Core](/apps/connectors/etl-tools/dbt/references/what-does-atlan-crawl-from-dbt-core) properties, you can update any of Atlan's metadata attributes (except for `name`, `tenantId`, and `qualifiedName`) through your dbt model's `meta` property.

Enrich Power BI OLS datasets

Learn how to create missing Power BI tables and columns blocked by Object Level Security and generate upstream lineage to your data warehouse using the PBI OLS Dataset Enricher app with BIM files from S3.

Event conventions

Transport, authentication, naming conventions, supported data sources, and lineage behavior for Generic OpenLineage integration with Atlan.

Extract lineage and usage from Databricks

Retrieve lineage from Unity Catalog and usage and popularity metrics from query history or system tables using REST API, offline, or system table extraction methods.

Extract on-premises Databricks lineage

The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks lineage extraction, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.

Find assets by usage

Data teams often lack clarity on which data assets can be considered trustworthy, whether these are frequently used, the freshness of the data itself, or how critical these are for enrichment and governance.

Generate lineage

Enable query logging and configure your ClickHouse instance so the ClickHouse Miner workflow can extract query history and generate lineage.

Generate lineage

Create an ingestion workflow in Atlan to extract Oracle query history and generate lineage for existing Oracle assets.

Generate lineage

Enable pg_stat_statements and configure your PostgreSQL instance so the PostgreSQL Miner workflow can extract query history and generate lineage.

Generate Power BI columns to dataset lineage

Learn how to generate column-to-dataset lineage for Microsoft Power BI by using the PowerBI Columns -> Dataset lineage app with report.json files stored in cloud object storage.

Glean sync

Frequently asked questions about syncing Atlan glossary terms to Glean

How Atlan connects to Hive

Understand how Atlan securely connects to your Hive database to extract metadata, with support for multiple authentication methods and deployment modes.

How Atlan connects to PostgreSQL

Understand how Atlan securely connects to your PostgreSQL database to extract metadata, with support for multiple authentication methods and deployment modes

How Tableau popularity works

How Atlan sources and computes popularity for Tableau Cloud assets, why JWT bearer authentication isn't supported, and how Tableau differs from miner-based connectors.

Implement OpenLineage in Airflow operators

If you're using an Airflow operator supported by OpenLineage, the OpenLineage events will contain input and output details. This means that you do not have to modify your current DAG implementation and Atlan will be able to generate data lineage.

Ingest data quality metadata

Create an ingestion workflow in Atlan to fetch data quality metadata from Bigeye and enrich your existing assets with DQ insights.

Ingest data quality metadata

Create an ingestion workflow in Atlan to fetch data quality metadata from Great Expectations Cloud and enrich your existing assets with data quality insights.

Integrate Amazon MWAA/OpenLineage

To learn more about OpenLineage, refer to [OpenLineage configuration and facets](/product/connections/references/openlineage-configuration-and-facets).

Integrate Anomalo

Once you have [configured the Anomalo settings](/apps/connectors/observability/anomalo/how-tos/set-up-anomalo), you can establish a connection between Atlan and Anomalo.

Integrate Apache Airflow/OpenLineage

To integrate Apache Airflow/OpenLineage with Atlan, complete the following steps. To learn more about OpenLineage, refer to [OpenLineage configuration and facets](/product/connections/references/openlineage-configuration-and-facets).

Integrate Astronomer/OpenLineage

Learn how to integrate Astronomer/OpenLineage with Atlan by configuring the connection, setting environment variables, and verifying connectivity.

Integrate Ataccama with Atlan

Create an ingestion workflow in Atlan to fetch data quality metadata from Ataccama ONE and enrich your existing assets with DQ insights.

Integrate Generic OpenLineage

Atlan extracts job-level operational metadata from applications sending OpenLineage events and generates job lineage through OpenLineage.

Integrate Jira Cloud

You must have at least one issue already created in Jira before integrating it with Atlan. This will enable Atlan to detect whether the Atlan app is installed in your Jira workspace for the integration to work.

Integrate Microsoft Teams

Install and configure the Atlan Assistant (Teams marketplace app) and connect your Atlan tenant to Microsoft Teams.

Integrate with custom app (legacy)

Connect Atlan to Microsoft Teams using the custom app approach. Use this method if you have an existing legacy setup or need specific deployment configurations.

Lineage

Frequently asked questions about Talend lineage in Atlan

Link your Jira account

To create and link Jira issues inside Atlan, you may first need to link your Jira account. This is done automatically for the admin user that [set up the Jira integration](/product/integrations/project-management/jira/how-tos/integrate-jira-cloud), but not for other users.

Link your Slack account

To see previews of Slack messages inside Atlan, you may need to first link your Slack account. This is done automatically for the user that [set up the Slack integration](/product/integrations/collaboration/slack/how-tos/integrate-slack), but not for other users.

Manage Databricks tags

You must have a [Unity Catalog-enabled workspace](https://docs.databricks.com/en/data-governance/unity-catalog/get-started.html) and SQL warehouse configured to import Databricks tags in Atlan.

Manage dbt tags

Atlan imports your [dbt tags](https://docs.getdbt.com/references/resource-configs/tags) and lets you update your dbt assets with the imported tags.

Manage Google BigQuery tags

Atlan imports your [Google BigQuery tags](https://docs.getdbt.com/references/resource-configs/tags) and lets you update your Google BigQuery assets with the imported tags. Note that object tagging in Google BigQuery currently requires [Enterprise edition or higher](https://cloud.google.com/bigquery/docs/editions-intro#editions_features).

Manage requests

If your organization's [Slack account is integrated with Atlan](/product/integrations/collaboration/slack/how-tos/integrate-slack), you will receive Slack notifications when your requests are approved or rejected.

Manage Snowflake tags

You can import your Snowflake tags to Atlan through one-way tag sync. The synced Snowflake tags will be matched to corresponding tags in Atlan through case-insensitive name match and your Snowflake assets will be enriched with their synced tags from Snowflake.

Migrate from dbt to Atlan action

The dbt-action is a custom action designed to perform impact analysis on changes to your dbt models in a [GitHub](/apps/connectors/etl-tools/dbt/how-tos/.

Mine Amazon Redshift

Once you have [crawled assets from Amazon Redshift](/apps/connectors/data-warehouses/amazon-redshift/how-tos/crawl-amazon-redshift), you can mine its query history to construct lineage and retrieve [usage and popularity metrics](/product/capabilities/usage-and-popularity/how-tos/interpret-usage-metrics).

Mine ClickHouse

Once you have [crawled assets from ClickHouse](/apps/connectors/database/clickhouse/how-tos/crawl-clickhouse), you can mine its query history to construct lineage.

Mine Google BigQuery

Once you have [crawled assets from Google BigQuery](/apps/connectors/data-warehouses/google-bigquery/how-tos/crawl-google-bigquery), you can mine its query history to construct lineage.

Mine Microsoft Power BI

Once you have crawled assets from Microsoft Power BI, you can mine its activity events to generate usage metrics.

Mine PostgreSQL

Once you have [crawled assets from PostgreSQL](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can mine its query history to construct lineage.

Mine query history

Mine query history from Microsoft SQL Server to construct lineage relationships between your database assets.

Mine Snowflake

Once you have [crawled assets from Snowflake](/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake), you can mine its query history to construct lineage.

Mine Teradata

Once you have [crawled assets from Teradata](/apps/connectors/database/teradata/how-tos/crawl-teradata), you can mine its query history to construct lineage.

Modify workflow settings

Once you've scheduled or run a workflow you can modify its configuration at any time. The configuration that can be modified may vary by workflow but the general steps remain consistent.

Order workflows

The [order of operations](/product/connections/how-tos/order-workflows#order-of-operations) you run in Atlan is important. Follow the specific workflow sequence outlined below when crawling [data tools](/product/connections/references/supported-sources). The right order particularly ensures that lineage is constructed without needing to rerun crawlers.

Permissions for Databricks AI models

Full reference of the privileges required to crawl AI models and extract lineage from Databricks Unity Catalog, including what each privilege enables and how to grant it.

Permissions for Snowflake AI models

Full reference of the privileges required to crawl AI models and extract lineage from the Snowflake Model Registry, including what each privilege enables and why it's needed.

PostgreSQL

Integrate, catalog, and govern PostgreSQL assets in Atlan

Preflight checks for Aiven Kafka

Before [running the Aiven Kafka crawler](/apps/connectors/messaging/aiven-kafka/how-tos/crawl-aiven-kafka), you can run [preflight checks](/product/conne.

Preflight checks for Amazon MSK

Before [running the Amazon MSK crawler](/apps/connectors/messaging/amazon-msk/how-tos/crawl-amazon-msk), you can run [preflight checks](/product/connecti.

Preflight checks for Amazon QuickSight

The [ListAnalyses](https://docs.aws.amazon.com/quicksight/latest/APIReference/API_ListAnalyses.html) REST API is used to fetch the actual list of analyses for which the user has view permission.

Preflight checks for Amazon Redshift

Before [running the Amazon Redshift crawler](/apps/connectors/data-warehouses/amazon-redshift/how-tos/crawl-amazon-redshift), you can run [preflight chec.

Preflight checks for Anaplan

The Anaplan REST API is used to fetch the actual list of workspaces, and apps for which the user has view permission.

Preflight checks for Anomalo

This check tests for the validity of the [host name URL and API key](/apps/connectors/observability/anomalo/how-tos/integrate-anomalo) you provided. If Atlan is unable to connect to your Anomalo instance, this may indicate that your credentials are either incorrect or invalid.

Preflight checks for Apache Kafka

Before [running the Apache Kafka crawler](/apps/connectors/messaging/apache-kafka/how-tos/crawl-apache-kafka), run [preflight checks](/product/connection.

Preflight checks for Bigeye

This check tests for the validity of the [host name URL and API key](/apps/connectors/observability/bigeye/how-tos/ingest-bigeye-data) you provided. If Atlan is unable to connect to your Bigeye instance, this may indicate that your credentials are either incorrect or invalid.

Preflight checks for Databricks

Before [running the Databricks crawler](/apps/connectors/data-warehouses/databricks/how-tos/crawl-databricks), you can run [preflight checks](/product/co.

Preflight checks for Domo

Atlan uses the [DataSet API](https://developer.domo.com/portal/72ae9b3e80374-list-data-sets) to fetch dataset metadata from Domo.

Preflight checks for Google BigQuery

Each request requires an OAuth 2.0 access token generated via the [service account key](https://cloud.google.com/docs/authentication#service-accounts).

Preflight checks for Hive

Before [running the Hive crawler](/apps/connectors/database/hive/how-tos/crawl-hive), you can run [preflight checks](/product/connections/concepts/what-a.

Preflight checks for Looker

First, the list of projects in the _Include Projects_ and _Exclude Projects_ fields is determined. Next, the [Query Projects](https://developers.looker.com/api/explorer/3.1/methods/Project#get_all_projects) REST API is used to fetch the actual list of projects for which the user has [view capability](https://cloud.google.com/looker/docs/access-control-and-permission-management).

Preflight checks for Metabase

Before [running the Metabase crawler](/apps/connectors/business-intelligence/metabase/how-tos/crawl-metabase), you can run [preflight checks](/product/co.

Preflight checks for Microsoft Azure Synapse Analytics

This check is performed for both [basic](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics) and [service principal](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics) authentication method.

Preflight checks for MicroStrategy

First, the list of projects in the _Include Projects_ and _Exclude Projects_ fields is determined. Next, the [Get Projects REST API](https://demo.microstrategy.com/MicroStrategyLibrary/api-docs/index.html#/Projects/getProjects_1) is used to fetch the actual list of projects for which the user has permissions.

Preflight checks for Mode

Before [running the Mode crawler](/apps/connectors/business-intelligence/mode/how-tos/crawl-mode), you can run [preflight checks](/product/connections/co.

Preflight checks for MongoDB Atlas

Before running the MongoDB Atlas crawler, you can run preflight checks to verify the connected user has the required MongoDB privileges for metadata extraction.

Preflight checks for Monte Carlo

Before [running the Monte Carlo crawler](/apps/connectors/observability/monte-carlo/how-tos/crawl-monte-carlo), you can run [preflight checks](/product/c.

Preflight checks for MySQL

Before [running the MySQL crawler](/apps/connectors/database/mysql/how-tos/crawl-mysql), you can run [preflight checks](/product/connections/concepts/wha.

Preflight checks for Oracle

Before [running the Oracle crawler](/apps/connectors/database/oracle/how-tos/crawl-oracle), you can run [preflight checks](/product/connections/concepts/.

Preflight checks for PostgreSQL

Before [running the PostgreSQL crawler](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can run [preflight checks](/product/connectio.

Preflight checks for PrestoSQL

Before [running the PrestoSQL crawler](/apps/connectors/database/prestosql/how-tos/crawl-prestosql), you can run [preflight checks](/product/connections/.

Preflight checks for Redash

Before [running the Redash crawler](/apps/connectors/business-intelligence/redash/how-tos/crawl-redash), you can run [preflight checks](/product/connecti.

Preflight checks for Redpanda Kafka

Before [running the Redpanda Kafka crawler](/apps/connectors/messaging/redpanda-kafka/how-tos/crawl-redpanda-kafka), you can run [preflight checks](/prod.

Preflight checks for Salesforce

Before [running the Salesforce crawler](/apps/connectors/crm/salesforce/how-tos/crawl-salesforce), you can run [preflight checks](/product/connections/co.

Preflight checks for Sigma

First, the list of workbooks in the _Include Workbooks_ and _Exclude Workbooks_ fields is determined. Next, the [List Workbooks](https://help.sigmacomputing.com/hc/en-us/articles/4408555666323) REST API is used to fetch the actual list of workbooks for which the user credentials have view permission.

Preflight checks for Sisense

Atlan uses the [Folders API](https://sisense.dev/guides/restApi/v1/?platform=linux&spec=L2023.6#/folders) to check if it's responding with a response status code 200.

Preflight checks for Snowflake

Before [running the Snowflake crawler](/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake), you can run [preflight checks](/product/conne.

Preflight checks for Tableau

The [Server Info](https://help.tableau.com/current/api/rest_api/en-us/REST/rest_api_ref_server.htm#server_info) REST API is used to fetch the `restApiVersion` value.

Preflight checks for Teradata

Before [running the Teradata crawler](/apps/connectors/database/teradata/how-tos/crawl-teradata), you can run [preflight checks](/product/connections/con.

Preflight checks for Trino

Before [running the Trino crawler](/apps/connectors/database/trino/how-tos/crawl-trino), you can run [preflight checks](/product/connections/concepts/wha.

PrivateLink connectivity

Understand how AWS PrivateLink ensures all metadata traffic between Atlan and AWS SageMaker Unified Studio stays within the AWS private network.

Provide SSL certificates

SSL (Secure Sockets Layer) encryption helps establish a secure connection between your data source and Atlan. Atlan currently supports SSL certificates for [crawling Tableau](/apps/connectors/business-intelligence/tableau/how-tos/crawl-tableau) and [crawling Matillion](/apps/connectors/etl-tools/matillion/how-tos/crawl-matillion).

Report on automations

You can track asset enrichment through [suggestions from similar assets](/product/integrations/automation/always-on/references/suggestions-from-similar-assets). You can also view top users who have accepted automated suggestions.

Routines and Process assets

Frequently asked questions about BigQuery routines and their relationships with Process assets for lineage generation

S3 Inventory Report Structure

Expected folder structure and format for S3 inventory reports used by Atlan's S3 crawler for inventory-based ingestion.

SDR connectivity

Understand how Self-Deployed Runtime connects to Atlan Cloud and your data sources

Semantic offerings by connector

Discover semantic assets by connector — view semantic models, datasets, metric views, and business-friendly definitions cataloged from each tool.

Set default user roles for SSO

:::warning Who can do this? You will need to be an admin user and [configure SSO](/product/integrations/identity-management/sso) with a provider first.

Set up Aiven Kafka

Atlan supports the [S3 extraction method](/apps/connectors/messaging/on-premises-event-buses/how-tos/set-up-on-premises-kafka-access) for fetching metadata from Aiven Kafka. This method uses Atlan's kafka-extractor tool to fetch metadata.

Set up Alteryx

Set up real-time integration between Alteryx and Atlan using OpenLineage to automatically catalog assets and create lineage when workflows run.

Set up ALTR

Prepare your ALTR environment and generate API credentials for Atlan integration.

Set up Amazon Redshift

Grant permissions and configure authentication for Atlan to connect to and crawl metadata from Amazon Redshift.

Set up Amazon S3

Create AWS IAM permissions and credentials for Atlan to access and catalog your S3 buckets and objects.

Set up Anaplan

Configure Basic or CA Certificate authentication to connect Anaplan to Atlan.

Set up Anomalo

Atlan supports the API authentication method for fetching metadata from [Anomalo](https://docs.anomalo.com/integrations/atlan-integration). This method uses an API key to fetch metadata.

Set up Apache Kafka

Configure authentication and permissions on Apache Kafka so Atlan can access your cluster metadata.

Set up Ataccama

Configure authentication credentials in Ataccama ONE to enable Atlan to fetch data quality metadata from your Ataccama instance.

Set up Bigeye

Map Atlan connections to Bigeye sources and configure authentication credentials to enable Atlan to fetch data quality metadata from your Bigeye instance.

Set up BigID

Create a BigID system user and API token for Atlan integration.

Set up ClickHouse

Configure a dedicated ClickHouse user with read-only access so Atlan can connect and extract metadata.

Set up CrateDB

Configure authentication and connection settings for CrateDB connector

Set up Cyera

Create a Cyera API token and obtain credentials for Atlan integration.

Set up Dagster

Configure Dagster integration with Atlan to enable asset and lineage capture from your Dagster assets

Set up dbt Cloud

Configure authentication tokens in dbt Cloud to enable Atlan to fetch and enrich your assets with dbt metadata.

Set up Domo

:::warning Who can do this? You'll need your Domo administrator to complete these steps - you may not have access yourself.

Set up Dremio

Configure Dremio connection and authentication for Atlan integration.

Set up Google BigQuery

You must be a Google BigQuery administrator to run these commands. For more information, see [Google Cloud's Granting, changing, and revoking access to resources](https://cloud.google.com/iam/docs/granting-changing-revoking-access).

Set up Google Cloud Knowledge Catalog

Configure Google Cloud Knowledge Catalog connection and authentication by creating a service account with required permissions, or using Workload Identity Federation.

Set up Hightouch

Configure Hightouch roles, groups, and API keys to connect with Atlan.

Set up IBM Cognos Analytics

:::warning Who can do this? You must be an IBM Cognos Analytics administrator to complete these steps - you may not have access yourself.

Set up Iceberg

Configure Generic REST Catalog and BigLake Metastore authentication for Iceberg integration in Atlan.

Set up Informatica CDI

Configure authentication and user permissions for Informatica Cloud Data Integration connector

Set up Matillion

Configure user authentication and permissions in Matillion to enable Atlan to crawl metadata from your Matillion instance.

Set up Microsoft SSRS

Configure authentication and permissions in SSRS to enable Atlan to crawl metadata from your Report Server.

Set up MicroStrategy

Atlan supports basic authentication and API token authentication methods for fetching metadata from MicroStrategy.

Set up Mode

If you do not see the prompts to enter details for the user above, you are probably already signed in to Mode. Sign out of Mode first, and then accept the invite in the service account email.

Set up MongoDB (self-managed)

Atlan supports SCRAM authentication (SCRAM-SHA-1 and SCRAM-SHA-256) for fetching metadata from MongoDB. This method uses a [username and password](#create-database-user) to fetch metadata.

Set up MongoDB Atlas

Atlan supports the basic authentication method for fetching metadata from MongoDB. This method uses a username and password to fetch metadata

Set up Monte Carlo

:::warning Who can do this? You will probably need your Monte Carlo [account owner](https://docs.getmontecarlo.com/docs/authorizationmanaged-roles-and-groups).

Set up NetSuite

Configure token-based authentication to connect NetSuite to Atlan.

Set up on-premises Databricks lineage extraction

The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks lineage extraction, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.

Set up on-premises Microsoft Azure Synapse Analytics miner access

In some cases you will not be able to expose your Microsoft Azure Synapse Analytics instance for Atlan to [mine query history from the Query Store](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics). For example, this may happen when security requirements restrict access to sensitive, mission-critical data.

Set up on-premises Teradata miner access

In some cases you will not be able to expose your Teradata instance for Atlan to mine query history. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.

Set up Oracle

Configure Oracle user and permissions to enable Atlan to extract metadata from your Oracle database.

Set up Qualytics

Configure API access in Atlan and Qualytics to enable secure authentication and data quality metadata synchronization between your Qualytics instance and Atlan.

Set up Redpanda Kafka

Atlan supports the [S3 extraction method](/apps/connectors/messaging/on-premises-event-buses/how-tos/set-up-on-premises-kafka-access) for fetching metadata from Redpanda Kafka. This method uses Atlan's kafka-extractor tool to fetch metadata.

Set up SageMaker

Configure AWS credentials and permissions to connect Atlan to your SageMaker environment.

Set up Salesforce

Configure Salesforce authentication and connection with Atlan. Set up OAuth or JWT Bearer flow for secure integration with Sales Cloud and Financial Services Cloud.

Set up Sisense

Atlan supports the basic authentication method for fetching metadata from Sisense. This method uses a username and password to fetch metadata.

Set up Snowflake

:::warning Who can do this? You need your Snowflake administrator to run these commands - you may not have access yourself. :::.

Set up Starburst Enterprise

Configure authentication and permissions for Starburst Enterprise to enable Atlan to crawl metadata from your instance.

Set up Talend

Configure GitHub or Stash access tokens for the Talend connector

Set up Teradata

:::warning Who can do this? You need your Teradata administrator to run these commands - you may not have access yourself.

Set up ThoughtSpot

:::warning Who can do this? You will probably need your ThoughtSpot instance administrator to complete these steps - you may not have access yourself.

Set up Trino

Configure authentication and permissions for Trino to enable Atlan to crawl metadata from your database.

Supported sources

Connect to data sources — out-of-the-box connectors or custom integrations using App Framework and Open APIs.

Talend

Integrate, catalog, and govern Talend assets in Atlan.

Task and crawl issues

Troubleshoot Informatica CDI task processing and crawling issues with error, cause, and solution guidance.

Transformations

Understand how Informatica Cloud Data Integration transformation logic and business rules are discovered and cataloged in Atlan

Troubleshooting Hive connectivity

Resolve common Hive connection issues including authentication failures, Kerberos errors, TLS/MTLS certificate problems, and network connectivity issues.

Update column metadata in Google Sheets

Once you've [connected Atlan with Google Sheets](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-google-sheets), you can import the column metadata for all your data assets in Atlan and make changes to them directly in Google Sheets.

Update column metadata in Microsoft Excel

Once you've [connected Atlan with Microsoft Excel](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-microsoft-excel), you can import the column metadata for all your data assets in Atlan and make changes to them directly in Microsoft Excel.

View event logs

Event logs help you track and debug events received from supported connectors, providing you with greater observability in Atlan. Event logs are currently stored in Atlan for 7 days.

What Atlan crawls from Talend

During a Talend crawl, Atlan extracts metadata for Projects, Jobs, Reusable Units, Datasets, Fields, and Dataset Operations. Reference tables map each Talend property to its Atlan asset.

What does Atlan crawl from Anomalo?

Once you have [integrated Anomalo](/apps/connectors/observability/anomalo/how-tos/integrate-anomalo), Atlan will receive webhook events when checks are executed in Anomalo. These checks will be cataloged in Atlan to create a relationship with existing assets using the association information from the check.

What does Atlan crawl from Apache Kafka?

During an Apache Kafka crawl, Atlan extracts metadata for Clusters, Topics, Consumer Groups, Schema Subjects, Schema Versions, and Schema Fields. Reference tables map each Kafka property to its Atlan asset.

What does Atlan crawl from Astronomer/OpenLineage?

Atlan maps the following assets and properties from Astronomer/OpenLineage. Asset lineage support depends on the [list of operators supported by OpenLineage](https://airflow.apache.org/docs/apache-airflow-providers-openlineage/1.6.0/supported_classes.html).

What does Atlan crawl from ClickHouse?

During a ClickHouse crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Columns. Reference tables map each ClickHouse property to its Atlan asset.

What does Atlan crawl from Confluent Kafka?

During a Confluent Kafka crawl, Atlan extracts metadata for Clusters, Topics, Consumer Groups, Schema Subjects, Schema Versions, and Schema Fields. Reference tables map each Confluent Kafka property to its Atlan asset.

What does Atlan crawl from Fivetran?

During a Fivetran crawl, Atlan creates lineage between source and destination data assets and extracts metadata for Fivetran Connectors. Reference tables map each Fivetran Connector property to its Atlan asset.

What does Atlan crawl from Google BigQuery?

Atlan doesn't run any table scans. Atlan leverages the table preview options from [Google BigQuery](https://cloud.google.com/bigquery/docs/best-practices-costs#preview-data) that enable you to view data for free and without affecting any quotas using the `tabledata.list` API. Hence, [table](/apps/connectors/data-warehouses/google-bigquery/references/what-does-atlan-crawl-from-google-bigquery#tables) asset previews in Atlan are already cost-optimized. However, this doesn't apply to [views](/apps/connectors/data-warehouses/google-bigquery/references/what-does-atlan-crawl-from-google-bigquery#views) and [materialized views](/apps/connectors/data-warehouses/google-bigquery/references/what-does-atlan-crawl-from-google-bigquery#materialized-views).

What does Atlan crawl from Google Cloud Composer/OpenLineage?

Atlan maps the following assets and properties from Google Cloud Composer/OpenLineage. Asset lineage support depends on the [list of operators supported by OpenLineage](https://airflow.apache.org/docs/apache-airflow-providers-openlineage/1.6.0/supported_classes.html).

What does Atlan crawl from Informatica CDI

During an Informatica Cloud Data Integration crawl, Atlan extracts metadata for Projects, Folders, Mapping Tasks, Mappings, Transformations, and Transformation Fields. Reference tables map each Informatica CDI property to its Atlan asset.

What does Atlan crawl from Metabase?

During a Metabase crawl, Atlan extracts metadata for Collections, Dashboards, and Questions. Reference tables map each Metabase property to its Atlan asset.

What does Atlan crawl from Monte Carlo?

What does Atlan crawl from Monte Carlo? <Badge variant="preview" text="Private Preview" link="/get-started/references/product-release-stages#private-preview" />

What does Atlan crawl from MySQL?

During a MySQL crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Stored Procedures. Reference tables map each MySQL property to its Atlan asset.

What does Atlan crawl from PostgreSQL?

During a PostgreSQL crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Functions. Reference tables map each PostgreSQL property to its Atlan asset.

What does Atlan crawl from Sisense?

During a Sisense crawl, Atlan extracts metadata for Dashboards, Widgets, Data Models, Data Model Tables, and Folders. Reference tables map each Sisense property to its Atlan asset.

What does Atlan crawl from Snowflake?

During a Snowflake crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Procedures. Reference tables map each Snowflake property to its Atlan asset.

What does Atlan crawl from Soda?

Atlan crawls datasets and then filters out all the datasets without any checks. It then crawls the checks associated with each of the datasets with checks from Soda. These checks are cataloged in Atlan to create a relationship with existing assets using the association information from the dataset.

What does Atlan crawl from Tableau?

During a Tableau crawl, Atlan extracts metadata for Projects, Workbooks, Worksheets, Dashboards, Datasources, and Flows. Reference tables map each Tableau property to its Atlan asset.

What lineage does Atlan extract from Matillion?

Atlan uses Matillion's metadata API to generate lineage associated with [Matillion connectors](https://www.matillion.com/connectors). This is particularly useful for creating lineage between different tools.

What lineage does Atlan extract from Microsoft Power BI?

This document helps you understand how Atlan generates lineage to upstream SQL sources for your Microsoft Power BI assets using a custom query parser, and the steps you can take while developing reports and dashboards in Microsoft Power BI to create seamless lineage generation.

Workflow

Monitor workflow execution and asset creation — track lineage coverage, connection metadata, and extraction progress.