You can add descriptions to your assets in Atlan, including tables, views, and individual columns. You can even add a description in the form of a [README](/product/integrations). Doing so enriches your data asset with the relevant contextual information.
:::warning Who can do this? You must be an admin user in Atlan to create options for custom metadata properties.
Create profiling playbooks to scan data assets at scale, identify data quality issues, and improve asset quality. Setup requires admin user permissions in Atlan.
A number of Atlan's [supported connectors](/product/connections/references/connectors-and-capabilities) use a JDBC- or REST API-based approach for metadata extraction. If you are attempting to connect to a source with no native integration, [contact Atlan support](/support/submit-request) to share more details about your use case.
Atlan recommends that you turn off sample data preview at a connection level. For example, you can configure the [Snowflake crawler](/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake) to prevent users from previewing any Snowflake data.
Extract metadata from Aiven Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring permissions.
Extract metadata from your AlloyDB for PostgreSQL database and establish a connection between Atlan and your database
To crawl metadata from Amazon Athena, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.
Extract metadata from Amazon DynamoDB to catalog tables, items, and attributes. Extract asset information and column-level details after configuring AWS permissions.
To crawl metadata from Amazon MSK, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.
Extract metadata from Amazon QuickSight to catalog dashboards, analyses, and datasets. Discover and govern your BI assets after configuring permissions.
Once you have configured the [Amazon Redshift access permissions](/apps/connectors/data-warehouses/amazon-redshift/how-tos/set-up-amazon-redshift), you can establish a connection between Atlan and Amazon Redshift.
Crawl metadata from Anaplan to catalog workspaces, models, dimensions, and planning modules. Extract model structure and planning asset information after configuring user access.
Crawl metadata from Apache Kafka to catalog topics, consumer groups, and clusters. Extract schema information from Confluent Schema Registry after configuring cluster permissions.
Crawl metadata from AWS Glue Data Catalog to catalog jobs, workflows, tables, and data transformations. Extract lineage information after configuring AWS access permissions.
Configure and run the SMUS Catalog crawler to extract assets, metadata, and lineage from SMUS and catalog and enrich them in Atlan.
Configure and run the Atlan BigID workflow to crawl metadata from BigID.
Create a ClickHouse crawler workflow in Atlan to extract metadata from your database.
Extract metadata from your Cloud SQL for PostgreSQL database and establish a connection between Atlan and your database
Learn about crawl confluent kafka.
Configure and run the standalone Confluent Schema Registry crawler in Atlan.
Configure and run the CrateDB crawler to extract metadata from your database
Crawl classification metadata from Cyera to enrich assets with data sensitivity and privacy information. Extract data sensitivity classifications and security issues.
Crawl metadata from Databricks to catalog tables, schemas, views, and volumes. Extract lineage and column information after configuring access permissions and authentication.
Discover and catalog AI models registered in the Databricks Unity Catalog Model Registry using Atlan's Databricks connector.
Extract metadata from DataStax Enterprise to catalog databases, tables, columns, and keyspaces. Discover and govern your NoSQL data assets after configuring user permissions.
Configure and run the crawler to extract metadata from your dbt Cloud or dbt Core projects.
Extract metadata from Domo to catalog dashboards, datasets, cards, and pages. Discover and govern your BI assets after configuring permissions.
Crawl metadata from Dremio to catalog physical datasets, virtual datasets, folders, and spaces. Extract lineage and asset information from your data lakehouse.
Enrich Atlan with Fivetran metadata to track data pipeline lineage and transformations. Configure the Fivetran Platform Connector and connect a supported data warehouse destination.
Configure and run the GCS crawler to catalog your GCP GCS buckets and objects in Atlan.
Crawl metadata from Google BigQuery to catalog datasets, tables, views, and columns. Extract lineage and asset details after completing prerequisite setup.
Configure and run the crawler to extract metadata from Google Cloud Knowledge Catalog.
Crawl metadata from Hightouch to catalog models and syncs. Extract reverse ETL lineage between data warehouse sources and operational business tools after configuring API credentials.
Extract metadata from Hive to catalog databases, tables, views, and columns. Extract lineage and asset information after configuring user permissions.
Extract metadata from IBM Cognos Analytics to catalog reports, queries, and dashboards. Discover and govern your BI assets after configuring user permissions.
Crawl metadata from Iceberg to catalog tables, namespaces, and columns. Extract table metadata and lineage from your Iceberg data lakehouse catalogs.
Crawl metadata from Informatica Cloud Data Integration to catalog projects, workflows, tasks, and mappings. Extract data transformation lineage after configuring cloud access.
Once you have configured the [Looker user permissions](/apps/connectors/business-intelligence/looker/how-tos/set-up-looker), you can establish a connection between Atlan and Looker.
Crawl metadata from Matillion to catalog jobs, tasks, pipelines, and transformations. Extract lineage information after configuring user permissions and connectivity.
Once you have [configured the Metabase user permissions](/apps/connectors/business-intelligence/metabase/how-tos/set-up-metabase), you can establish a connection between Atlan and Metabase.
Extract metadata from Microsoft Azure Cosmos DB to catalog databases, containers, and documents. Discover and govern your NoSQL data assets after configuring permissions.
Once you have [configured the Microsoft Azure Data Factory permissions](/apps/connectors/etl-tools/microsoft-azure-data-factory/how-tos/set-up-microsoft-.
Extract metadata from Microsoft Azure Event Hubs to catalog topics, partitions, and consumer groups. Discover and govern your messaging infrastructure after configuring permissions.
Extract metadata from Microsoft Azure Synapse Analytics to catalog databases, schemas, tables, and views. Discover and govern your cloud data warehouse assets after configuring permissions.
Crawl metadata from Microsoft Fabric to catalog workspaces, reports, dashboards, and datasets. Extract lineage and analytics information from your Fabric environment.
Once you have configured the [Microsoft Power BI user permissions](/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi), you can establish a connection between Atlan and Microsoft Power BI.
Crawl metadata from Microsoft SQL Server to catalog databases, schemas, tables, and views. Extract column details and enable data discovery, lineage tracking, and governance after configuring user permissions.
Crawl metadata from SQL Server Reporting Services (SSRS) to catalog reports, datasets, and data sources. Extract report definitions, lineage, and data model information.
Extract metadata from MicroStrategy to catalog reports, dashboards, and metrics. Discover and govern your BI assets after configuring authentication.
Once you have [configured the Mode user permissions](/apps/connectors/business-intelligence/mode/how-tos/set-up-mode), you can establish a connection between Atlan and Mode.
Once you have [configured the MongoDB permissions](/apps/connectors/database/mongodb/onprem/how-tos/set-up-mongodb-onprem), you can establish a connection between Atlan and MongoDB.
Configure MongoDB Atlas connection and run the crawler to extract metadata from MongoDB into Atlan.
Once you have [configured the Monte Carlo permissions](/apps/connectors/observability/monte-carlo/how-tos/set-up-monte-carlo), you can establish a connection between Atlan and Monte Carlo.
To crawl metadata from MySQL, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.
Crawl metadata from NetSuite to catalog record types, record fields, and business processes. Extract enterprise data structure after configuring access credentials.
Extract metadata from on-premises databases to catalog tables, schemas, and views. Discover and govern your database assets after configuring the metadata-extractor tool.
The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks environments, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.
Extract metadata from on-premises IBM Cognos Analytics to catalog reports, queries, and dashboards. Discover and govern your BI assets after configuring extractor tool.
Extract metadata from on-premises Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring extractor tool.
Extract metadata from on-premises Looker to catalog dashboards, looks, explores, and data sources. Discover and govern your BI assets after configuring extractor tool.
Extract metadata from on-premises Tableau to catalog workbooks, dashboards, and sheets. Discover and govern your BI assets after configuring extractor tool.
Extract metadata from on-premises ThoughtSpot to catalog pinboards, answers, and liveboards. Discover and govern your BI assets after configuring extractor tool.
Crawl metadata from Oracle Database to catalog schemas, tables, views, and columns. Extract lineage and asset information after configuring user permissions and database connectivity.
Configure and run PostgreSQL metadata extraction workflows to catalog databases, schemas, tables, views, and columns in Atlan.
Once you have configured the [PrestoSQL user permissions](/apps/connectors/database/prestosql/how-tos/set-up-prestosql), you can establish a connection between Atlan and PrestoSQL.
Extract metadata from Qlik Sense Cloud to catalog applications, sheets, and visualizations. Discover and govern your BI assets after configuring permissions.
Extract metadata from Qlik Sense Enterprise on Windows to catalog applications, sheets, and visualizations. Discover and govern your BI assets after configuring permissions.
Crawl metadata from Qualytics to capture data quality checks, anomalies, and scores. Enrich your assets with comprehensive quality insights from quality rules and validations.
Once you have [configured the Redash permissions](/apps/connectors/business-intelligence/redash/how-tos/set-up-redash), you can establish a connection between Atlan and Redash.
Extract metadata from Redpanda Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring permissions.
Configure and run the S3 crawler to catalog your Amazon S3 buckets and objects in Atlan.
Crawl lineage from AWS SageMaker to catalog machine learning pipelines, jobs, models, and datasets. Extract ML workflow lineage after configuring AWS credentials.
Extract metadata from Salesforce to catalog objects, fields, and relationships. Discover and govern your CRM data assets after configuring user permissions.
Extract and catalog metadata from your SAP BW/4HANA system in Atlan.
Configure and run the crawler to extract metadata from SAP Datasphere spaces, views, analytical models, and columns into Atlan.
Extract and catalog metadata from your SAP ECC system including tables, fields, and modules in Atlan.
Extract metadata from SAP HANA to catalog databases, schemas, tables, views, and columns. Discover and govern your enterprise data assets after configuring user permissions.
Extract and catalog metadata from your SAP S/4HANA system including tables, fields, CDS views, and modules in Atlan.
Once you have [configured the Sigma permissions](/apps/connectors/business-intelligence/sigma/how-tos/set-up-sigma), you can establish a connection between Atlan and Sigma.
Extract metadata from Sisense to catalog dashboards, widgets, and datasets. Discover and govern your BI assets after configuring permissions.
To crawl metadata from Snowflake, review the [order of operations](/product/connections/how-tos/order-workflows) and then complete the following steps.
Discover, catalog, and build lineage for AI models registered in the Snowflake Model Registry using Atlan's Snowflake connector.
Once you have [configured the Soda permissions](/apps/connectors/observability/soda/how-tos/set-up-soda), you can establish a connection between Atlan and Soda.
Crawl metadata from SSIS project files to catalog projects, packages, tasks, and components. Extract transformation lineage from SSIS packages stored in Azure Blob Storage.
Crawl metadata from Starburst Enterprise to catalog catalogs, schemas, tables, and data products. Extract domain definitions and lineage information after configuring user permissions.
Crawl metadata from Tableau to catalog workbooks, dashboards, sheets, and data sources. Extract lineage and usage information after configuring user permissions.
Crawl metadata from Talend to catalog jobs, components, and transformations. Extract transformation lineage from project files in GitHub or Atlassian Stash repositories.
Extract metadata from Teradata to catalog databases, tables, views, and columns. Extract query lineage and asset information after configuring user permissions.
Extract metadata from ThoughtSpot to catalog pinboards, answers, and liveboards. Discover and govern your BI assets after configuring permissions.
Crawl metadata from Trino to catalog schemas, tables, views, and columns. Extract distributed query lineage and asset information after configuring user permissions.
:::warning Who can do this? You will need to be an admin user in Atlan to configure these options.
Atlan displays upstream as well as downstream lineage for [Tableau dashboards](/apps/connectors/business-intelligence/tableau/references/what-does-atlan-crawl-f.
Beyond the default mapped [dbt Cloud](/apps/connectors/etl-tools/dbt/references/what-does-atlan-crawl-from-dbt-cloud) or [dbt Core](/apps/connectors/etl-tools/dbt/references/what-does-atlan-crawl-from-dbt-core) properties, you can update any of Atlan's metadata attributes (except for `name`, `tenantId`, and `qualifiedName`) through your dbt model's `meta` property.
Retrieve lineage from Unity Catalog and usage and popularity metrics from query history or system tables using REST API, offline, or system table extraction methods.
How to configure permissions for future tables created by any user in Cloud SQL for PostgreSQL
You must have a [Unity Catalog-enabled workspace](https://docs.databricks.com/en/data-governance/unity-catalog/get-started.html) and SQL warehouse configured to import Databricks tags in Atlan.
Atlan imports your [dbt tags](https://docs.getdbt.com/references/resource-configs/tags) and lets you update your dbt assets with the imported tags.
Atlan imports your [Google BigQuery tags](https://docs.getdbt.com/references/resource-configs/tags) and lets you update your Google BigQuery assets with the imported tags. Note that object tagging in Google BigQuery currently requires [Enterprise edition or higher](https://cloud.google.com/bigquery/docs/editions-intro#editions_features).
You can import your Snowflake tags to Atlan through one-way tag sync. The synced Snowflake tags will be matched to corresponding tags in Atlan through case-insensitive name match and your Snowflake assets will be enriched with their synced tags from Snowflake.
Once you have [crawled assets from Amazon Redshift](/apps/connectors/data-warehouses/amazon-redshift/how-tos/crawl-amazon-redshift), you can mine its query history to construct lineage and retrieve [usage and popularity metrics](/product/capabilities/usage-and-popularity/how-tos/interpret-usage-metrics).
Once you have [crawled assets from ClickHouse](/apps/connectors/database/clickhouse/how-tos/crawl-clickhouse), you can mine its query history to construct lineage.
Once you have [crawled assets from Google BigQuery](/apps/connectors/data-warehouses/google-bigquery/how-tos/crawl-google-bigquery), you can mine its query history to construct lineage.
Learn about mine microsoft azure synapse analytics.
Once you have crawled assets from Microsoft Power BI, you can mine its activity events to generate usage metrics.
Once you have [crawled assets from PostgreSQL](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can mine its query history to construct lineage.
Once you have crawled assets from a supported connector, you can mine query history.
Once you have [crawled assets from Snowflake](/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake), you can mine its query history to construct lineage.
Once you have [crawled assets from Teradata](/apps/connectors/database/teradata/how-tos/crawl-teradata), you can mine its query history to construct lineage.
The [order of operations](/product/connections/how-tos/order-workflows#order-of-operations) you run in Atlan is important. Follow the specific workflow sequence outlined below when crawling [data tools](/product/connections/references/supported-sources). The right order particularly ensures that lineage is constructed without needing to rerun crawlers.
Before [running the Aiven Kafka crawler](/apps/connectors/messaging/aiven-kafka/how-tos/crawl-aiven-kafka), you can run [preflight checks](/product/conne.
Verify prerequisites before setting up the AlloyDB for PostgreSQL connector
Before [running the Amazon MSK crawler](/apps/connectors/messaging/amazon-msk/how-tos/crawl-amazon-msk), you can run [preflight checks](/product/connecti.
The [ListAnalyses](https://docs.aws.amazon.com/quicksight/latest/APIReference/API_ListAnalyses.html) REST API is used to fetch the actual list of analyses for which the user has view permission.
Before [running the Amazon Redshift crawler](/apps/connectors/data-warehouses/amazon-redshift/how-tos/crawl-amazon-redshift), you can run [preflight chec.
Before crawling Amazon SageMaker Unified Studio, you can run preflight checks to perform the necessary technical validations.
The Anaplan REST API is used to fetch the actual list of workspaces, and apps for which the user has view permission.
Before [running the Apache Kafka crawler](/apps/connectors/messaging/apache-kafka/how-tos/crawl-apache-kafka), run [preflight checks](/product/connection.
Before running the AWS Glue crawler, you can run preflight checks to validate credentials and IAM permissions.
Before running the ClickHouse crawler, you can run preflight checks to perform the necessary technical validations.
Verify prerequisites before setting up the Cloud SQL for PostgreSQL connector
Before running the Confluent Kafka crawler, run preflight checks to perform necessary technical validations.
Before [running the Confluent Schema Registry crawler](/apps/connectors/schema/confluent-schema-registry/how-tos/crawl-confluent-schema-registry), you ca.
Before [running the Databricks crawler](/apps/connectors/data-warehouses/databricks/how-tos/crawl-databricks), you can run [preflight checks](/product/co.
Preflight checks for DataStax Enterprise
This checks if manifest files are present in the provided bucket and prefix.
Atlan uses the [DataSet API](https://developer.domo.com/portal/72ae9b3e80374-list-data-sets) to fetch dataset metadata from Domo.
Learn about preflight checks for fivetran.
Each request requires an OAuth 2.0 access token generated via the [service account key](https://cloud.google.com/docs/authentication#service-accounts).
Before [running the Hive crawler](/apps/connectors/database/hive/how-tos/crawl-hive), you can run [preflight checks](/product/connections/concepts/what-a.
First, the list of projects in the _Include Projects_ and _Exclude Projects_ fields is determined. Next, the [Query Projects](https://developers.looker.com/api/explorer/3.1/methods/Project#get_all_projects) REST API is used to fetch the actual list of projects for which the user has [view capability](https://cloud.google.com/looker/docs/access-control-and-permission-management).
Before [running the Metabase crawler](/apps/connectors/business-intelligence/metabase/how-tos/crawl-metabase), you can run [preflight checks](/product/co.
Before [running the Microsoft Azure Data Factory crawler](/apps/connectors/etl-tools/microsoft-azure-data-factory/how-tos/crawl-microsoft-azure-data-fact.
This check is performed for both [basic](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics) and [service principal](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics) authentication method.
Before [running the Microsoft Fabric crawler](/apps/connectors/business-intelligence/microsoft-fabric/how-tos/crawl-microsoft-fabric), you can run.
Before [running the Microsoft Power BI crawler](/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi), you can run.
Before [running the Microsoft SQL Server crawler](/apps/connectors/database/microsoft-sql-server/how-tos/crawl-microsoft-sql-server), you can run [prefli.
First, the list of projects in the _Include Projects_ and _Exclude Projects_ fields is determined. Next, the [Get Projects REST API](https://demo.microstrategy.com/MicroStrategyLibrary/api-docs/index.html#/Projects/getProjects_1) is used to fetch the actual list of projects for which the user has permissions.
Before [running the Mode crawler](/apps/connectors/business-intelligence/mode/how-tos/crawl-mode), you can run [preflight checks](/product/connections/co.
Before running the MongoDB Atlas crawler, you can run preflight checks to verify the connected user has the required MongoDB privileges for metadata extraction.
Before [running the Monte Carlo crawler](/apps/connectors/observability/monte-carlo/how-tos/crawl-monte-carlo), you can run [preflight checks](/product/c.
Before [running the MySQL crawler](/apps/connectors/database/mysql/how-tos/crawl-mysql), you can run [preflight checks](/product/connections/concepts/wha.
The NetSuite SuiteTalk REST API is used to validate authentication and access permissions before crawling.
Before [running the Oracle crawler](/apps/connectors/database/oracle/how-tos/crawl-oracle), you can run [preflight checks](/product/connections/concepts/.
Before [running the PostgreSQL crawler](/apps/connectors/database/postgresql/how-tos/crawl-postgresql), you can run [preflight checks](/product/connectio.
Before [running the PrestoSQL crawler](/apps/connectors/database/prestosql/how-tos/crawl-prestosql), you can run [preflight checks](/product/connections/.
This check tests for access to datasets and other Qlik objects.
Before [running the Redash crawler](/apps/connectors/business-intelligence/redash/how-tos/crawl-redash), you can run [preflight checks](/product/connecti.
Before [running the Redpanda Kafka crawler](/apps/connectors/messaging/redpanda-kafka/how-tos/crawl-redpanda-kafka), you can run [preflight checks](/prod.
Before [running the Salesforce crawler](/apps/connectors/crm/salesforce/how-tos/crawl-salesforce), you can run [preflight checks](/product/connections/co.
Preflight checks for SAP HANA
First, the list of workbooks in the _Include Workbooks_ and _Exclude Workbooks_ fields is determined. Next, the [List Workbooks](https://help.sigmacomputing.com/hc/en-us/articles/4408555666323) REST API is used to fetch the actual list of workbooks for which the user credentials have view permission.
Atlan uses the [Folders API](https://sisense.dev/guides/restApi/v1/?platform=linux&spec=L2023.6#/folders) to check if it's responding with a response status code 200.
Before [running the Snowflake crawler](/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake), you can run [preflight checks](/product/conne.
Learn about preflight checks for soda
Before running the Starburst Enterprise crawler, you can run preflight checks to perform the necessary technical validations.
The [Server Info](https://help.tableau.com/current/api/rest_api/en-us/REST/rest_api_ref_server.htm#server_info) REST API is used to fetch the `restApiVersion` value.
Before [running the Teradata crawler](/apps/connectors/database/teradata/how-tos/crawl-teradata), you can run [preflight checks](/product/connections/con.
Before [running the Trino crawler](/apps/connectors/database/trino/how-tos/crawl-trino), you can run [preflight checks](/product/connections/concepts/wha.
SSL (Secure Sockets Layer) encryption helps establish a secure connection between your data source and Atlan. Atlan currently supports SSL certificates for [crawling Tableau](/apps/connectors/business-intelligence/tableau/how-tos/crawl-tableau) and [crawling Matillion](/apps/connectors/etl-tools/matillion/how-tos/crawl-matillion).
:::warning Who can do this? You will need your Amazon Athena or AWS administrator involved - you may not have access yourself to complete these steps.
Configure authentication and connection settings for AlloyDB for PostgreSQL connector
Create AWS IAM permissions and credentials for Atlan to access and catalog your S3 buckets and objects.
Learn about set up aws glue.
Configure AWS authentication and IAM credentials to enable Atlan to integrate with AWS DataZone and SageMaker Catalog Unified Studio.
Create a BigID system user and API token for Atlan integration.
Configure authentication and connection settings for Cloud SQL for PostgreSQL connector
Create a Cyera API token and obtain credentials for Atlan integration.
Set up DataStax Enterprise
Configure authentication tokens in dbt Cloud to enable Atlan to fetch and enrich your assets with dbt metadata.
:::warning Who can do this? You'll need your Domo administrator to complete these steps - you may not have access yourself.
Configure the Fivetran Platform Connector and destination to enable Atlan to extract Fivetran metadata and logs.
You must be a Google BigQuery administrator to run these commands. For more information, see [Google Cloud's Granting, changing, and revoking access to resources](https://cloud.google.com/iam/docs/granting-changing-revoking-access).
Configure Google Cloud Knowledge Catalog connection and authentication by creating a service account with required permissions, or using Workload Identity Federation.
Configure Google Cloud Storage for secure metadata ingestion with Atlan.
Configure Hightouch roles, groups, and API keys to connect with Atlan.
Configure permissions and authentication for Hive to enable metadata extraction in Atlan.
:::warning Who can do this? You must be an IBM Cognos Analytics administrator to complete these steps - you may not have access yourself.
Create Inventory report for Amazon S3 in case of inventory based ingestion through the crawler.
:::warning Who can do this? You probably need your Looker administrator to run these commands - you may not have access yourself.
If your Microsoft Azure Cosmos DB deployment includes a mix of vCore- and RU-based accounts, you must configure both to fetch metadata. You can then use the _vCore and RU_ deployment option to [crawl your Microsoft Azure Cosmos DB assets](/apps/connectors/database/microsoft-azure-cosmos-db/how-tos/crawl-microsoft-azure-cosmos-db).
Atlan supports crawling the following with the Microsoft Azure Synapse Analytics package:.
Configure authentication and permissions for Microsoft SQL Server to enable Atlan to crawl metadata from your database.
If you do not see the prompts to enter details for the user above, you are probably already signed in to Mode. Sign out of Mode first, and then accept the invite in the service account email.
Atlan supports SCRAM authentication (SCRAM-SHA-1 and SCRAM-SHA-256) for fetching metadata from MongoDB. This method uses a [username and password](#create-database-user) to fetch metadata.
Atlan supports the basic authentication method for fetching metadata from MongoDB. This method uses a username and password to fetch metadata
:::warning Who can do this? You will probably need your Monte Carlo [account owner](https://docs.getmontecarlo.com/docs/authorizationmanaged-roles-and-groups).
In such cases you may want to decouple the extraction of metadata from its ingestion in Atlan. This approach gives you full control over your resources and metadata transfer to Atlan.
The Docker-based databricks-extractor offline tool has been sunset. For on-premises or network-restricted Databricks environments, use Self-Deployed Runtime, Secure Agent, or direct connectivity via private link.
:::warning Who can do this? You need access to a machine that can run Docker on-premises. You also need your IBM Cognos Analytics instance details, including credentials.
In some cases you won't be able to expose your Kafka instance for Atlan to crawl and ingest metadata. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.
In some cases you won't be able to expose your Looker instance for Atlan to crawl and ingest metadata. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.
In some cases you may not be able to expose your Tableau instance for Atlan to crawl and ingest metadata. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.
In some cases you will not be able to expose your ThoughtSpot instance for Atlan to crawl and ingest metadata. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.
:::warning Who can do this? You will probably need your PostgreSQL administrator to run these commands - you may not have access yourself.
:::warning Who can do this? You will probably need your SAP HANA administrator to run these commands - you may not have access yourself.
Atlan supports the basic authentication method for fetching metadata from Sisense. This method uses a username and password to fetch metadata.
:::warning Who can do this? You need your Snowflake administrator to run these commands - you may not have access yourself. :::.
:::warning Who can do this? You probably need your Tableau administrator to run these commands - you may not have access yourself.
:::warning Who can do this? You need your Teradata administrator to run these commands - you may not have access yourself.
:::warning Who can do this? You will probably need your ThoughtSpot instance administrator to complete these steps - you may not have access yourself.
Configure Workload Identity Federation (WIF) to enable Atlan to authenticate with Google BigQuery without using service account keys.
What are the known limitations of data models in Atlan?
So you've crawled your source, and mined the queries, but lineage is missing. Why?
Once you've [connected Atlan with Google Sheets](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-google-sheets), you can import the column metadata for all your data assets in Atlan and make changes to them directly in Google Sheets.
Once you've [connected Atlan with Microsoft Excel](/product/integrations/collaboration/spreadsheets/how-tos/integrate-atlan-with-microsoft-excel), you can import the column metadata for all your data assets in Atlan and make changes to them directly in Microsoft Excel.
Once you have [ingested your ER model assets in Atlan](/product/capabilities/data-models/concepts/what-are-data-models), you can:.
Reference guide for Cyera metadata crawled by Atlan.
Atlan crawls and maps the following assets and properties from Aiven Kafka.
Atlan crawls and maps the following assets and properties from AlloyDB for PostgreSQL
During an Amazon Athena crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Columns. Reference tables map each Athena property to its Atlan asset.
Atlan crawls and maps the following assets and properties from Amazon DynamoDB. Atlan also currently supports lineage between Amazon DynamoDB as a source to supported data warehouses as destinations, as enriched by Fivetran.
During an Amazon MSK crawl, Atlan extracts metadata for Topics and Consumer Groups. Reference tables map each Amazon MSK property to its Atlan asset.
Once you have [integrated Amazon MWAA/OpenLineage](/apps/connectors/lineage/amazon-mwaa-openlineage/how-tos/integrate-amazon-mwaa-openlineage), you can [.
Atlan currently supports lineage for the Amazon QuickSight connector to the following data sources:.
During an Amazon Redshift crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Columns. Reference tables map each Redshift property to its Atlan asset.
Complete reference for the S3 assets and properties that Atlan crawls and maps during S3 cataloging.
Atlan crawls and maps the following assets and properties from Anaplan.
Once you have [integrated Anomalo](/apps/connectors/observability/anomalo/how-tos/integrate-anomalo), Atlan will receive webhook events when checks are executed in Anomalo. These checks will be cataloged in Atlan to create a relationship with existing assets using the association information from the check.
Once you have [integrated Apache Airflow/OpenLineage](/apps/connectors/lineage/apache-airflow-openlineage/how-tos/integrate-apache-airflow-openlineage),.
Atlan maps the following assets and properties from Apache Flink/OpenLineage. Asset lineage support depends on the data sources that OpenLineage supports.
During an Apache Kafka crawl, Atlan extracts metadata for Clusters, Topics, Consumer Groups, Schema Subjects, Schema Versions, and Schema Fields. Reference tables map each Kafka property to its Atlan asset.
Atlan maps the following assets and properties from Apache Spark/OpenLineage. Asset lineage support depends on the data sources that OpenLineage supports.
Atlan maps the following assets and properties from Astronomer/OpenLineage. Asset lineage support depends on the [list of operators supported by OpenLineage](https://airflow.apache.org/docs/apache-airflow-providers-openlineage/1.6.0/supported_classes.html).
During an AWS Glue crawl, Atlan extracts metadata for Catalogs, Databases, Schemas, Tables, and Jobs. Reference tables map each Glue property to its Atlan asset.
Reference guide for BigID metadata crawled by Atlan.
During a ClickHouse crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Columns. Reference tables map each ClickHouse property to its Atlan asset.
Atlan crawls and maps the following assets and properties from Cloud SQL for PostgreSQL
During a Confluent Kafka crawl, Atlan extracts metadata for Clusters, Topics, Consumer Groups, Schema Subjects, Schema Versions, and Schema Fields. Reference tables map each Confluent Kafka property to its Atlan asset.
Complete list of CrateDB assets and metadata properties extracted by Atlan during crawling
During a Databricks crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, Materialized Views, Volumes, External Locations, and AI Models. Reference tables map each Databricks property to its Atlan asset.
What does Atlan crawl from DataStax Enterprise?
Atlan supports lineage for the following asset types:.
During a Fivetran crawl, Atlan creates lineage between source and destination data assets and extracts metadata for Fivetran Connectors. Reference tables map each Fivetran Connector property to its Atlan asset.
Atlan doesn't run any table scans. Atlan leverages the table preview options from [Google BigQuery](https://cloud.google.com/bigquery/docs/best-practices-costs#preview-data) that enable you to view data for free and without affecting any quotas using the `tabledata.list` API. Hence, [table](/apps/connectors/data-warehouses/google-bigquery/references/what-does-atlan-crawl-from-google-bigquery#tables) asset previews in Atlan are already cost-optimized. However, this doesn't apply to [views](/apps/connectors/data-warehouses/google-bigquery/references/what-does-atlan-crawl-from-google-bigquery#views) and [materialized views](/apps/connectors/data-warehouses/google-bigquery/references/what-does-atlan-crawl-from-google-bigquery#materialized-views).
Atlan maps the following assets and properties from Google Cloud Composer/OpenLineage. Asset lineage support depends on the [list of operators supported by OpenLineage](https://airflow.apache.org/docs/apache-airflow-providers-openlineage/1.6.0/supported_classes.html).
Complete reference for the GCS assets and properties that Atlan crawls and maps during GCS cataloging.
During a Hive crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, Materialized Views, and Columns. Reference tables map each Hive property to its Atlan asset.
Atlan crawls and maps the following assets and properties from IBM Cognos Analytics.
During a Looker crawl, Atlan extracts metadata for Connections, Projects, Views, Models, Folders, Looks, Dashboards, Tiles, and Explores. Reference tables map each Looker property to its Atlan asset.
Atlan crawls and maps the following assets and properties from Matillion.
Once you have [crawled Microsoft Azure Cosmos DB](/apps/connectors/database/microsoft-azure-cosmos-db/how-tos/crawl-microsoft-azure-cosmos-db), you can [.
Atlan crawls and maps the following assets and properties from Microsoft Azure Data Factory.
Atlan crawls and maps the following assets and properties from Microsoft Azure Event Hubs.
During a Microsoft Azure Synapse Analytics crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Routines. Reference tables map each Azure Synapse property to its Atlan asset.
Atlan crawls and maps the following assets and properties from Microsoft Power BI.
Atlan crawls and maps the following assets and properties from Microsoft SQL Server.
Atlan crawls and maps the following assets and properties from MicroStrategy.
Atlan crawls and maps the following assets and properties from MongoDB (self-managed). Atlan currently doesn't support lineage for MongoDB (self-managed) assets.
During a MongoDB crawl, Atlan extracts metadata for Databases, Collections, and Columns. Reference tables map each MongoDB property to its Atlan asset.
What does Atlan crawl from Monte Carlo? <Badge variant="preview" text="Private Preview" link="/get-started/references/product-release-stages#private-preview" />
During a MySQL crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Stored Procedures. Reference tables map each MySQL property to its Atlan asset.
Atlan crawls and maps NetSuite record types to tables and record fields to columns.
During an Oracle crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Procedures. Reference tables map each Oracle property to its Atlan asset.
During a PostgreSQL crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Functions. Reference tables map each PostgreSQL property to its Atlan asset.
Atlan crawls and maps the following assets and properties from PrestoSQL.
Atlan crawls and maps the following assets and properties from Qlik Sense Cloud.
Atlan crawls and maps the following assets and properties from Qlik Sense Enterprise on Windows.
Atlan crawls and maps the following assets and properties from Redash.
Atlan crawls and maps the following assets and properties from Redpanda Kafka.
During a Salesforce crawl, Atlan extracts metadata for Organizations, Objects, Fields, Reports, and Dashboards. Reference tables map each Salesforce property to its Atlan asset.
What does Atlan crawl from SAP BW/4HANA? <Badge variant="preview" text="Private Preview" link="/get-started/references/product-release-stages#private-preview" />
Assets, properties, and data type mappings that Atlan discovers and catalogs from SAP Datasphere.
What does Atlan crawl from SAP ECC? <Badge variant="preview" text="Public Preview" link="/get-started/references/product-release-stages#public-preview" />
What does Atlan crawl from SAP S/4HANA? <Badge variant="preview" text="Public Preview" link="/get-started/references/product-release-stages#public-preview" />
During a Sisense crawl, Atlan extracts metadata for Dashboards, Widgets, Data Models, Data Model Tables, and Folders. Reference tables map each Sisense property to its Atlan asset.
Atlan crawls and maps the following assets from SageMaker Catalog Unified Studio.
During a Snowflake crawl, Atlan extracts metadata for Databases, Schemas, Tables, Views, and Procedures. Reference tables map each Snowflake property to its Atlan asset.
Atlan crawls datasets and then filters out all the datasets without any checks. It then crawls the checks associated with each of the datasets with checks from Soda. These checks are cataloged in Atlan to create a relationship with existing assets using the association information from the dataset.
Atlan crawls and maps the following assets and properties from Starburst Enterprise.
During a Tableau crawl, Atlan extracts metadata for Projects, Workbooks, Worksheets, Dashboards, Datasources, and Flows. Reference tables map each Tableau property to its Atlan asset.
During a Teradata crawl, Atlan extracts metadata for Schemas, Tables, Views, and Columns. Reference tables map each Teradata property to its Atlan asset.
Once you've [crawled ThoughtSpot](/apps/connectors/business-intelligence/thoughtspot/how-tos/crawl-thoughtspot), you can [use connector-specific filters].
Atlan crawls and maps the following assets and properties from Trino.
Atlan uses Matillion's metadata API to generate lineage associated with [Matillion connectors](https://www.matillion.com/connectors). This is particularly useful for creating lineage between different tools.
Microsoft Azure Data Factory REST API reference for lineage extracted into Atlan.
This document helps you understand how Atlan generates lineage to upstream SQL sources for your Microsoft Power BI assets using a custom query parser, and the steps you can take while developing reports and dashboards in Microsoft Power BI to create seamless lineage generation.
Atlan personnel do not have access to any customer instance unless specifically provided by the customer. Accordingly, in the event that a customer instance contains personal data and Atlan personnel are provided access to that instance, Atlan may act as a personal data processor. In addition, depending on whether the customer is a data controller or processor, Atlan may act as a data processor or subprocessor, respectively.
Atlan supports extracting and displaying description metadata for your [Salesforce objects](/apps/connectors/crm/salesforce/references/what-does-atlan-crawl-from-salesforce).