# Apache Kafka

Integrate, catalog, and govern Apache Kafka assets in Atlan.

## Required permissions

- [Preflight checks for Apache Kafka](https://docs.atlan.com/llms/connectors/apache-kafka/preflight-checks-for-apache-kafka/llms.txt): Before running the Apache Kafka crawler, run preflight checks to perform the necessary technical validations.

## Setup options

- [Set up Apache Kafka](https://docs.atlan.com/llms/connectors/apache-kafka/set-up-apache-kafka/llms.txt): Configure authentication and permissions on Apache Kafka so Atlan can access your cluster metadata.

## Crawl and mine

- [Crawl Apache Kafka](https://docs.atlan.com/llms/connectors/apache-kafka/crawl-apache-kafka/llms.txt): Crawl metadata from Apache Kafka to catalog topics, consumer groups, and clusters. Extract schema information from Confluent Schema Registry after configuring cluster permissions.

## Reference

- [Set up on-premises Kafka access](https://docs.atlan.com/llms/connectors/apache-kafka/set-up-on-premises-kafka-access/llms.txt): In some cases you won't be able to expose your Kafka instance for Atlan to crawl and ingest metadata. For example, this may happen when security requirements restrict access to sensitive, mission-critical data.
- [Crawl on-premises Kafka](https://docs.atlan.com/llms/connectors/apache-kafka/crawl-on-premises-kafka/llms.txt): Extract metadata from on-premises Kafka to catalog topics, partitions, and consumer groups. Discover and govern your Kafka messaging infrastructure after configuring extractor tool.
- [How Atlan connects to Apache Kafka](https://docs.atlan.com/llms/connectors/apache-kafka/how-atlan-connects-to-apache-kafka/llms.txt): Understand how Atlan securely connects to your Apache Kafka cluster to extract metadata.
- [What does Atlan crawl from Apache Kafka?](https://docs.atlan.com/llms/connectors/apache-kafka/what-does-atlan-crawl-from-apache-kafka/llms.txt): During an Apache Kafka crawl, Atlan extracts metadata for Clusters, Topics, Consumer Groups, Schema Subjects, Schema Versions, and Schema Fields. Reference tables map each Kafka property to its Atlan asset.
- [Manage Kafka assets](https://docs.atlan.com/llms/connectors/apache-kafka/manage-assets/llms.txt): Manage Apache Kafka assets programmatically in Atlan using the Python SDK (pyatlan). Create, update, and delete KafkaTopic and KafkaConsumerGroup assets via the SDK.