Apache Kafka
TL;DR
Integrate, catalog, and govern Apache Kafka assets in Atlan.
Your AI can read this via Docs MCPcurl -fsSL "https://docs.atlan.com/install-docs-mcp" | bashConnect
Discovery
Lineage
Browser Extension
Self-deployed Runtime
Enrichment
Popularity
Run status
Overview: Catalog Apache Kafka clusters, topics, consumer groups, schema subjects, and schema versions in Atlan. Gain visibility into event streams, schema evolution, lineage, and governance for your messaging platform.
Get started
Follow these steps to connect and catalog Apache Kafka assets in Atlan:
- Set up the connector: Configure authentication and permissions on Apache Kafka so Atlan can access your cluster metadata.
- Crawl Apache Kafka assets: Configure and run the Apache Kafka crawler in Atlan.
Atlan supports Direct and Agent extraction methods. Use Agent extraction with Self-Deployed Runtime when your Apache Kafka cluster isn't reachable from Atlan Cloud.
Guides
- Set up on-premises Kafka access: Configure Atlan to connect to Kafka environments that are isolated from the public internet.
- Crawl on-premises Kafka: Extract metadata from on-premises Kafka instances.
Concepts
- How Atlan connects to Apache Kafka: Connection protocols, ports, and security
References
- What does Atlan crawl from Apache Kafka: Learn about the Apache Kafka assets and metadata that Atlan discovers and catalogs.
- Preflight checks for Apache Kafka: Verify prerequisites before setting up the Apache Kafka connector.