Confluent Kafka
TL;DR
Integrate, catalog, and govern Confluent Kafka assets in Atlan.
Your AI can read this via Docs MCPcurl -fsSL "https://docs.atlan.com/install-docs-mcp" | bashConnect
Discovery
Lineage
Browser Extension
Self-deployed Runtime
Enrichment
Popularity
Run status
Overview: Catalog Confluent Kafka clusters, topics, consumer groups, schema subjects, and schema versions in Atlan. Gain visibility into event streams, schema evolution, lineage, and governance for your Confluent platform, including lineage from Kafka Connect connectors to Snowflake tables.
Get started
Follow these steps to connect and catalog Confluent Kafka assets in Atlan:
- Set up the connector: Configure authentication and permissions on Confluent Kafka so Atlan can access your cluster metadata.
- Crawl Confluent Kafka assets: Configure and run the Confluent Kafka crawler in Atlan.
Atlan supports Direct and Agent extraction methods. Use Agent extraction with Self-Deployed Runtime when your Confluent Kafka cluster isn't reachable from Atlan Cloud.
Guides
- Set up on-premises Kafka access: Configure Atlan to connect to Kafka environments that are isolated from the public internet.
- Crawl on-premises Kafka: Extract metadata from on-premises Kafka instances.
Concepts
- How Atlan connects to Confluent Kafka: Connection protocols, ports, and security
References
- What does Atlan crawl from Confluent Kafka: Learn about the Confluent Kafka assets and metadata that Atlan discovers and catalogs.
- Preflight checks for Confluent Kafka: Verify prerequisites before running the Confluent Kafka crawler