## What does Atlan crawl from Aiven Kafka?

URL: https://docs.atlan.com/apps/connectors/messaging/aiven-kafka/references/what-does-atlan-crawl-from-aiven-kafka

> Atlan crawls and maps the following assets and properties from Aiven Kafka.

Atlan crawls and maps the following assets and properties from Aiven Kafka.

Once you've [crawled Aiven Kafka](https://docs.atlan.com/llms/connectors/aiven-kafka/crawl-aiven-kafka/llms.txt), you can [use connector-specific filters](https://docs.atlan.com/llms/catalog/discovery/use-the-filters-menu/llms.txt) for quick asset discovery. The following filters are currently supported for these assets:

- [Topics](#topics) - Message count, size (MB), partition count, and cleanup policy filters
- [Consumer groups](#consumer-groups) - Member count and topic name filters

## Topics

Atlan maps topics from Aiven Kafka to its `KafkaTopic` asset type.

| Source property | Atlan property |
| --- | --- |
| Topic | name |
| PartitionCount | kafkaTopicPartitionsCount |
| ReplicationFactor | kafkaTopicReplicationFactor |
| segment.byte | kafkaTopicSegmentBytes |
| compression.type | kafkaTopicCompressionType |
| cleanup.policy | kafkaLogTopicCleanupPolicy |
| isInternal | kafkaTopicIsInternal |
| sizeInBytes | kafkaTopicSizeInBytes |
| recordCount | kafkaTopicRecordCount |
| retention.ms | kafkaTopicRetentionTimeInMs |

## Consumer groups

Atlan maps consumer groups from Aiven Kafka to its `KafkaConsumerGroup` asset type.

:::info **Did you know?** 
 Consumer groups are most likely to show up only in streaming scenarios. This is because if a topic is not being consumed actively, Aiven Kafka will purge the consumer group. So, if a consumer group is inactive while the workflow runs in Atlan, it will not be cataloged as an asset.

:::

| Source property | Atlan property |
| --- | --- |
| GROUP | name |
| memberCount | kafkaConsumerGroupMemberCount |
| ReplicationFactor | kafkaTopicReplicationFactor |
| topic\_names | kafkaTopicNames |
| TOPIC | kafkaConsumerGroupTopicConsumptionProperties.topicName |
| PARTITION | kafkaConsumerGroupTopicConsumptionProperties.topicPartition |
| LAG | kafkaConsumerGroupTopicConsumptionProperties.topicLag |
| CURRENT-OFFSET | kafkaConsumerGroupTopicConsumptionProperties.topicCurrentOffset |

---