Preflight checks for Apache Kafka

Before running the Apache Kafka crawler, run preflight checks to perform the necessary technical validations. The following preflight checks are completed:

Cluster permission

• ✅ Check successful if the user has sufficient permission to list all the brokers of the Apache Kafka cluster.
• ❌ Failed to get list of Kafka brokers if the user has permission to connect to the Apache Kafka cluster but is unable to fetch any broker details.

Topics permission

• ✅ Check successful if the user has sufficient permission to list or describe topics available in the Apache Kafka cluster.
• ❌ Failed to get list of Kafka topics if the user has permission to connect to the Apache Kafka cluster but is unable to fetch any topic details.

The following additional preflight checks are run when Schema Registry credentials are provided:

Schema Registry subjects check

• ✅ Check successful if the provided credentials have sufficient permission to list subjects in the Schema Registry.
• ❌ Check failed for $subjectName. Grant at least read access to the subject.

Schema Registry configs check

• ✅ Check successful if the provided credentials can read compatibility configuration from the Schema Registry.
• ❌ Source returned error message.

Schema Registry schemas check

• ✅ Check successful if the provided credentials can retrieve schema definitions from the Schema Registry.
• ❌ Source returned error message.