Apache Kafka Hooks

KafkaHook

A base hook for interacting with Apache Kafka. Use this hook as a base class when creating your own Kafka hooks. For parameter definitions take a look at KafkaBaseHook.

KafkaAdminClientHook

A hook for interacting with an Apache Kafka cluster. For parameter definitions take a look at KafkaAdminClientHook.

Reference

For further information, look at Apache Kafka Admin config documentation.

KafkaAuthenticationError

Custom exception for Kafka authentication failures.

Reference

For further information, look at Confluent Kafka Documentation.

KafkaConsumerHook

A hook for creating a Kafka Consumer. This hook is used by the ConsumeFromTopicOperator and the AwaitMessageTrigger. For parameter definitions take a look at KafkaConsumerHook.

Reference

For further information, look at Apache Kafka Consumer documentation.

KafkaProducerHook

A hook for creating a Kafka Producer. This hook is used by the ProduceToTopicOperator. For parameter definitions take a look at KafkaProducerHook.

Reference

For further information, look at Apache Kafka Producer documentation.

Was this entry helpful?