Apache Kafka

This section contains the following topics:

  • Overview
    Apache Kafka is a distributed messaging system, providing fast, highly scalable, and redundant messaging through a publisher-subscriber model. By using out-of-the-box connectivity, you can design the flows to send and receive the records.
  • Configuring a Kafka Client Connection
    To publish or subscribe messages, you must first configure a Apache Kafka client connection. The Apache Kafka client connection contains the parameters required to connect to the Apache Kafka cluster. The Apache Kafka client connection is used by all the activities in the Apache Kafka category.
  • Kafka Consumer Trigger
    Apache Kafka Consumer Trigger receives records from specified topic in the Apache Kafka cluster.
  • Kafka Producer
    Apache Kafka producer activity sends a record to a specified topic or channel in the Kafka cluster.
  • Kafka Offset Commit
    Apache Kafka Offset Commit activity notifies Kafka Consumer Trigger to commit given offset. This is useful in case you want offsets to be committed as soon as the record is processed in the flow. By default, offsets are committed only when flow is successfully executed.
Related concepts