Name
|
None
|
The name to be displayed as the label for the activity in the process.
|
Kafka Connection
|
Yes
|
The Kafka connection resource for communicating with a Kafka server instance.
|
Group Id
|
Yes
|
The group ID for the consumer group.
|
Topic Names
|
Yes
|
The topic name where Kafka cluster stores streams of record.
|
Assign Custom Partition
|
None
|
This is a check box to select if
Partition ID needs to be entered. You can select the check box to override Kafka's default partition assignment behavior.
|
Partition ID
|
Yes
|
Sequence ID or range of the partition to which the message is sent. Default is 0.
Note:
- This field is enabled only if
Assign Custom Partition field is checked.
- For Projects created on Kafka Plug-in version 6.1.0 or earlier, if the
PartitionID field in Kafka ReceiveMessage Activity is configured by using module or process property, the data type of the property must be changed from Integer to String.
|
Consumer Count
|
Yes
|
The Consumer Count specifies the number of KafkaConsumer instances started by the activity. The default value is 0 which will create and start KafkaConsumer instances equal to the number of partitions in the topic. The maximum value allowed for Consumer Count is equal to the number of partitions in the topic.
|
Key Deserializer
|
Yes
|
Class for the key that implements the serializer interface.
|
Value Deserializer
|
Yes
|
Value for the serializer interface.
|
Fetch Timeout
|
Yes
|
Specifies the maximum time in milliseconds to get the metadata about the topic before a timeout occurs.
The default value is 1000.
|
Fetch Min Bytes
|
Yes
|
The minimum amount of data that the server would send on receiving a fetch request. The default setting of 1 byte means that fetch requests are answered as soon as a single byte of data is available or the fetch request times out waiting for data to arrive.
|
Fetch Max Wait
|
Yes
|
The maximum amount of time that the server would block before answering a fetch request if there is not sufficient data to immediately satisfy the requirement given by
fetch.min.bytes.
The default value is 500.
|
Heartbeat Interval
|
Yes
|
Time in milliseconds between heartbeats to the consumer. Heartbeats are used to ensure that the consumer's session stays active and to facilitate rebalancing and information when consumers join or leave a group.
The default value is 3000.
|
Session Timeout
|
Yes
|
The consumer sends periodic heartbeats to server indicating about its liveness to the broker. If no heartbeats are received by a broker before the expiration of this session timeout, the broker removes this consumer from the group and initiates a rebalance.
The default value is 30000.
|