Catalogs of Metrics
The following statistics are automatically included in the generated JSON configuration file and are collected from each Kafka Broker. For more details on any specific statistic, refer to the Apache Kafka documentation.
Metric Name | Attributes | InfluxDB Alias | Notes |
---|---|---|---|
kafka.server.MessagesInPerSec |
Count
MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
MessagesInPerSec | |
kafka.server.MessagesInPerSec | Count
MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
MessagesInPerSecPerTopic | Topic=* |
kafka.server.BytesInPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
BytesInPerSec | |
kafka.server.BytesInPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
BytesInPerSecPerTopic | Topic=* |
kafka.server.BytesOutPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
BytesOutPerSec | |
kafka.server.BytesOutPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
BytesOutPerSecPerTopic | Topic=* |
kafka.server.ReplicationBytesInPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
ReplicationBytesInPerSec | |
kafka.network.RequestsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
RequestsPerSec | |
kafka.network.ErrorsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
ErrorsPerSec | |
kafka.network.RequestBytes |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
RequestBytes | request=* |
kafka.network.TemporaryMemoryBytes |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
TemporaryMemoryBytesProduce | request=Produce |
kafka.network.TemporaryMemoryBytes |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
TemporaryMemoryBytesFetch | request=Fetch |
kafka.network.MessageConversionsTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
MessageConversionsTimeMsFetch | request=Fetch |
kafka.network.MessageConversionsTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
MessageConversionsTimeMsProduce | request=Produce |
kafka.server.ProduceMessageConversionsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
ProduceMessageConversionsPerSec | |
kafka.server.FetchMessageConversionsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
FetchMessageConversionsPerSec | |
kafka.server.ReplicationBytesOutPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
ReplicationBytesOutPerSec | |
kafka.server.UnderReplicatedPartitions | Value | UnderReplicatedPartitions | |
kafka.server. UnderMinIsrPartitionCount | Value | UnderMinIsrPartitionCount | |
kafka.server. OfflinePartitionsCount | Value | OfflinePartitionsCount | |
kafka.server. OfflineLogDirectoryCount | Value | OfflineLogDirectoryCount | |
kafka.controller.ActiveControllerCount | Value | ActiveControllerCount | |
kafka.controller.LeaderElectionRateAndTimeMs |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
LeaderElectionRateAndTimeMs | |
kafka.controller.UncleanLeaderElectionsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
UncleanLeaderElectionsPerSec | |
kafka.server.kafka.server.PartitionCount | Value | PartitionCount | |
kafka.server.LeaderCount | Value | LeaderCount | |
kafka.server.IsrShrinksPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
IsrShrinksPerSec | |
kafka.server.IsrExpandsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
IsrExpandsPerSec | |
kafka.server.MaxLag | Value | MaxLag | clientId=Replica |
kafka.server.PurgatorySize | Value | FetchPurgatorySize | delayedOperation=Fetch |
kafka.server.PurgatorySize | Value | ProducePurgatorySize | delayedOperation=Produce |
kafka.network.TotalTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
ProduceTotalTimeMS | request=Produce |
kafka.network.TotalTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchConsumerTotalTimeMS | request=FetchConsumer |
kafka.network.TotalTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchFollowerTotalTimeMS | request=FetchFollower |
kafka.network.RequestQueueTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchFollowerRequestQueueTimeMs | request=FetchFollower |
kafka.network.RequestQueueTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchConsumerRequestQueueTimeMS | request=FetchConsumer |
kafka.network.RequestQueueTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
ProduceRequestQueueTimeMS | request=Produce |
kafka.log.LogFlushRateAndTimeMs |
MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
LogFlush | |
kafka.network.LocalTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
ProduceLocalTimeMs | request=Produce |
kafka.network.LocalTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchConsumerLocalTimeMs | request=FetchConsumer |
kafka.network.LocalTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchFollowerLocalTimeMs | request=FetchFollower |
kafka.network.RemoteTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
ProduceRemoteTimeMs | request=Produce |
kafka.network.RemoteTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchConsumerRemoteTimeMs | request=FetchConsumer |
kafka.network.RemoteTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchFollowerRemoteTimeMs | request=FetchFollower |
kafka.network.RequestsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
ProduceRequestsPerSec | Request=Produce |
kafka.network.RequestsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
FetchConsumerRequestsPerSec | Request=FetchConsumer |
kafka.network.RequestsPerSec |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
FetchFollowerRequestsPerSec | Request=FetchFollower |
kafka.network.ResponseSendTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchConsumerResponseSendTimeMs | request=FetchConsumer |
kafka.network.ResponseSendTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchFollowerResponseSendTimeMs | request=FetchFollower |
kafka.network.ResponseQueueTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
ProduceResponseQueueTimeMs | request=Produce |
kafka.network.ResponseQueueTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchConsumerResponseQueueTimeMs | request=FetchConsumer |
kafka.network.ResponseQueueTimeMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
FetchFollowerResponseQueueTimeMs | request=FetchFollower |
kafka.network.NetworkProcessorAvgIdlePercent | Value | NetworkProcessorAvgIdlePercent | |
kafka.server.RequestHandlerAvgIdlePercent |
Count MeanRate OneMinuteRate FiveMinuteRate FifteenMinuteRate |
RequestHandlerAvgIdlePercent | |
kafka.server.ProduceBWQuota | queue-size | ProduceBWQuota | type=Produce |
kafka.server.FetchBWQuota | queue-size | FetchBWQuota | type=Fetch |
kafka.server.RequestQuota | queue-size | RequestQuota | |
org.apache.ZooKeeperService |
Name StartTime Version TickTime QuorumSize MinSessionTimeout MaxSessionTimeout ClientPort PacketsSent NumAliveConnections OutstandingRequests MaxClientsCnxnsPerHost FsyncThresholdExceedCount PacketsReceived |
zookeeper | |
org.apache.ZooKeeperService.replica |
Name State StartTime TickTime TickQuorunAddress ElectionType InitLimit SyncLimit MaxClientCnxnsPerHost MinSessionTimeout MaxSessionTimeout |
zookeeper | |
org.apache.ZooKeeperService.InMemoryDataTree |
LastZxid NodeCount WatchCount |
zookeeper | |
kafka.server.ZooKeeperRequestLatencyMs |
Count Min Max Mean StdDev 50thPercentile 75thPercentile 95thPercentile 98thPercentile 99thPercentile 999thPercentile |
ZooKeeperRequestLatencyMs | |
java.lang.OperatingSystem |
ProcessCpuTime ProcessCpuLoad SystemCpuLoad SystemLoadAverage CommittedVirtualMemorySize FreePhysicalMemorySize |
OS | |
java.lang.Memory |
HeapMemoryUsage NonHeapMemoryUsage |
MemoryUsage |