Catalogs of Metrics

The following statistics are automatically included in the generated JSON configuration file and are collected from each Kafka Broker. For more details on any specific statistic, refer to the Apache Kafka documentation.

Metric Name Attributes InfluxDB Alias Notes
kafka.server.MessagesInPerSec Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

MessagesInPerSec
kafka.server.MessagesInPerSec Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

MessagesInPerSecPerTopic Topic=*
kafka.server.BytesInPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

BytesInPerSec
kafka.server.BytesInPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

BytesInPerSecPerTopic Topic=*
kafka.server.BytesOutPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

BytesOutPerSec
kafka.server.BytesOutPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

BytesOutPerSecPerTopic Topic=*
kafka.server.ReplicationBytesInPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

ReplicationBytesInPerSec
kafka.network.RequestsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

RequestsPerSec
kafka.network.ErrorsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

ErrorsPerSec
kafka.network.RequestBytes

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

RequestBytes request=*
kafka.network.TemporaryMemoryBytes

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

TemporaryMemoryBytesProduce request=Produce
kafka.network.TemporaryMemoryBytes

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

TemporaryMemoryBytesFetch request=Fetch
kafka.network.MessageConversionsTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

MessageConversionsTimeMsFetch request=Fetch
kafka.network.MessageConversionsTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

MessageConversionsTimeMsProduce request=Produce
kafka.server.ProduceMessageConversionsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

ProduceMessageConversionsPerSec
kafka.server.FetchMessageConversionsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

FetchMessageConversionsPerSec
kafka.server.ReplicationBytesOutPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

ReplicationBytesOutPerSec
kafka.server.UnderReplicatedPartitions Value UnderReplicatedPartitions
kafka.server. UnderMinIsrPartitionCount Value UnderMinIsrPartitionCount
kafka.server. OfflinePartitionsCount Value OfflinePartitionsCount
kafka.server. OfflineLogDirectoryCount Value OfflineLogDirectoryCount
kafka.controller.ActiveControllerCount Value ActiveControllerCount
kafka.controller.LeaderElectionRateAndTimeMs

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

LeaderElectionRateAndTimeMs
kafka.controller.UncleanLeaderElectionsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

UncleanLeaderElectionsPerSec
kafka.server.kafka.server.PartitionCount Value PartitionCount
kafka.server.LeaderCount Value LeaderCount
kafka.server.IsrShrinksPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

IsrShrinksPerSec
kafka.server.IsrExpandsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

IsrExpandsPerSec
kafka.server.MaxLag Value MaxLag clientId=Replica
kafka.server.PurgatorySize Value FetchPurgatorySize delayedOperation=Fetch
kafka.server.PurgatorySize Value ProducePurgatorySize delayedOperation=Produce
kafka.network.TotalTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

ProduceTotalTimeMS request=Produce
kafka.network.TotalTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchConsumerTotalTimeMS request=FetchConsumer
kafka.network.TotalTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchFollowerTotalTimeMS request=FetchFollower
kafka.network.RequestQueueTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchFollowerRequestQueueTimeMs request=FetchFollower
kafka.network.RequestQueueTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchConsumerRequestQueueTimeMS request=FetchConsumer
kafka.network.RequestQueueTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

ProduceRequestQueueTimeMS request=Produce
kafka.log.LogFlushRateAndTimeMs

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

LogFlush
kafka.network.LocalTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

ProduceLocalTimeMs request=Produce
kafka.network.LocalTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchConsumerLocalTimeMs request=FetchConsumer
kafka.network.LocalTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchFollowerLocalTimeMs request=FetchFollower
kafka.network.RemoteTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

ProduceRemoteTimeMs request=Produce
kafka.network.RemoteTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchConsumerRemoteTimeMs request=FetchConsumer
kafka.network.RemoteTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchFollowerRemoteTimeMs request=FetchFollower
kafka.network.RequestsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

ProduceRequestsPerSec Request=Produce
kafka.network.RequestsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

FetchConsumerRequestsPerSec Request=FetchConsumer
kafka.network.RequestsPerSec

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

FetchFollowerRequestsPerSec Request=FetchFollower
kafka.network.ResponseSendTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchConsumerResponseSendTimeMs request=FetchConsumer
kafka.network.ResponseSendTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchFollowerResponseSendTimeMs request=FetchFollower
kafka.network.ResponseQueueTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

ProduceResponseQueueTimeMs request=Produce
kafka.network.ResponseQueueTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchConsumerResponseQueueTimeMs request=FetchConsumer
kafka.network.ResponseQueueTimeMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

FetchFollowerResponseQueueTimeMs request=FetchFollower
kafka.network.NetworkProcessorAvgIdlePercent Value NetworkProcessorAvgIdlePercent

kafka.server.RequestHandlerAvgIdlePercent

Count

MeanRate

OneMinuteRate

FiveMinuteRate

FifteenMinuteRate

RequestHandlerAvgIdlePercent
kafka.server.ProduceBWQuota queue-size ProduceBWQuota type=Produce
kafka.server.FetchBWQuota queue-size FetchBWQuota type=Fetch
kafka.server.RequestQuota queue-size RequestQuota
org.apache.ZooKeeperService

Name

StartTime

Version

TickTime

QuorumSize

MinSessionTimeout

MaxSessionTimeout

ClientPort

PacketsSent

NumAliveConnections

OutstandingRequests

MaxClientsCnxnsPerHost

FsyncThresholdExceedCount

PacketsReceived

zookeeper
org.apache.ZooKeeperService.replica

Name

State

StartTime

TickTime

TickQuorunAddress

ElectionType

InitLimit

SyncLimit

MaxClientCnxnsPerHost

MinSessionTimeout

MaxSessionTimeout

zookeeper
org.apache.ZooKeeperService.InMemoryDataTree

LastZxid

NodeCount

WatchCount

zookeeper
kafka.server.ZooKeeperRequestLatencyMs

Count

Min

Max

Mean

StdDev

50thPercentile

75thPercentile

95thPercentile

98thPercentile

99thPercentile

999thPercentile

ZooKeeperRequestLatencyMs
java.lang.OperatingSystem

ProcessCpuTime

ProcessCpuLoad

SystemCpuLoad

SystemLoadAverage

CommittedVirtualMemorySize

FreePhysicalMemorySize

OS
java.lang.Memory

HeapMemoryUsage

NonHeapMemoryUsage

MemoryUsage