Data Flow of Monitoring Data and Log Messages

Monitoring data is sourced from the messaging servers/brokers and the client applications. When the messaging server or broker receives monitoring data from any of its clients, it immediately publishes that data on a monitoring stream. When the server receives log messages or advisory messages from any of its clients, it publishes these on a logging stream.

The Monitoring Gateway collects statistics from the Apache Pulsar-related services driven by the configuration settings. (By default, all available statistics are collected but the specific statistics collected can be controlled through configuration.) The gateway posts the collected statistics to an InfluxDB database.

InfluxDB is an open-source database. You can access the data directly from InfluxDB, or use other tools that manipulate and display the data, such as Grafana.

Grafana provides data visualization for dashboards. Dashboards specific to the type of messaging system are provided with the corresponding extension component.