Throughput

Copyright © Cloud Software Group, Inc. All Rights Reserved

Chapter 17 Best Practices for Low Latency : Throughput

Throughput

Low-latency and high-throughput are conflicting goals. Just as cars can move faster when highways are not crowded, data can move faster when host computers and networks are not crowded.

In addition, consolidating the functionality of the TIBCO Rendezvous daemon into application programs can reduce maximum throughput.

When low-latency is the highest priority, be prepared to accept lower throughput as a trade-off.

Send Messages in Groups

When throughput becomes a limiting factor, consider sending messages as a group with one call to tibrvTransport_Sendv(), rather than sending individual messages with repeated calls to tibrvTransport_Send().

Judicious application of this tool can avoid the overhead of multiple function calls, and permit opportunistic batching of messages for improved throughput. Nonetheless, it is good practice to strike a balance between latency and throughput goals using careful experimentation.