Performance Benchmarking Criteria
The first step when measuring performance is to identify the Service Level Agreement. Performance targets are determined by user response time and message processing requirements.
Defining the minimum, desired, and peak targets for each requirement helps identifying the type of data to collect and to evaluate the test results.
In addition to these normal load expectations, abnormal error-recovery scenarios under unusually high loads should also be considered. For example, the TIBCO BusinessWorks™ Container Edition process might be receiving or polling messages from a TIBCO Enterprise Message Service queue, and the above targets reflect the normal flow of messages through the queue.
However, if communication to the TIBCO Enterprise Message Service server has been disrupted for an extended period of time, or if the TIBCO BusinessWorks Container Edition Engine shuts down, a much higher load may be experienced when communication is re-established or when the engine restarts.
These scenarios must be addressed when considering the engine performance under load, and to ensure that the throughput does not deteriorate below the target in such situations.
Business requirements also control the decision to use reliable or certified messaging. Certified messaging has an impact on performance.