Compare test results

Compare test results

Compare results in the GUI

NeoLoad graphical interface includes a Compare mode.

This makes it possible to compare the results of two tests. The more similar the designs of the Virtual Users are in both tests, the more relevant comparing the results is. It is advised to compare two test results with the same User Paths, but with different scenarios (different load policies, different durations, and so on).

Launch a comparison

  1. Open the Results Manager from the Edit > Results Manager menu.
  2. In the table, select the two results to compare.
  3. Click on the Compare button.
  4. Edit the labels of the two tests and click OK. The default labels are "A" and "B".
Use the GUI

The Summary, Values and Graphs tabs switch to the Compare mode. The Errors and Details tabs are superfluous and are therefore disabled.

In the Compare mode, only the statistics for Avg, Max and Err are displayed, together with the value in the first test, value in the second test, and percentage difference for each item.

Percentages color coding

The percentages are displayed in different colors depending on whether the statistic performance has improved or deteriorated:

Consequently, a positive percentage (+20%) will be color-coded differently, depending on the context: for example, red in the case of a time delay or green in the case of Hits/sec.

Return to Standard mode

To quit the Compare mode, it is only necessary to call up a single test result:

Generate a comparison report

NeoLoad can generate comparison reports with the same structure and in the same formats (Word, HTML, PDF, and XML) as standard reports.

In the Compare mode, only the statistics for Avg, Max and Err are displayed, together with the value in the first test, value in the second test, and percentage difference for each item.

  1. Open the Results Manager from the Edit > Results Manager menu.
  2. In the table, select the two results to compare.
  3. Click on the Generate a report button.
  4. Edit the labels of the two tests and click OK. The default labels are "A" and "B".