Save Yourself Some Work and Get a Great Load Test Report, Even from JMeter
So the test is finally done and it is time to analyze and optimize, right? No? What do you need to do after a JMeter test to evaluate its results?
You know how the result of a JMeter load test is a few xml or csv files... and that's it. In practice, that often means that the tester looks at the numbers and “evaluates the important stuff.” That also usually means that some other “important stuff” is missing and the test is essentially worthless. That's not real reporting or analysis.
You can try to visualize the results by filling listeners with the output files and saving them as a graph or table (but only if the listener saves the log to the disk, otherwise you won't see anything). But even if everything works as it should, then you only see individual parts and not a holistic view of the results. That's a lot of work for a pretty paltry outcome.
This should just be a lot easier.
- Also read: Other improvements to JMeter load testing
Would You Like a One-Click Test Report?
During the test, you can see live status of everything you'd have to search for in a pile of numbers in JMeter's results.
Once the test is done, the load test report is generated with one-click on button.
- Check out this example report.
You can easily compare multiple graphs using the intersection tool in the right bottom corner. Pinpoint the exact moment on a graph and compare it with the other graphs. This allows you to discover unexpected connections.
Acceptance criteria
Acceptance criteria enables auto-evaluation of test results. Quickly see if they were met or not. Red color means a failure. Take advantage of continuous integration tools to evaluate tests on your behalf!
Errors overview
When an error occurs, you need to see a full detail of it - requested URL, request headers and body, response code, headers and body and assertion message. Everything is included in the SmartMeter.io report.
Trend Analysis
Are you running your tests multiple times or as a part of your CI pipeline? If so, you will appreciate the Trend analysis page. No configuration is required, trends are formed automatically based on the test script file name.
Getting report from JMeter
Load a log file from JMeter (.jtl file) in an XML format to Report Generator and get a report with one-click. SmartMeter.io 1.5.0 or newer is required.
- Open SmartMeter.io Editor (Create/Edit Scenario on Welcome screen).
- Right-click on WorkBench (the last element in the component tree on the left).
- Select Add / Non-Test Elements / et@sm - Report Generator.
- Click Browse and select the JMeter log file.
- Optionally, click Browse and select the test script file (to evaluate acceptance criteria and get Trend analysis).
- Click
button.
Alternatively, run your JMeter test script in SmartMeter.io and get the test report the usual way, or easily create a new one. Check out the Quick guide to get some starting tips.
And There’s More
The entire report, log, and test itself are backed-up while the report is created. This means you'll never lose old results and can compare them to new ones.
You can also customize the report, because its template is a simple html file that makes it easy to add your corporate logo or use the right colors to make it stand out in a presentation.
If you're missing something, or something is not relevant, you can re-generate it and set exactly what you want to see, but more on that another time.
Now, get to testing!
