ReportPortal - Find Out Why Your Automated Tests Fail

Looking for a dashboard that is easy to install and use? Need to categorize automated test results and create great charts? Wish it be free? ReportPortal is an easy-to-use dashboard with a focus on automated testing.

With it you can get all the advantages of Elastic Search and Grafana like dashboards in an almost one-click solution out of the box.

Real-Time Report

One of the important advantages of the ReportPortal is its real-time reporting. This is a great time-saving feature. Sometimes the team is waiting to start reviewing their test results, or they excuse that they don't have time to debug. Using this solution, they can start to view the results in the dashboard a few seconds after the start of execution, enabling real-time debugging. This means that if test cases start to fail due to environmental issues or incorrect builds, etc., instead of waiting until the next day to find out, the problem can be checked in a few seconds. This allows you to take quick action to stop the bad operation and restart it without wasting hours or days.

Test Automation Classification Center

The ReportPortal was also created as a single entry point for all test automation and team project results, becoming an excellent center for managers and test engineers.

Categorize Automated Test Failures

The portal has a feature that allows the classification of test failures, which means I can enter and set the failure as a defect, or mark it as a system problem. Now anyone who is logged in can scan and see which tests still need to be investigated. In the lunch section, test engineers can analyze, group and mark tests according to the type of failure. Therefore, all future runs and builds can tell you if you are in Jira or any other bug tracking system.

You will see that the error already exists. It can also show, for example, whether it is on or off, and you can also view all comments.

Artificial Intelligence Machine Learning

With the latest version of Report Portal, you can use machine learning algorithms to help you automatically analyze the results. The machine learning algorithm uses all the historical data already in the project dashboard database. This means that it can analyze your latest execution, and you can have confidence in the state of the test case.

This feature is a huge time saver. In some projects it reduces failure analysis time by as much as 90%—the time the team used to spend on reports and results analysis. You can view all the content about the test: history, log, screenshots - all in one place.

For managers, the dashboard contains all the statistics you might need and beautiful candy charts. You can set up an execution panel based on widgets, which can well display any KPI indicators used by your company. All this means that automation engineers can quickly and easily classify their tests, and managers can see the high-level KPIs they desire in one place.

To find out more watch the video about the new ML-based analyzer in version 5.1 and its improvements in version 5.4.

ReportPortal Is Easy Customizable

Making this tool customizable is an important goal of the team developing the reporting portal. Since their vision was to make it open source, they considered this from the beginning.

To achieve this, they built it using a microservice architecture, which makes customization easy because you can use their API to place your own microservices. Your microservice will work like any other built-in microservice.

To view all API possibilities in the reporting portal, you can click on your profile menu option and API in the drop-down list to view Swagger. This will describe the available API array and all the methods behind the portal.

Being able to make requests to these APIs also enables ReportPortal to integrate into your CI/CD pipeline and create triggers for different actions in tools such as your CI system.

How Scalable Is The Reporting Portal

ReportPortal can handle almost any integration. The portal has been even integrated with the Silk Test agent, which allows Silk to send legacy results within the reporting portal. Since it is open source, you can view all the code at the same time, which means you can change the code and contribute to the project.

Between the API and the fact that everything works through the HTTP channel, you can integrate any solution that triggers a specific event. This is easy, and in most cases, the lead engineer only needs to spend a few hours implementing the adapter from scratch.

Which Automation Framework Integrations Are Supported

ReportPortal already has a lot of integrations available, so you don't even need to worry about this. If they are not integrated with the framework you use, they are easy to find on a Github.

The following are some of the supported out-of-the-box integrations:

• TestNG

• JUnit

• Cucumber-JVM (Java)

• ScalaTest

• Cucumber

• Node.js client

• NUnit

• Specflow

• SoapUI

So if you are looking for an open source dashboard solution specifically designed for automated testing, you should consider ReportPortal as a great option. But if you still have doubts watch their video describing benefits in the latest released versions.