Failure Analysis
TestBeats provides a streamlined approach for test failure analysis and defect management. It helps teams investigate test failures, categorize defects, and track issues efficiently, enhancing overall test observability.
Test Failure Categories
Product Bug
Issues related to defects or faults in the software product itself that impact its functionality, performance, or usability.
Environment Issue
Problems arising from the environment where the software is deployed, including hardware, software dependencies, and network conditions.
Automation Bug
Issues encountered during automated testing processes, affecting the execution or reliability of automated test scripts.
Not a Defect
Cases where reported issues are determined not to be defects in the software, often due to resolution or misinterpretation.
How to investigate failures?
- Navigate to the test run in TestBeats portal.
- Click on the test case name to view the test details.
- Click on "Add Failure Analysis" under Failure Analysis tab.
- Select the appropriate failure category and write a description of the issue.
- Click on "Update" to submit the failure analysis.
Automated Failure Analysis
Once the failure has been analyzed, the system will automatically analyze any subsequent test runs. If a test case fails with a similar error, it will attach the appropriate categories based on the previous analysis.
Notes
INFO
This feature is inspired from Report Portal.