AI Failure Summary ✨

Generates succinct summaries of test failures detected during the testing process. These summaries include relevant information such as error messages and impacted functionalities.

If a test run contains failures, the TestBeats portal will generate an AI failure summary and include it in the report.

Slack message showing TestBeats AI failure summary with error context.

Configuration

AI Failure Summary is enabled by default. You can disable it from the test run configuration.

{
  "api_key": "<api-key>",
  "show_failure_summary": false,
  "targets": [
    {
      "name": "slack",
      "inputs": {
        "url": "<slack-incoming-webhook-url>"
      }
    }
  ],
  "results": [
    {
      "type": "testng",
      "files": [
        "path/to/testng-results.xml"
      ]
    }
  ]
}

Next Steps

• AI Failure Signature — semantic grouping of failures
• Smart Analysis — new, flaky, and recurring failures
• Getting Started — publish results and enable portal features
• publish command — CLI reference for configuration
• CI/CD integration — run TestBeats in your pipeline