Azure DevOps (Pipelines)

Azure Pipelines automatically builds and tests code projects to make them available to others. It works with just about any language or project type. Azure Pipelines combines continuous integration (CI) and continuous delivery (CD) to test and build your code and ship it to any target.

Using this tool in Azure Pipelines is very easy and straightforward. Most of the azure build agents has Node.js installed by default. So just add a custom script in your yaml file to publish test results - npx testbeats publish -c path/to/report.json

Example

Let’s look at an example of running Java TestNG automation tests.

pipeline.yaml

Make sure to add continueOnError: true in the maven task.

pool:
  vmImage: windows-latest

steps:
  - task: JavaToolInstaller@0
    inputs:
      versionSpec: '11'
      jdkArchitectureOption: x64
      jdkSourceOption: PreInstalled
  - task: Maven@3
    displayName: Running Tests
    continueOnError: true
    inputs:
      mavenPomFile: pom.xml
      publishJUnitResults: true
      testResultsFiles: '**/surefire-reports/TEST-*.xml'
      javaHomeOption: JDKVersion
      mavenVersionOption: Default
      mavenAuthenticateFeed: true
      effectivePomSkip: false
      options: test -Dsurefire.suiteXmlFiles=resources/testng.xml
  - script: npx testbeats publish -c resources/report.json
    displayName: Reporting Results
    env:
      BUILD_URL: $(System.TeamFoundationCollectionUri)$(System.TeamProject)/_build/results?buildId=$(Build.BuildId)

report.json

Notice, how we are using the environment variable BUILD_URL in the report.json file.

{
  "targets": [
    {
      "name": "teams",
      "inputs": {
        "url": "<teams-url>",
        "publish": "test-summary-slim"
      },
      "extensions": [
        {
          "name": "hyperlinks",
          "inputs": {
            "links": [
              {
                "text": "Logs",
                "url": "{BUILD_URL}"
              }
            ]
          }
        }
      ]
    }
  ],
  "results": [
    {
      "type": "testng",
      "files": [
        "target/surefire-reports/testng-results.xml"
      ]
    }
  ]
}