Workflows

List of CI configurations which include Testomat.io Reporter

GitHub Actions and CodeceptJS

Execute CodeceptJS in parallel mode with 2 wokers and report data to Testomat.io Application. This workflow will be executed from Testomat.io Application when you click “Run on CI”

name: CodeceptJS Tests

on:
  workflow_dispatch:
    inputs:
      grep:
        description: 'A grep '
        required: false
        default: ''
      testomatio:
        required: false
      run:
        required: false

jobs:
  build:
    runs-on: ubuntu-latest

    steps:
      - uses: actions/checkout@v2
      - name: Setup node
        uses: actions/setup-node@v1
        with:
          node-version: 16.x
      - run: npm i
      - run: npx start-test-run -c 'npx codeceptjs run-workers 2 --grep "${{ github.event.inputs.grep }}"'
        env:
          TESTOMATIO: '${{ github.event.inputs.testomatio }}'
          TESTOMATIO_RUN: '${{ github.event.inputs.run }}'

Azure Pipelines and CodeceptJS

Simple workflow for CodeceptJS and Azure

trigger:
  - master

pool:
  vmImage: ubuntu-latest

steps:
  - task: NodeTool@0
    inputs:
      versionSpec: '16.x'
    displayName: 'Install Node.js'

  - script: |
      npm install
      TESTOMATIO=$(testomatio) npx codeceptjs run --grep="$(grep)"
    displayName: 'run tests'

Enable testomatio variable inside Azure Pipelines config to pass this value

GitHub Actions and MiniTest

GitHub Actions workflow that uses Testomat.io Reporter to send results from Minitest to Testomat.io Application and add comment to GitHub pull request:

name: CI

on:
  pull_request:

jobs:
  test:
    name: Tests
    runs-on: ubuntu-latest
    steps:
      - name: Checkout code
        uses: actions/checkout@v2

      - name: Setup node
        uses: actions/setup-node@v1

      - name: install nodejs deps
        run: npm i

      - name: install ruby deps
        run: bundle install

      # all required preperations

      - name: test
        run: bundle exec rails test
        env:
          RAILS_ENV: test
      - name: Testomatio Report
        run: npx report-xml "test/reports/**.xml" --lang=Ruby
        if: always()
        env:
          TESTOMATIO: ${{ secrets.TESTOMATIO }}
          TESTOMATIO_RUN: 'PR ${{ github.event.number }} ${{ github.event.pull_request.title }}'
          GH_PAT: ${{ github.token }}

GitHub Actions and PHPUnit

GitHub Actions workflow that uses Testomat.io Reporter to send results from Minitest to Testomat.io Application and add comment to GitHub pull request:

name: CI

on:
  pull_request:

jobs:
  test:
    name: Tests
    runs-on: ubuntu-latest
    steps:
      - name: Checkout code
        uses: actions/checkout@v2

      - name: Install dependencies
        run: composer install

      # all required preparations

      - name: Run PHPUnit tests
        run: vendor/bin/phpunit --log-junit=report.xml

      - name: Testomatio Report
        run: npx report-xml report.xml --lang=PHP
        if: always()
        env:
          TESTOMATIO: ${{ secrets.TESTOMATIO }}
          TESTOMATIO_TITLE: 'PR ${{ github.event.number }} ${{ github.event.pull_request.title }}'
          GH_PAT: ${{ github.token }}

GitHub Actions and Cypress (trigger = PR)

Execute Cypress tests and report data to Testomat.io Application after each pull request:

name: Cypress reporting

on:
  pull_request:

jobs:
  reporting:
    runs-on: ubuntu-latest

    strategy:
      matrix:
        node-version: [18.x]

    steps:
      - uses: actions/checkout@v3
      - name: Use Node.js ${{ matrix.node-version }}
        uses: actions/setup-node@v3
        with:
          node-version: ${{ matrix.node-version }}

      - name: Setup dependencies
        run: npm i

      - name: Run tests
        run: npx cypress run
        env:
          TESTOMATIO: '${{ secrets.TESTOMATIO }}'
          TESTOMATIO_TITLE: 'PR ${{ github.event.number }} ${{ github.event.pull_request.title }}'

GitHub Actions and Cypress (trigger = click “Run Automated Tests on CI”)

Execute Cypress tests and report data to Testomat.io Application. This workflow will be executed from Testomat.io Application when you click “Run on CI”:

name: Cypress reporting

on:
  workflow_dispatch:
    inputs:
      grep:
        required: false
        default: ''
      run:
        required: false
      testomatio:
        required: false
      testomatio_url:
        required: false

jobs:
  reporting:
    runs-on: ubuntu-latest

    strategy:
      matrix:
        node-version: [18.x]

    steps:
      - uses: actions/checkout@v3
      - name: Use Node.js ${{ matrix.node-version }}
        uses: actions/setup-node@v3
        with:
          node-version: ${{ matrix.node-version }}

      - name: Setup dependencies
        run: npm i

      - name: Run tests
        run: npx cypress run
        env:
          TESTOMATIO: '${{ secrets.TESTOMATIO }}'
          TESTOMATIO_RUN: '${{ github.event.inputs.run }}'

GitHub Actions and Playwright (trigger = PR)

Execute Playwright tests and report data to Testomat.io Application after each pull request:

name: Playwright reporting

on:
  pull_request:

jobs:
  reporting:
    runs-on: ubuntu-latest

    strategy:
      matrix:
        node-version: [18.x]

    steps:
      - uses: actions/checkout@v3
      - name: Use Node.js ${{ matrix.node-version }}
        uses: actions/setup-node@v3
        with:
          node-version: ${{ matrix.node-version }}

      - name: Setup dependencies
        run: npm i

      - name: Playwright browser updates
        run: npx playwright install

      - name: Run tests
        run: npx playwright test
        env:
          TESTOMATIO: '${{ secrets.TESTOMATIO }}'
          TESTOMATIO_TITLE: 'PR ${{ github.event.number }} ${{ github.event.pull_request.title }}'

GitHub Actions and Playwright (trigger = click “Run Automated Tests on CI”)

Execute Playwright tests and report data to Testomat.io Application. This workflow will be executed from Testomat.io Application when you click “Run on CI”:

name: Playwright reporting

on:
  workflow_dispatch:
    inputs:
      grep:
        description: 'tests to grep '
        required: false
        default: ''
      run:
        required: false
      testomatio:
        required: false
      testomatio_url:
        required: false

jobs:
  reporting:
    runs-on: ubuntu-latest

    strategy:
      matrix:
        node-version: [18.x]

    steps:
      - uses: actions/checkout@v3
      - name: Use Node.js ${{ matrix.node-version }}
        uses: actions/setup-node@v3
        with:
          node-version: ${{ matrix.node-version }}

      - name: Setup dependencies
        run: npm i

      - name: Playwright browser updates
        run: npx playwright install

      - name: Run tests
        run: npx playwright test --grep "${{ github.event.inputs.grep }}"
        env:
          TESTOMATIO: '${{ secrets.TESTOMATIO }}'
          TESTOMATIO_RUN: '${{ github.event.inputs.run }}'

…more examples are coming