Managing Runs

Reports

When you run tests with Testomat.io it will generate a Run Report with the results. We have such options as basic view and extended view. Let's have a look at each of them.

Basic view

Clicking on the Test Run will toggle RunReport screen in basic view.

33

Here you can see 1. a list of tests, 2. their status (Passed/ Failed/ Skipped), 3. general information on the Run Result.

333

Also, you can click on test and open it to see details.

3333

Extended view

If you click on Report button you will see the extended view of the Run Report.

33333

You can see such options here: 1. a list of tests 2. overview of all executed tests 3. Report Summary.

333333

If you hover your tests in Overview field you will see a summary of the test and its status. Also, you can click on a test and see its details.

33333333

You can use ↓ and ↑ keys to navigate the tests and have a quick view of details for each test.

3333333

RunGroups

You can group your Runs within Testomat.io. To do this you need to click on New Group button

4

On New RunGroup screen you need

  1. Choose a group type
  2. Add a Name of a group
  3. Choose Merge strategy
  4. Click on Save button

44

A New RunGroup will appear on Runs page

444

To put Manual Run to a RunGroup you need to open it and click on Add Manual Run button

4444

To put an Automated Run to a RunGroup you need to execute your tests with Testomat.io providing TESTOMATIO_RUNGROUP_TITLE="Build ${BUILD_ID}".

Now you can see Test Runs in a created RunGroup

44444

Merge Strategy

With Testomat.io you can use different Merge Strategies for Test Runs analysis. It helps to aggregate results when a group contains multiple runs.

You can use it when merging few Runs:

5

Or when you add/edit RunGroup

55

Merge Runs

With Testomat.io you can merge your Test Runs. To do this you need to choose Test Runs you want to merge and click on Merge button on the top of the page

6

Here you will need to 1. Select testing Environment 2. Enter a name for merged run 3. Choose a Merging Strategy 4. Click on Merge button

66

Your merged run will appear in the list of runs on the Runs page

666

Relaunch Runs

For some reason, you may need to re-check some tests in your Run manually. You can use Relaunch Run options for such cases. To do this you need to 1. click on the menu button and 2. click on Relaunch manually button

7

Your Test Run will open in Manual Run window and you will be able to re-check tests and change their status:

77

When you finish you need to click on Finish button. You will see tests with new status and new Run Status

777

Also, your Test Run will contain updated information on its results: You will see a changed tag and Run status.

7777

Launch a Copy

If you need need to re-check some tests in your Run manually, but for some reason, you want to save this Test Run you can use Launch a copy option. To do this you need to 1. click on the menu button and 2. click on Launch a Copy Manually button.

8

Your Test Run will open in Manual Run window and you will be able to re-check tests and change their status:

88

When you finish you need to click on Finish button. You will see a new Test Run tests with new status and new Run Status:

888

On the Runs page you will see a copy of your Test Run with new tests results:

8888