Managing Runs

Reports

When you run tests with Testomat.io it will generate a Run Report with the results. We have such options as basic view and extended view. Let's have a look at each of them.

Basic view

Clicking on the Test Run will toggle RunReport screen in basic view.

Here you can see 1. a list of tests, 2. their status (Passed/ Failed/ Skipped), 3. general information on the Run Result.

333

Also, you can click on test and open it to see details.

3333

Extended view

If you click on Report button you will see the extended view of the Run Report.

33333

You can see such options here: 1. a list of tests 2. overview of all executed tests 3. Report Summary.

333333

If you hover your tests in Overview field you will see a summary of the test and its status. Also, you can click on a test and see its details.

33333333

You can use ↓ and ↑ keys to navigate the tests and have a quick view of details for each test.

3333333

RunGroups

You can group your Runs within Testomat.io. To do this you need to click on New Group button

On New RunGroup screen you need

Choose a group type
Add a Name of a group
Choose Merge strategy
Click on Save button

A New RunGroup will appear on Runs page

444

To put Manual Run to a RunGroup you need to open it and click on Add Manual Run button

4444

To put an Automated Run to a RunGroup you need to execute your tests with Testomat.io providing TESTOMATIO_RUNGROUP_TITLE="Build ${BUILD_ID}".

Now you can see Test Runs in a created RunGroup

44444

Merge Strategy

With Testomat.io you can use different Merge Strategies for Test Runs analysis. It helps to aggregate results when a group contains multiple runs.

You can use it when merging few Runs:

Or when you add/edit RunGroup

Merge Runs

With Testomat.io you can merge your Test Runs. To do this you need to choose Test Runs you want to merge and click on Merge button on the top of the page

Here you will need to 1. Select testing Environment 2. Enter a name for merged run 3. Choose a Merging Strategy 4. Click on Merge button

Your merged run will appear in the list of runs on the Runs page

666

Relaunch Runs

For some reason, you may need to re-check some tests in your Run manually. You can use Relaunch Run options for such cases. To do this you need to 1. click on the menu button and 2. click on Relaunch manually button

Your Test Run will open in Manual Run window and you will be able to re-check tests and change their status:

When you finish you need to click on Finish button. You will see tests with new status and new Run Status

777

Also, your Test Run will contain updated information on its results: You will see a changed tag and Run status.

7777

Launch a Copy

If you need need to re-check some tests in your Run manually, but for some reason, you want to save this Test Run you can use Launch a copy option. To do this you need to 1. click on the menu button and 2. click on Launch a Copy Manually button.