Managing Runs

Reports

When you run tests with Testomat.io it will generate a Run Report with the results. We have such options as basic view and extended view. Let's have a look at each of them.

Basic view

Clicking on the Test Run will toggle RunReport screen in basic view.

Here you can see 1. a list of tests, 2. their status (Passed/ Failed/ Skipped), 3. general information on the Run Result.

Also, you can click on test and open it to see details.

Extended view

If you click on Report button you will see the extended view of the Run Report.

You can see such options here: 1. a list of tests 2. overview of all executed tests 3. Report Summary.

If you hover your tests in Overview field you will see a summary of the test and its status. Also, you can click on a test and see its details.

You can use ↓ and ↑ keys to navigate the tests and have a quick view of details for each test.

RunGroups

You can group your Runs within Testomat.io. To do this you need to click on New Group button

On New RunGroup screen you need

1. Choose a group type
2. Add a Name of a group
3. Choose Merge strategy
4. Click on Save button

A New RunGroup will appear on Runs page

To put Manual Run to a RunGroup you need to open it and click on Add Manual Run button

To put an Automated Run to a RunGroup you need to execute your tests with Testomat.io providing TESTOMATIO_RUNGROUP_TITLE="Build ${BUILD_ID}".

Now you can see Test Runs in a created RunGroup

Merge Strategy

With Testomat.io you can use different Merge Strategies for Test Runs analysis. It helps to aggregate results when a group contains multiple runs.

You can use it when merging few Runs:

Or when you add/edit RunGroup

Merge Runs

With Testomat.io you can merge your Test Runs. To do this you need to choose Test Runs you want to merge and click on Merge button on the top of the page

Here you will need to 1. Select testing Environment 2. Enter a name for merged run 3. Choose a Merging Strategy 4. Click on Merge button

Your merged run will appear in the list of runs on the Runs page

Relaunch Runs

For some reason, you may need to re-check some tests in your Run manually. You can use Relaunch Run options for such cases. To do this you need to 1. click on the menu button and 2. click on Relaunch manually button

Your Test Run will open in Manual Run window and you will be able to re-check tests and change their status:

When you finish you need to click on Finish button. You will see tests with new status and new Run Status

Also, your Test Run will contain updated information on its results: You will see a changed tag and Run status.

Launch a Copy

If you need need to re-check some tests in your Run manually, but for some reason, you want to save this Test Run you can use Launch a copy option. To do this you need to 1. click on the menu button and 2. click on Launch a Copy Manually button.

Your Test Run will open in Manual Run window and you will be able to re-check tests and change their status:

When you finish you need to click on Finish button. You will see a new Test Run tests with new status and new Run Status:

On the Runs page you will see a copy of your Test Run with new tests results: