Run Reports

When you run tests with Testomat.io, the system generates a Run Report displaying your test results. You can view these reports in two ways: basic view and extended view. Let’s explore each option.

Run Report Basic View

Clicking on the Test Run will toggle RunReport screen in basic view.

On this basic report you can:

1. View a list of test cases.
2. Check their status (Passed, Failed, Skipped, Pending, Custom statuses).
3. Reiew general information on the Run Result.

4. Sort test cases by suite, test case names or failure status.
5. Filter test cases by status, type, added messages, custom statuses, or assignees.

6. Search test cases by title or message.

7. Customize test cases view - (learn more in the How to Customize Test Cases View section).

Additionally, click on any test case within the run report to open it and view its details.

Moreover, you can view the history of run results for selected test case by filtering them by group name, defects, labels or environment.

You can also check overall Statistics by suites/tags/labels/assignees/priorities/custom statuses for the selected test run.

How to Customize Test Cases View

Testomat.io allows you to customize the dispalay of test cases within a Run Report.

This geature helps you:

• Show or hide columns such as test status, duration, labels, tags, priority, etc.
• Focus only on the data most reelvant to you or your team.
• Tailor the report layout for different review needs.

To cusmozite your Run Report view, follow next steps:

1. Select any Run.
2. Click the ‘Custom view’ button to open the configurable view instantly.

3. Click the ‘Settings’ icon to access ‘Runs List Settings’.
4. Adjust Run view:

• Select/deselect columns to show only the data you need.
• Set each column width (px), to suit your preferences (or leave empty for automatic sizing).

5. Click the ‘Save’ button to apply your changes.

You can also adjust each column width manually, in this case changes will save automatically.

Note

Customized Test Cases view within a Run Report automatically applies to all Run Reports.

Run Report Extended View

If you click the ‘Report’ button from Basic Run Report view, you will see the extended view of the Run Report.

In the extended report view, you can:

1. View a list of tests.
2. Check their status (Passed, Failed, Skipped, Pending, Custom statuses).
3. See overview of all executed tests grouped by suites, tags, labels, assignees, or priorities.
4. Review the Run Report Summary.

5. Check ‘Flaky Tests’ Analytics, if applicable.

6. Sort suites by Name and Failed status (as well works for Tags, Labels, Assignees, Priorities, Custom Statuses) in the Overview widget.

7. Filter test cases by status, type, added messages, custom statuses, or assignees.

8. Search test cases by title or message.

Note

Use ↓ and ↑ keys to navigate tests and quickly view details for each test.

Similar to the basic run report view, click on a test case to see its details or the history of run results.

How to Download Run Report as Spreadsheet

Testomat.io allows you to export Run Reports as a spreadsheet (XLSX file) to obtain your test data.

Download Multiple Run Reports in One File:

1. Go to Runs.
2. Enable ‘Multi-select’.
3. Select the Runs you want to download.
4. Click the ‘Extra menu’ button.
5. Select ‘Download’ option.

Download a Separate Run Report:

1. Go to Runs.
2. Select a Run Report.
3. Click the ‘Report’ button.

4. Click the ‘Extra menu’ button.
5. Select ‘Download as Spreadsheet’ option.

How to Export Run Report in PDF Format

Testomat.io also allows you to export your test run results as a PDF report. This feature enables easy sharing and archiving of test outcomes outside of Testomat.io.

You can generate a structured PDF report with test execution details in two ways:

1. Go to Runs.
2. Select a Run Report.
3. Click the ‘Extra menu’ button.
4. Select ‘Export as PDF’ option.

OR

1. Go to Runs.
2. Select a Run Report.
3. Click the ‘Report’ button.

4. Click the ‘Extra menu’ button.
5. Select ‘Export as PDF’ option.

Example of Test Run Report in PDF format

Use cases for PDF Reports:

• Sharing results with stakeholders: Quickly generate a portable summary of test outcomes for product owners, QA managers, or external partners who may not have access to the platform.

• Audit and compliance documentation: Maintain a formal record of test results in a fixed format for compliance, certification, or audit purposes.

• Team retrospectives and reviews: Use the PDF report to review test coverage and outcomes during retrospectives or sprint reviews without relying on live access to the system.

How to Share Run Report

You can share your Run Report for external access from the Extended report view using two options: ‘Share Report by Email’ or ‘Share Report Publicly’.

Share Report by Email

1. Open Extended report view.

2. Click the ‘Extra menu’ button.
3. Select ‘Share Report by Email’ option.

4. Enter one or multiple emails, separated with commas, in the displayed modal.
5. Click the ‘Send’ button.

Note

This action also creates public report without passcode for external access.

Example of the email with Run Report

Share Report Publicly

Note

To enable the ‘Share Report Publicly’ option, first enable this feature at the Company level and then enable it on Project level (Project Settings -> Project -> ‘Sharing’ section). Check the instruction in the Share Options section on ‘Administration’ page.

1. Open Extended report view.

2. Click the ‘Extra menu’ button.
3. Select ‘Share Report Publicly’ option.

4. Select ‘Expiration Date’ (7 days is set by default).
5. ‘Protect by passcode’ is enabled by default for better security (you can disable it if needed).
6. Click the ‘Share’ button in the displayed modal.

7. Copy the URL for sharing the report.
8. Copy and share the Passcode with the link.

Note

Copy and save the Passcode in a secure place. For security reasons, you will not be able to see it again after the Run Report Public URL is generated.

If a shared run report is protected with a Passcode, only users with the valid Passcode will have access to it.

9. Copy and share the Expiration date, if needed.

After the Run Report Public URL is generated, ‘Share’ button will be displayed on the Extended run report page.

Note

You can stop sharing at any time by clicking the ‘Stop Sharing’ button.

Users with access to ‘Public Run Report’ can:

1. Filter test cases by statuses.
2. Search test cases by name.
3. Copy the URL for sharing the Run report.
4. Check ‘Full Report’ (only users with project access).

Compare Test Runs

Select test runs to see a visual display of their similarities and differences. Compare your run reports and analyze them by parameters such as Flaky, Reviewed, Degraded, and more.

To compare Runs:

1. Enable Multiselection.
2. Select the Runs you want to compare.
3. Click the ‘Compare’ button.

This feature is also available for RunGroups, allowing you to compare test results from different runs within a single RunGroup.

1. Open RunGroup.
2. Click the ‘Combined Report’ button.

3. Click the ‘Compare to’ button to select the run you want to compare with others.

Note

The ‘Combined Report’ feature for RunGroups does not combine test results of all runs inside one RunGroup into a single report. It only allows you to compare test results of all runs within this RunGroup.