Test Plans

Test Plan is a detailed document that outlines the testing strategy, objectives, schedule, resources, and scope of a testing effort. It acts as a blueprint for how testing will be conducted, ensuring all stakeholders are aware of what will be tested, when, how, and by whom. A well-defined test plan is essential for ensuring product quality and aligning the testing process with project goals.

To create a test plan in Testomat.io, go to the Plans page and click the + button. The Plans page allows to search and filter previously created plans. You can also view and edit test cases that contain plans.

After that, you should select the type of plan you want to create:

• Manual - Test plan for manual test runs
• Automated - Test plan for automated test runs on CI
• Mixed - Automated tests on CI combined with manual run

Manual

By choosing manual plan, you can easily customize your selection of test cases:

• Select test cases by Checking Tests & Suites
• Select test cases by Tags
• Select test cases by Labels
• Select test cases by Query

For more details on using the Query Language, visit the dedicated page.

Additionally, you can run your Automated tests as Manual using a toggle switch.

Automated

By choosing automated plan, you need to configure Continuous Integration. Also, tests need to have IDs. This can be done by adding the --update-ids option when importing tests.

To learn how to set up Continuous Integration in Testomat.io, visit the dedicated page.

After running tests via CI, the report will be sent to Testomat.io. You can view it on the Runs page.

Automated run report:

A Plan ID can also be used to run an Automated Plan. To learn how to do this, visit the Filter Test page (currently available for Playwright and CodeceptJS frameworks).

Mixed

Mixed Plan is a combination of automated and manual tests. Automated tests are running in Continuous Integration, while you run manual tests in parallel. As a result, you get one report for both automated and manual runs.