Selective TestingΒΆ
In some cases it might be difficult to execute the test cases of a project in the predefined order. Therefore it may be necessary to execute the test cases in a different order. Additionally, it may be required to run certain tests at a later time or at least after a significant break. For reasons of documentation it is, however, still required to have a single project report.
Combining all those requirements, ecu.test offers the option of selective testing. Choosing this option does not start the execution immediately but just opens the following execution dialog.
When selecting a test case its preview is shown as in the picture above. The test cases of the project can then be executed individually in arbitrary order (and repeatedly as well) with the Play button next to them. Executing a group of test cases is also possible by checking them and start the execution with the Play button at the bottom of the dialog.
Info
Currently, only projects that contain folders, package references and parameter sets are suitable for selective testing.
To resume the selective project execution at a later time, the current execution may be ended with the Continue later button and be started again by choosing selective execution again.
Info
Projects may not be changed between the first selective execution and finishing the execution to ensure the significance of the report.
Info
If the project is changed, resuming an already executed selective project is not possible. However, it cannot be detected if packages which are referenced in the project are changed. Thus, if the package reference already has an evaluation it will be preserved.
To resume a specific execution, the dialog offers to select all started executions of this project as well as the option to start a new one. The execution which was modified most recently is chosen by default.
The evaluation column of the project shows which test cases were already executed. The test cases that were executed in the current session are highlighted in bold letters.
Executions can be finished using the butten next to the execution selection. This action removes the execution from the list.