Regression Test Output Window


The Regression Test Output window provides you with all the projects, algorithms, and expected results you selected along with the actual results obtained by running the algorithms on the projects. The window is separated into 4 sections: the All Results, Unexpected, and Errors tabs, and the Summary.

The All Results tab displays a list of all projects, each with the algorithms run on them. The third column is the Actual results column, which can display "Pass", "Fail", "Error", or "Integrity Error" for each algorithm or subsystem. The Regression Test Suite only runs an algorithm on a project once, so if tests containing the same information were run, only one copy of the results are included.

RegTestAllResults_scaled.png

If an algorithm's expected result is different than the result obtained by the Regression Test, it is added to the Unexpected tab. This tab also includes algorithms that have experienced errors. The Unexpected tab provides a concise view of where problems may lie in modified DESpot code or in a projects implementation.

RegTestUnexpected_scaled.png

The Errors tab filters the algorithms that recieved an "Error" or "Integrity Error" result from the test. To obtain more detail on why the error occurred, the algorithm could be run on the project in DESpot's Project Editor. If a project fails the integrity check, all remaining algorithms for the project will not be run and instead labeled with "Integrity Error".

RegTestErrors_scaled.png

The Summary on the right hand side of the window provides a quick-look at the testing results. If the Regression Test Editor that created the Regression Test Output is closed, the output window will also be closed.

If a project's saved location has changed and the Regression Test Editor is unable to locate the project, the project will be labelled with "Project not found" in the All Results and Errors tabs.


« Save a Regression Test