NightlyBuild issueshttps://gitlab.psi.ch/OPAL/NightlyBuild/-/issues2022-08-22T16:29:47+02:00https://gitlab.psi.ch/OPAL/NightlyBuild/-/issues/33Summary of the regression test does not show all results2022-08-22T16:29:47+02:00ext-calvo_ppedro.calvo@ciemat.esSummary of the regression test does not show all resultsThe summary of regression-tests summary in [amas-opal home page](http://amas.web.psi.ch/opal/master/) does not count all the test. The sum of passed, failed, disabled and broken tests does not add up to the total. However, if you click i...The summary of regression-tests summary in [amas-opal home page](http://amas.web.psi.ch/opal/master/) does not count all the test. The sum of passed, failed, disabled and broken tests does not add up to the total. However, if you click into to [regression-tests page](http://amas.web.psi.ch/opal/regressionTests/master/results_2022-07-27_10-49.xml), the test summary is correct. It happens since 2022-07-27.
It seems that the results printed at the main page is not counting regression test failures based on loss files. This may be related to the fact that losstest.py doesn't include a section for "result generation" that prints the status of the test, as it is done in [stattest.py](https://gitlab.psi.ch/OPAL/NightlyBuild/-/blob/master/scripts/OpalRegressionTests/stattest.py#L98) and [outtest.py](https://gitlab.psi.ch/OPAL/NightlyBuild/-/blob/master/scripts/OpalRegressionTests/outtest.py#L198)
It isn't a critical issue, but it would be nice to fix it to prevent possible test failures not reported on the main pagehttps://gitlab.psi.ch/OPAL/NightlyBuild/-/issues/7`last` value can still be evaluated when simulation and reference file have d...2018-01-10T11:15:53+01:00snuverink_jjochem.snuverink@psi.ch`last` value can still be evaluated when simulation and reference file have different number of linesIn case the simulation and reference (stat) file have a different number of lines the test is marked as broken. However, in case the `last` value is asked for the test can still be evaluated.
Evaluating the test in this case would give ...In case the simulation and reference (stat) file have a different number of lines the test is marked as broken. However, in case the `last` value is asked for the test can still be evaluated.
Evaluating the test in this case would give more information and might even result in a successful test.