regression-tests issueshttps://gitlab.psi.ch/OPAL/regression-tests/-/issues2020-04-30T12:31:18Zhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/83Regression tests for optimizer and sampler2020-04-30T12:31:18Zfrey_mRegression tests for optimizer and samplerAs discussed in https://gitlab.psi.ch/OPAL/src/issues/496, it would be good to have regression tests for the optimizer and sampler where we test, for example, the objective functionality.As discussed in https://gitlab.psi.ch/OPAL/src/issues/496, it would be good to have regression tests for the optimizer and sampler where we test, for example, the objective functionality.https://gitlab.psi.ch/OPAL/regression-tests/-/issues/82Remove Envelope Tracker Test2020-04-23T13:45:27Zsnuverink_jjochem.snuverink@psi.chRemove Envelope Tracker TestNow that the envelope tracker has been removed (src#520), the corresponding regression test can also be removed.Now that the envelope tracker has been removed (src#520), the corresponding regression test can also be removed.snuverink_jjochem.snuverink@psi.chsnuverink_jjochem.snuverink@psi.chhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/81There is no test for 3D field maps2020-04-14T09:10:57ZkrausThere is no test for 3D field mapsAdd tests that make use of all kinds of field maps also 3D field maps.Add tests that make use of all kinds of field maps also 3D field maps.krauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/80There is no test for elements placed in 3D2020-04-12T11:10:38ZkrausThere is no test for elements placed in 3DAdd a regression test where some elements are placed in 3D.Add a regression test where some elements are placed in 3D.krauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/79There is no test for TRACKBACK2020-08-10T12:27:05ZkrausThere is no test for TRACKBACKAdd a regression test for TRACKBACK=TRUE.Add a regression test for TRACKBACK=TRUE.krauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/78AMR regression tests2020-04-14T14:04:54Zfrey_mAMR regression testsPart of OPAL/src#496.Part of OPAL/src#496.frey_mfrey_mhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/77GasStripping test broken2020-02-24T13:02:40Zext-calvo_ppedro.calvo@ciemat.esGasStripping test brokenGasStripping test broken after src!284 due to RF output dataGasStripping test broken after src!284 due to RF output dataext-calvo_ppedro.calvo@ciemat.esext-calvo_ppedro.calvo@ciemat.eshttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/76cleanup VFFA-12019-12-13T14:54:43Zgsellcleanup VFFA-1gsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/75enable/disable tests2019-10-30T13:38:39Zgsellenable/disable testsFor the time being tests to be run are listed in a configuration file. There is no information in the directory of a test whether it is enabled or disabled. Some tests are "disabled" by adding a postfix `-fixme` but this postfix is not checked at all.
Proposed solution: disable a test by creating a file named `disabled` in the regression test directoryFor the time being tests to be run are listed in a configuration file. There is no information in the directory of a test whether it is enabled or disabled. Some tests are "disabled" by adding a postfix `-fixme` but this postfix is not checked at all.
Proposed solution: disable a test by creating a file named `disabled` in the regression test directorygsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/74add dks and gnuplot to list of to be loaded modules2019-10-30T13:02:25Zgselladd dks and gnuplot to list of to be loaded modulesgsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/73implement argument passing2019-10-30T12:57:49Zgsellimplement argument passingMost regression do not accept arguments. But passing of argument is required e.g. to run the some test with/-out DKS. In this case we have to pass `--use-dks` to OPALMost regression do not accept arguments. But passing of argument is required e.g. to run the some test with/-out DKS. In this case we have to pass `--use-dks` to OPALgsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/72GasStripping fails2019-10-15T06:43:50Zext-calvo_ppedro.calvo@ciemat.esGasStripping failsThe regression test GasStripping in OPAL-2.0 fails due to !177 (merged)
Before http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-09-19.xml)
After http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-10-09.xmlThe regression test GasStripping in OPAL-2.0 fails due to !177 (merged)
Before http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-09-19.xml)
After http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-10-09.xmlext-calvo_ppedro.calvo@ciemat.esext-calvo_ppedro.calvo@ciemat.eshttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/71Cyclotron RestartTest-2 fails2019-09-16T12:03:27Zfrey_mCyclotron RestartTest-2 failsThe regression test RestartTest-2 fails due to https://gitlab.psi.ch/OPAL/src/merge_requests/170
Before: http://amas.web.psi.ch/opal/regressionTests/master/results_2019-09-09.xml
After: http://amas.web.psi.ch/opal/regressionTests/master/results_2019-09-13.xmlThe regression test RestartTest-2 fails due to https://gitlab.psi.ch/OPAL/src/merge_requests/170
Before: http://amas.web.psi.ch/opal/regressionTests/master/results_2019-09-09.xml
After: http://amas.web.psi.ch/opal/regressionTests/master/results_2019-09-13.xmlfrey_mfrey_mhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/70wrong md5sum's for tests Restart-2 and RingCyclotronMTS2019-07-17T10:57:17Zgsellwrong md5sum's for tests Restart-2 and RingCyclotronMTSIn the tests Restart-2 and RingCyclotronMTS the lbal reference files has been changed but the md5 sum has not been updatedIn the tests Restart-2 and RingCyclotronMTS the lbal reference files has been changed but the md5 sum has not been updatedgsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/69Restart tests fail due to missing quotes2019-07-18T07:33:28Zfrey_mRestart tests fail due to missing quotesConnected to https://gitlab.psi.ch/OPAL/src/merge_requests/143.Connected to https://gitlab.psi.ch/OPAL/src/merge_requests/143.frey_mfrey_mhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/68Failed kicker tests after kicker update2019-08-01T04:07:27Zsnuverink_jjochem.snuverink@psi.chFailed kicker tests after kicker updateAfter merging src!101 and fixing src#37, the kicker regression tests fail with small error margins: http://amas.web.psi.ch/opal/regressionTests/master/results_2019-05-24.xmlAfter merging src!101 and fixing src#37, the kicker regression tests fail with small error margins: http://amas.web.psi.ch/opal/regressionTests/master/results_2019-05-24.xmlkrauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/67GasStripping test fails2019-04-23T06:19:50Zsnuverink_jjochem.snuverink@psi.chGasStripping test failsThe `GasStripping` test fails from time to time with a too large difference for the surviving number of particles.
The `GasStripping` test checks how many particles are lost, in the reference these are 1e5 - 99623 = 377. Since this is a stochastic process, the expected error is about sqrt(377) = 20. The allowed error right now in the test is 25. [The GasStripping test failed with a difference of 42](http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-04-16.xml). To avoid that the test fails randomly from time to time, I propose to set the allowed error to at least 2 sigma=40, perhaps even better 3 sigma=60 (also because the reference of 377 might actually not be a good estimate for the expected number).The `GasStripping` test fails from time to time with a too large difference for the surviving number of particles.
The `GasStripping` test checks how many particles are lost, in the reference these are 1e5 - 99623 = 377. Since this is a stochastic process, the expected error is about sqrt(377) = 20. The allowed error right now in the test is 25. [The GasStripping test failed with a difference of 42](http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-04-16.xml). To avoid that the test fails randomly from time to time, I propose to set the allowed error to at least 2 sigma=40, perhaps even better 3 sigma=60 (also because the reference of 377 might actually not be a good estimate for the expected number).gsellext-calvo_ppedro.calvo@ciemat.esgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/66Degrader-1 test broken2019-08-01T04:08:15ZkrausDegrader-1 test brokenThe necessary changes to the source code to make the reference particle lose energy in a degrader (OPAL/src#298) produce different results in this test. Will have to remake the reference.The necessary changes to the source code to make the reference particle lose energy in a degrader (OPAL/src#298) produce different results in this test. Will have to remake the reference.krauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/65AWAGun not running2018-12-28T20:55:55ZkrausAWAGun not runningWith the latest changes this regression test isn't running. I'm working on it.With the latest changes this regression test isn't running. I'm working on it.krauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/64MAP-Circular test failing2019-02-15T07:51:23Zsnuverink_jjochem.snuverink@psi.chMAP-Circular test failingThe MAP-Circular test is failing since its introduction.
@gsell : locally this test works for me, but it fails on the nightly without specific information (perhaps a timeout?). Do you have a log file with some more information why this test fails?The MAP-Circular test is failing since its introduction.
@gsell : locally this test works for me, but it fails on the nightly without specific information (perhaps a timeout?). Do you have a log file with some more information why this test fails?snuverink_jjochem.snuverink@psi.chsnuverink_jjochem.snuverink@psi.ch