regression-tests issueshttps://gitlab.psi.ch/OPAL/regression-tests/-/issues2019-05-06T16:28:58+02:00https://gitlab.psi.ch/OPAL/regression-tests/-/issues/23scripts to run regression test must be moved to separate repository2019-05-06T16:28:58+02:00gsellscripts to run regression test must be moved to separate repositorygsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/24'REGTEST_WWW' should be set in the configuration file2019-05-06T16:28:58+02:00gsell'REGTEST_WWW' should be set in the configuration filegsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/25add option to enable/disable publishing in 'scripts/run_regression_tests'2019-05-06T16:28:58+02:00gselladd option to enable/disable publishing in 'scripts/run_regression_tests'OPAL 1.9.xgsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/26add option to define publishing directory in 'run_regression_test'2019-05-06T16:28:58+02:00gselladd option to define publishing directory in 'run_regression_test'OPAL 1.9.xgsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/27define toolchain in configuration file2019-05-06T16:28:58+02:00gselldefine toolchain in configuration fileThe tool-chain to build and run OPAL should be defined in a configuration file.The tool-chain to build and run OPAL should be defined in a configuration file.OPAL 1.9.xgsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/37DKS2019-05-06T16:28:58+02:00adelmannDKScurrent results from the regression tests are available at
--------------
http://amas.web.psi.ch/opal/regressionTests/OPAL-1.6/
OPAL compiled *without* DKS. Three tests are failing:
2.5.2017 [passed:201 | broken:0 | failed:3 | total:2...current results from the regression tests are available at
--------------
http://amas.web.psi.ch/opal/regressionTests/OPAL-1.6/
OPAL compiled *without* DKS. Three tests are failing:
2.5.2017 [passed:201 | broken:0 | failed:3 | total:204]
--------------
http://amas.web.psi.ch/opal/regressionTests/OPAL-1.6-DKS/
OPAL compiled *with* DKS but DKS is *not* used. Two tests are failing:
2.5.2017 [passed:202 | broken:0 | failed:2 | total:204]
Note: The results shouldn't depend on whether OPAL has been compiled with or without DKS support.
---------------
http://amas.web.psi.ch/opal/regressionTests/OPAL-1.6-DKS-USED/
OPAL compiled *with* DKS and DKS *is* used. Five tests are failing:
2.5.2017 [passed:193 | broken:6 | failed:5 | total:204]
----------------
In all three flavours the following tests are skipped (same as in the "old" tests"):
Degrader-2
HKick-Test-2
LaserEmission-1
PROSCAN-3
PROSCAN-4
ParallelPlateFurman1
ParallelPlateVaughan1
----------------
Following error occurs in 'OpalRingTest':
Found valid test in ./OpalRingTest
Checksum for reference OpalRingTest.stat: OK
Checksum for reference OpalRingTest.out: OK
Checksum for reference OpalRingTest.lbal: OK
Checksum for reference PROBE1.loss: OK
run simulation
Error: failed to parse OpalRingTest.rt file line 2
PROBE1.loss "x" all 1E-15
Python reports
[Errno 2] No such file or directory: 'PROBE1.loss'
Error: failed to parse OpalRingTest.rt file line 3
PROBE1.loss "y" all 1E-15
Python reports
[Errno 2] No such file or directory: 'PROBE1.loss'OPAL 1.6.0https://gitlab.psi.ch/OPAL/regression-tests/-/issues/40Regression Test are not running after commit to src2019-05-06T16:28:58+02:00adelmannRegression Test are not running after commit to src![IMG_0068](/uploads/3d85ada3a631b785258b333b72936676/IMG_0068.PNG)![IMG_0068](/uploads/3d85ada3a631b785258b333b72936676/IMG_0068.PNG)OPAL 1.6.0gsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/2'RestartTest-8.in' fails with undefined element error2019-05-06T16:28:58+02:00gsell'RestartTest-8.in' fails with undefined element errorParse error in `RestartTest-8.in`:
```
Error>
Error> *** Parse error detected by function "Line::parseList()"
Error> *** in line 25 of file "RestartTest-8.in" before token ")":
Error> L1:LINE=(FINSS_RGUN,FIND1_MSOL10,END);
Er...Parse error in `RestartTest-8.in`:
```
Error>
Error> *** Parse error detected by function "Line::parseList()"
Error> *** in line 25 of file "RestartTest-8.in" before token ")":
Error> L1:LINE=(FINSS_RGUN,FIND1_MSOL10,END);
Error> Element "END" is undefined.
Error>
```adelmannadelmannhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/3'RestartTest-2' fails on master branch2019-05-06T16:28:57+02:00gsell'RestartTest-2' fails on master branch'RestartTest-2' fails with the following error message:
Error{0}> get_iter(): no more items in Message
Error{0}> reduce: mismatched element count in vector reduction.'RestartTest-2' fails with the following error message:
Error{0}> get_iter(): no more items in Message
Error{0}> reduce: mismatched element count in vector reduction.OPAL 1.9.xadelmannadelmannhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/67GasStripping test fails2019-04-23T08:19:50+02:00snuverink_jjochem.snuverink@psi.chGasStripping test failsThe `GasStripping` test fails from time to time with a too large difference for the surviving number of particles.
The `GasStripping` test checks how many particles are lost, in the reference these are 1e5 - 99623 = 377. Since this is a...The `GasStripping` test fails from time to time with a too large difference for the surviving number of particles.
The `GasStripping` test checks how many particles are lost, in the reference these are 1e5 - 99623 = 377. Since this is a stochastic process, the expected error is about sqrt(377) = 20. The allowed error right now in the test is 25. [The GasStripping test failed with a difference of 42](http://amas.web.psi.ch/opal/regressionTests/OPAL-2.0/results_2019-04-16.xml). To avoid that the test fails randomly from time to time, I propose to set the allowed error to at least 2 sigma=40, perhaps even better 3 sigma=60 (also because the reference of 377 might actually not be a good estimate for the expected number).gsellext-calvo_ppedro.calvo@ciemat.esgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/51opalimpact-1 failing after replacing OFFSETZ with ZSTART2019-02-15T08:51:23+01:00snuverink_jjochem.snuverink@psi.chopalimpact-1 failing after replacing OFFSETZ with ZSTARTSince we discussed to get the regression tests working, I had a more detailed look at one of them.
After replacing `OFFSETZ` with `ZSTART` in commit e2e902d8 the opalimpact-1 test is failing.
I believe this is because the starting s po...Since we discussed to get the regression tests working, I had a more detailed look at one of them.
After replacing `OFFSETZ` with `ZSTART` in commit e2e902d8 the opalimpact-1 test is failing.
I believe this is because the starting s position is different in both cases, perhaps contrary to what one would expect(?).
In the reference .stat file there is (t,s):
```
1.000000000000000e+00 1.383007003378306e-02
2.000000000000001e+00 2.766014006756613e-02
```
So the reference starts at t=0.0, s=0.0
and the current version (t,z):
```
2.115406793793548e+00 2.883007003378255e-02
3.115406793793549e+00 4.266014006756509e-02
```
The current version starts at t=0.11 , s = 0.15 (value of `ZSTART`).
since the test has `ZSTOP = 1.0` the last line will be different and the test will fail.
One possible way to fix the test is to have `ZSTOP=1.15`.
I haven't checked the other tests that were changed in the same way, but these might also be affected in the same way.kraussnuverink_jjochem.snuverink@psi.chkraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/47Fix units of BFREQ / BCURRENT2019-02-15T08:51:23+01:00krausFix units of BFREQ / BCURRENTIn the following tests it is unclear whether the units for BFREQ and BCURRENT are correct
Degrader-1
Distribution-Binomial-1
Distribution-Gauss-1
Distribution-Gauss-2
EGunCTF3-1
EGunCTF3-2
ExternalFieldTest
LaserEmission-1
OpalRi...In the following tests it is unclear whether the units for BFREQ and BCURRENT are correct
Degrader-1
Distribution-Binomial-1
Distribution-Gauss-1
Distribution-Gauss-2
EGunCTF3-1
EGunCTF3-2
ExternalFieldTest
LaserEmission-1
OpalRingTest
ParallelPlateFurman1
ParallelPlateVaughan1
PSIGUN-1
RestartTest-1
RestartTest-2
RestartTest-3
RestartTest-4
RestartTest-5
RestartTest-6
RestartTest-7
RestartTest-8
RingCyclotron
RingCyclotronMatched
RingCyclotronMTS
RingCyclotronSingleParticle
Scan-1adelmannadelmannhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/50some regression-tests use removed keyword DEBIN2019-02-15T08:51:23+01:00adelmannsome regression-tests use removed keyword DEBINDEBIN was removed from the DISTRIBUTION **BUT** the regressiontests are **NOT** updated. We should avoid this ....
Sorry was not able to find out who did this ....DEBIN was removed from the DISTRIBUTION **BUT** the regressiontests are **NOT** updated. We should avoid this ....
Sorry was not able to find out who did this ....https://gitlab.psi.ch/OPAL/regression-tests/-/issues/64MAP-Circular test failing2019-02-15T08:51:23+01:00snuverink_jjochem.snuverink@psi.chMAP-Circular test failingThe MAP-Circular test is failing since its introduction.
@gsell : locally this test works for me, but it fails on the nightly without specific information (perhaps a timeout?). Do you have a log file with some more information why this ...The MAP-Circular test is failing since its introduction.
@gsell : locally this test works for me, but it fails on the nightly without specific information (perhaps a timeout?). Do you have a log file with some more information why this test fails?snuverink_jjochem.snuverink@psi.chsnuverink_jjochem.snuverink@psi.chhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/65AWAGun not running2018-12-28T21:55:55+01:00krausAWAGun not runningWith the latest changes this regression test isn't running. I'm working on it.With the latest changes this regression test isn't running. I'm working on it.krauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/63Regression tests for 2.02018-08-23T16:33:18+02:00snuverink_jjochem.snuverink@psi.chRegression tests for 2.0Regression tests for the 2.0 branch are not yet running.Regression tests for the 2.0 branch are not yet running.gsellgsellhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/60EGunCTF3-1, EGunCTF3-2 and PSIGUN-12018-04-11T10:32:41+02:00adelmannEGunCTF3-1, EGunCTF3-2 and PSIGUN-1EGunCTF3-1, EGunCTF3-2 and PSIGUN-1 is working fine on merlin: not broken and results are ok.EGunCTF3-1, EGunCTF3-2 and PSIGUN-1 is working fine on merlin: not broken and results are ok.adelmannadelmannhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/61CSRBendDrift2018-04-11T09:12:23+02:00adelmannCSRBendDriftTurning CSR off there are discrepancies
[csr-1.6-2.0-comp-2.pdf](/uploads/4a08ee7eb7f06acf96be8c3e8b3cdcc3/csr-1.6-2.0-comp-2.pdf)
we need to understand first.
This is the last failing test in 1.9.x.Turning CSR off there are discrepancies
[csr-1.6-2.0-comp-2.pdf](/uploads/4a08ee7eb7f06acf96be8c3e8b3cdcc3/csr-1.6-2.0-comp-2.pdf)
we need to understand first.
This is the last failing test in 1.9.x.OPAL 1.9.xkrauskraushttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/39WIP: Disabled Regression Tests2018-04-01T15:03:17+02:00adelmannWIP: Disabled Regression TestsNeed to check if these tests are still be used and/or are redundant
Degrader-2
HKick-Test-2
LaserEmission-1
PROSCAN-3
PROSCAN-4
ParallelPlateFurman1
ParallelPlateVaughan1Need to check if these tests are still be used and/or are redundant
Degrader-2
HKick-Test-2
LaserEmission-1
PROSCAN-3
PROSCAN-4
ParallelPlateFurman1
ParallelPlateVaughan1OPAL 1.9.xadelmannadelmannhttps://gitlab.psi.ch/OPAL/regression-tests/-/issues/14'Transfer-Line' needs to be fixed2018-04-01T15:00:21+02:00gsell'Transfer-Line' needs to be fixed```
Error>
Error> *** User error detected by function "Bend::setK1"
Error> *** in line 58 of file "Transfer-Line.in":
Error> VALUE,{SIGPX,SIGPY,SIGPZ,PZAVE};
Error> Quadrupole field temporarily not supported
Error>
Error>
Err...```
Error>
Error> *** User error detected by function "Bend::setK1"
Error> *** in line 58 of file "Transfer-Line.in":
Error> VALUE,{SIGPX,SIGPY,SIGPZ,PZAVE};
Error> Quadrupole field temporarily not supported
Error>
Error>
Error> *** User error detected by function "Bend::setK1"
Error> *** in line 89 of file "Transfer-Line.in":
Error> SELECT,LINE=IW2LINE;
Error> Quadrupole field temporarily not supported
Error>
Error>
Error> *** User error detected by function "Bend::setK1"
Error> *** in line 91 of file "Transfer-Line.in":
Error> TRACK,LINE=IW2LINE,BEAM=BEAM1,MAXSTEPS=900000,DT=5e-11,ZSTOP=90;
Error> Quadrupole field temporarily not supported
Error>
Error>
Error> *** Parse error detected by function "OpalParser::parse()"
Error> *** in line 92 of file "Transfer-Line.in" before token ",":
Error> RUN,METHOD="PARALLEL-T",BEAM=BEAM1,FIELDSOLVER=FS1,DISTRIBUTION=DIST1405BIN;
Error> Syntax error, the command 'RUN' could belong to
Error> - the command TRACK
Error> but it's not present!
Error>
```OPAL 1.9.x