... | ... | @@ -35,18 +35,13 @@ Any deviation from this naming scheme will result in a failure. Additionally the |
|
|
6. `RegressionTestName.stat.md5`: The md5sum of the stat file
|
|
|
|
|
|
<<creating-md5sums,Creating md5sums>> shows how md5sums can be generated for reference files.
|
|
|
All these files have to be placed in `regression=tests/RegressionTests/` and be committed to the repository in order be run nightly.
|
|
|
You can omit the commit to only use the regression test locally by running
|
|
|
|
|
|
----
|
|
|
run-regression-test.py --user --run-local
|
|
|
----
|
|
|
All these files have to be placed in `regression-tests/RegressionTests/` and be committed to the repository in order be run nightly.
|
|
|
|
|
|
Examples of working regression tests are located in `regression-tests/RegressionTests/`.
|
|
|
|
|
|
=== Summary
|
|
|
=== Summary
|
|
|
|
|
|
The directory tree should look like this:
|
|
|
The directory tree should look like this:
|
|
|
|
|
|
----
|
|
|
regression-tests/RegressionTests/RegressionTestName
|
... | ... | @@ -96,7 +91,7 @@ In case of data from the `PROBE` element, you can compare `x`, |
|
|
|
|
|
Note that
|
|
|
|
|
|
* Output in the loss file is assumed to be that of a PROBE element.
|
|
|
* Output in the loss file is assumed to be that of a PROBE element.
|
|
|
* If a line of output is not compatible with PROBE output, test will ignore the line (not fail).
|
|
|
* Test will always fail if no valid data was found in the loss file
|
|
|
or the loss file could not be opened.
|
... | ... | @@ -135,13 +130,12 @@ md5sum ExternalFieldTest.out > ExternalFieldTest.out.md5 |
|
|
in the terminal.
|
|
|
|
|
|
== Locally Run Regression Tests
|
|
|
0. `git clone git@gitlab.psi.ch:OPAL/NightlyBuild.git`
|
|
|
1. goto the directory where **run-reg-tests.py** is present (you get this from the clone above)
|
|
|
2. set the environment variable `OPAL_EXE_PATH`
|
|
|
0. `git clone git@gitlab.psi.ch:OPAL/NightlyBuild.git`
|
|
|
1. goto the `scripts` directory, where **run-reg-tests.py** is present (you get this from the clone above)
|
|
|
2. set the environment variable `OPAL_EXE_PATH`
|
|
|
3. set the `$REG_TEST_DIR` for example `export REG_TEST_DIR=$OPAL_ROOT/regression-tests/RegressionTests`
|
|
|
4. set the `$REGTEST_WWW` for example `export REGTEST_WWW=$HOME/regtest-www`
|
|
|
5. `cd $REG_TEST_DIR/run`
|
|
|
6. `python run-reg-tests.py --opal-exe-path=$OPAL_EXE_PATH --regtests-dir=$REG_TEST_DIR --dont-publish OpalRingTest`
|
|
|
|
|
|
|
|
|
To run more than one test, simply add addition names separated by a space : `test1 test2 test3` |