Failure with runAll flag testing #43
-
Hi all, I encountered a problem when performing the test cases. After some minor modifications, all goes well with the tag "--runSimple". But following error appeared when I used the tag "--runAll" /home/alex/OpenFOAM/alex-v2106/src/openSource/WENOEXT/tests/src/geometryWENO-BasicFunc-Test.C:305: FAILED:
REQUIRE( Approx(mag(blaze::det(JInvI)))==1E+05 )
with expansion:
Approx( 225000.0000000003 ) == 100000.0 I am not familiar with the CATCH2 framework. Could someone help me fix this? Best, Fracturist |
Beta Was this translation helpful? Give feedback.
Replies: 4 comments 3 replies
-
This is not an error or bug, but a warning that one of the tests failed. Meaning, that something has changed to give now incorrect results. The expected determinant of the inverse Jacobi matrix for this test case is 1E+5 but your result is 225000, hence the test fails. However, it is interesting that the test does not fail for the first run, because it should be executed for both. I also see that you use the master branch version, please test the development branch version, which has improved features. I will update the master branch soon to fix this issue. Best, Jan |
Beta Was this translation helpful? Give feedback.
-
Hi Jan, Thank you very much for your explanation 😄. I am also comfused by the discrepancy between the two tests. From the runTest script, there should be no difference I think. I will try the development branch version to see if it helps. Best, Fracturist |
Beta Was this translation helpful? Give feedback.
-
Hi Jan, I have tried the development branch and it works quite well for tests. I work with v2106 and paraview 5.9.1 and have to make some slight changes to get the correct test report. I post them here in case someone might need these.
WENOEXT/tests/report/testReport.html Lines 20 to 25 in f152a37
plot "results.dat" every 2::0::2 using ($0+0.24):3 with boxes ls 2 notitle,\
"results.dat" every ::3 using ($0+0.51):3 with boxes ls 3 title 'best cond. WENOEXT/tests/Cases/2DMesh-cyclic/PLOT/plotReport.gplt Lines 34 to 35 in f152a37 Please correct me if I was wrong.
This is what i got in the end. |
Beta Was this translation helpful? Give feedback.
-
Hi Jan, Thank you for checking the results. I have created the pull request #44 to merge those changes. Best, Fracturist |
Beta Was this translation helpful? Give feedback.
This is not an error or bug, but a warning that one of the tests failed. Meaning, that something has changed to give now incorrect results. The expected determinant of the inverse Jacobi matrix for this test case is 1E+5 but your result is 225000, hence the test fails.
However, it is interesting that the test does not fail for the first run, because it should be executed for both.
I also see that you use the master branch version, please test the development branch version, which has improved features. I will update the master branch soon to fix this issue.
Best,
Jan