Select a suitable set of default validation tests and upload vetted reference data

Issue #13 new
Martin Sandve Alnæs created an issue

No description provided.

Comments (9)

  1. Martin Sandve Alnæs reporter

    Here are some points copied from the old todo list:

    • Add NSSolver unit test with mock scheme and postprocessor, testing that the solver steps correctly.

    • Improve unit test suite further (not sure what is needed yet).

    • Setup a fast regression test suite (trivial meshes, few timesteps).

    • Setup a slow regression test suite (realistic meshes).

    • Setup a validation test suite with analytical problems.

    • Setup a benchmark suite.

    Bonus points: Make it all runnable on cluster.

  2. Martin Sandve Alnæs reporter

    I've updated the test suite to use py.test. I'm thinking the unit tests we have are sufficient for the 1.3 release, but we can always improve more when we have the time.

  3. Martin Sandve Alnæs reporter

    See test/README for instructions on using the reference data framework.

    The validation tests need some more work:

    • Defining a reasonable set of default tests. The current default gives 600 cases, I'm thinking that can be reduced significantly.

    • Inspecting the results of the regression tests to approve them. After that, run cd test; ./scripts/upload_replace.py

  4. Log in to comment