SBML Test Suite

The SBML Test Suite is a conformance testing system for SBML. It allows developers and users to test the degree and correctness of SBML support provided in an SBML-compatible software package.

More details you can find at: 
http://sbml.org/Software/SBML_Test_Suite

Results

SBML test suite was used to validate BioUML simulation engines.

   SBML test suite    version 2.0.2   2011, November 15
   BioUML simulation engine    version 0.9.3   2011, October 31

 Test results are summarized below

SBML Details Tests Successful Failed Errors Needs tuning CSV error Result differs Problem is stiff Compilation error Success rate Time (s)
Level 1 version 2* by order
by categories
234 234 0 0 0 0 0 0 0 100.0 % 18
Level 2 version 1  by order
by categories
927 788 0 0 0 139** 0 0 0 100.0 % 94
Level 2 version 2  by order
by categories
927 927 0 0 0 0 0 0 0 100.0 % 211
Level 2 version 3  by order
by categories
927 927 0 0 0 0 0 0 0 100.0 % 343
Level 2 version 4  by order
by categories
927 927 0 0 0 0 0 0 0 100.0 % 467
Level 3 version 1  by order
by categories
927 927 0 0 0 0 0 0 0 100.0 % 104

Legend
Failed - an exception has occurred.
Errors - simulation results significantly differ from the known ones.
Needs tuning - relative error is not small enough.
CSV error - original CSV data is missing or can not be parsed.
Result differs - some variable or time point is missing in simulation engine output..
Problem is stiff - Problem is too stiff for this solver.
Compilation error - Could not compile generated model file.

Notes
* in tests 182, 573, 576 - algebraic rule changed to equivalent parameterRule with type = "scalar".
See discussion on SBM forum for more details.

** here it means that 139 tests are missing (some information about model can not be stored) for SBML level 2 version 1.