modes

Benchmark
Model:cabinets v.1 (MA)
Parameter(s)N = 3, P = 2, R = True
Property:Unreliability (prob-reach-time-bounded)
Invocation (specific)
mono modes/modes.exe cabinets.3-2-true.jani --props Unreliability --width 1e-3 --relative-width -O out.txt Minimal --unsafe --max-run-length 0 --timeout 1680  -R Uniform
Settings specific for this benchmark: '--unsafe' = compile model without bounds and assignment checks, '--max-run-length 0' = do not impose a limit on the maximum length of a simulation run (which is anyway more of a model debugging feature), '--timeout 1680' = stop after 28 minutes of simulation and return the estimate at that point even if the desired confidence is not yet met, '-R Uniform' = use uniform resolution of structural nondeterminism (since it is known to be spurious for this model and property).
Execution
Walltime:1681.4299914836884s
Return code:0
Note(s):The tool result '12301598184271/312500000000000000000' is tagged as incorrect. The reference result is 'OrderedDict([('lower', 5.67352732e-08), ('upper', 7.67352732e-08)])' (approx. OrderedDict([('lower', 5.67352732e-08), ('upper', 7.67352732e-08)])) which means a relative error of '0.30616154696392295' which is larger than the goal precision '0.001'.
Relative Error:0.30616154696392295
Log
cabinets.3-2-true.jani:model: info: cabinets.3-2-true.jani is an MA model and will be simulated as an MA.
cabinets.3-2-true.jani: info: Using default value of 0.95 for the confidence parameter.

Peak memory usage: 73 MB
Analysis results for cabinets.3-2-true.jani
Status:          Timeout (1680 s)
Simulation time: 1680.0 s

+ Property Property "Unreliability"
  Estimated probability: 3.93651141896672E-08
  Runs used:             76209610
  Run type:              MA
  Status:                Timeout

  + Error bounds
    Statement: Aborted: no error bounds