Community results

Solvers and models that others validated against the benchmark (Validate your own solver). Each row is self-reported, scored by this repository’s CI: the author gave the values at the published points, and the pinned build scored them with the same metrics and conventions as Eddy3D’s results on the Validation page, which are kept apart from this table on purpose. The scoring is checked; the solve is not.

Solver A B C D E F G H I J K L M
OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 — — — — scored
R +0.70 … +0.88
FAC2 0.76 … 0.95
320/320 points
— — — — — — — —
OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 — — — — — — — — — — scored
R -0.15 … +0.96
FAC2 0.05 … 0.76
1218/1218 points
— —
OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 scored
R +0.41 … +0.96
FAC2 0.34 … 0.87
930/930 points
scored
R +0.40 … +0.96
FAC2 0.29 … 0.82
1120/1120 points
— — — — — scored
R +0.12 … +0.95
FAC2 0.31 … 0.65
4956/4956 points
— — — — —
OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 scored
R +0.46 … +0.96
FAC2 0.35 … 0.88
930/930 points
— — — — — — — — — — — —
OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 scored
R +0.39 … +0.96
FAC2 0.36 … 0.87
930/930 points
scored
R +0.29 … +0.96
FAC2 0.27 … 0.86
1120/1120 points
scored
R +0.73 … +0.92
FAC2 0.57 … 0.99
2160/2160 points
scored
R -0.19 … +0.87
FAC2 0.27 … 0.92
462/462 points
scored
R +0.71 … +0.86
FAC2 0.69 … 0.95
320/320 points
scored
R +0.75 … +0.95
FAC2 0.85 … 1.00
92/92 points
scored
R +0.32 … +0.34
FAC2 0.36 … 1.00
84/84 points
scored
R -0.01 … +0.95
FAC2 0.30 … 0.68
4956/4956 points
— — scored
R -0.14 … +0.96
FAC2 0.05 … 0.81
1218/1218 points
scored
R +0.00 … +0.94
FAC2 0.20 … 1.00
2408/2408 points
scored
R +0.12 … +0.70
FAC2 0.13 … 0.67
90/90 points
OpenFOAM pimpleFoam (Eddy3D Outdoor case writer) 12 scored
R +0.63 … +0.95
FAC2 0.36 … 0.82
930/930 points
— — — — — — — — — — — —
OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 example scored
R +0.71 … +0.96
FAC2 0.35 … 0.88
744/744 points
— — — — — — — — — — — —
Nomenclature: scores

Scores

  • \(n\) — number of pairs of a measured value \(o_i\) and a modelled value \(p_i\) at one point
  • \(R\) — Pearson correlation coefficient of the pairs
  • \(R^2\) — square of \(R\): share of the measured variance a linear fit to the model explains
  • \(\mathrm{FAC2}\) — fraction of pairs with \(0.5 \le p_i/o_i \le 2\)
  • \(\mathrm{FB}\) — fractional bias \(2(\overline{o}-\overline{p})/(\overline{o}+\overline{p})\), positive when the model is low
  • \(\mathrm{HR}\) (hit rate) — fraction of pairs with \(\lvert p_i-o_i\rvert/\lvert o_i\rvert \le \delta_{\mathrm{rel}}\) or \(\lvert p_i-o_i\rvert \le \delta_{\mathrm{abs}}\), where \(\delta_{\mathrm{rel}} = 0.25\) and \(\delta_{\mathrm{abs}} = 0.05\thinspace U_H\) for a velocity component

Quantities scored

  • \(U\), \(V\) and \(W\) (mean velocity components) over \(U_H\)
  • \(k\) (turbulent kinetic energy) over \(U_H^2\)
  • the speed \(\lvert\mathbf{U}\rvert\) and \(\sqrt{\lvert\mathbf{U}\rvert^2+2k}\), against a thermistor’s \(V_{\mathrm{s}}\)
  • \(c^\ast = C/c_0\) (dimensionless concentration) at turbulent Schmidt numbers \(\mathrm{Sc_t}\) of 0.3, 0.5 and 0.7
  • \(\theta\) (floor-referenced temperature)

R and FAC2: the range over the submission’s scores for the case; n/N points: the points it gave over the points the benchmark measured (a partial submission scores its points only). A dash: the case was not submitted. The row marked example is the repository’s own worked example (Eddy3D’s Case A probes), there to prove the pipeline. Every value and every score is served at /api/submissions.json.

To add yours: Validate your own solver, step 10.


In this section