Community results
Solvers and models that others validated against the benchmark (Validate your own solver). Each row is self-reported, scored by this repository’s CI: the author gave the values at the published points, and the pinned build scored them with the same metrics and conventions as Eddy3D’s results on the Validation page, which are kept apart from this table on purpose. The scoring is checked; the solve is not.
| Solver | A | B | C | D | E | F | G | H | I | J | K | L | M |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 | — | — | — | — | scored R +0.70 … +0.88 FAC2 0.76 … 0.95 320/320 points | — | — | — | — | — | — | — | — |
| OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 | — | — | — | — | — | — | — | — | — | — | scored R -0.15 … +0.96 FAC2 0.05 … 0.76 1218/1218 points | — | — |
| OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 | scored R +0.41 … +0.96 FAC2 0.34 … 0.87 930/930 points | scored R +0.40 … +0.96 FAC2 0.29 … 0.82 1120/1120 points | — | — | — | — | — | scored R +0.12 … +0.95 FAC2 0.31 … 0.65 4956/4956 points | — | — | — | — | — |
| OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 | scored R +0.46 … +0.96 FAC2 0.35 … 0.88 930/930 points | — | — | — | — | — | — | — | — | — | — | — | — |
| OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 | scored R +0.39 … +0.96 FAC2 0.36 … 0.87 930/930 points | scored R +0.29 … +0.96 FAC2 0.27 … 0.86 1120/1120 points | scored R +0.73 … +0.92 FAC2 0.57 … 0.99 2160/2160 points | scored R -0.19 … +0.87 FAC2 0.27 … 0.92 462/462 points | scored R +0.71 … +0.86 FAC2 0.69 … 0.95 320/320 points | scored R +0.75 … +0.95 FAC2 0.85 … 1.00 92/92 points | scored R +0.32 … +0.34 FAC2 0.36 … 1.00 84/84 points | scored R -0.01 … +0.95 FAC2 0.30 … 0.68 4956/4956 points | — | — | scored R -0.14 … +0.96 FAC2 0.05 … 0.81 1218/1218 points | scored R +0.00 … +0.94 FAC2 0.20 … 1.00 2408/2408 points | scored R +0.12 … +0.70 FAC2 0.13 … 0.67 90/90 points |
| OpenFOAM pimpleFoam (Eddy3D Outdoor case writer) 12 | scored R +0.63 … +0.95 FAC2 0.36 … 0.82 930/930 points | — | — | — | — | — | — | — | — | — | — | — | — |
| OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12 example | scored R +0.71 … +0.96 FAC2 0.35 … 0.88 744/744 points | — | — | — | — | — | — | — | — | — | — | — | — |
Nomenclature: scores
Scores
- \(n\) — number of pairs of a measured value \(o_i\) and a modelled value \(p_i\) at one point
- \(R\) — Pearson correlation coefficient of the pairs
- \(R^2\) — square of \(R\): share of the measured variance a linear fit to the model explains
- \(\mathrm{FAC2}\) — fraction of pairs with \(0.5 \le p_i/o_i \le 2\)
- \(\mathrm{FB}\) — fractional bias \(2(\overline{o}-\overline{p})/(\overline{o}+\overline{p})\), positive when the model is low
- \(\mathrm{HR}\) (hit rate) — fraction of pairs with \(\lvert p_i-o_i\rvert/\lvert o_i\rvert \le \delta_{\mathrm{rel}}\) or \(\lvert p_i-o_i\rvert \le \delta_{\mathrm{abs}}\), where \(\delta_{\mathrm{rel}} = 0.25\) and \(\delta_{\mathrm{abs}} = 0.05\thinspace U_H\) for a velocity component
Quantities scored
- \(U\), \(V\) and \(W\) (mean velocity components) over \(U_H\)
- \(k\) (turbulent kinetic energy) over \(U_H^2\)
- the speed \(\lvert\mathbf{U}\rvert\) and \(\sqrt{\lvert\mathbf{U}\rvert^2+2k}\), against a thermistor’s \(V_{\mathrm{s}}\)
- \(c^\ast = C/c_0\) (dimensionless concentration) at turbulent Schmidt numbers \(\mathrm{Sc_t}\) of 0.3, 0.5 and 0.7
- \(\theta\) (floor-referenced temperature)
R and FAC2: the range over the submission’s scores for the case; n/N points: the points it gave over the points the benchmark measured (a partial submission scores its points only). A dash: the case was not submitted. The row marked example is the repository’s own worked example (Eddy3D’s Case A probes), there to prove the pipeline. Every value and every score is served at /api/submissions.json.
To add yours: Validate your own solver, step 10.
In this section
- OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12
- OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12
- OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12
- OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12
- OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12
- OpenFOAM pimpleFoam (Eddy3D Outdoor case writer) 12
- OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12