OpenFOAM simpleFoam (Eddy3D Outdoor case writer) 12

Self-reported inputs, scored by this repository’s build (method). The submitted values are under submissions/eddy3d-of12-nutcap-lifted/ and served as /api/submissions/eddy3d-of12-nutcap-lifted.json.

Field Value
solver OpenFOAM simpleFoam (Eddy3D Outdoor case writer)
version 12
url https://openfoam.org
author Sustainable Urban Systems Lab
licence CC-BY-4.0
contact https://github.com/Eddy3D-Dev/AIJ-Data-Validation/discussions
inlet the served fitted log law
mesh snappyHexMesh, 1:100 scale, the served runs' mesh and numerics level 3
turbulence_model realizable k-epsilon, nutMaxCoeff 1e8
compute 3000 iterations, steady, 5-6 ranks (Case A on an Apple M-series laptop, B and H on PACE Phoenix)
units normalised
notes Cases D, E and L are re-solves of the Eddy3D fixtures on PACE ICE with the cap lifted (E: the SW direction before and after construction; L: urbanMicroclimateFoam, \(\mathrm{Sc_t}\) 0.5). Case G is the conifer crown of the drag sweep, where lifting the cap makes the result worse (a worse score, submitted all the same). Case C (all nine configurations, from the fixture probes of an ICE re-solve), Cases F (wind from NNW) and M (WD 180, \(\mathrm{Sc_t}\) 0.5) are the Eddy3D fixtures re-solved by another session on PACE ICE with the same cap change, scored here from their probe files. Same fixtures as the served runs (Eddy3D docs/VALIDATION.md) with only the cap changed. Case H cstar is the \(\mathrm{Sc_t}\) = 0.5 species. Case B is the served set-up with the cap lifted (the capped control of the same fixture reproduces the served B scores to the third digit).
Nomenclature: symbols, columns and scores

Geometry, reference scales and release

  • \(H\), \(b\), \(D\) (m) — height of the building, cube, tower or tree belt; width of the building; edge of the cubes of Case C: the lengths the cases are drawn and normalised by
  • \(U_H\) (m/s) — reference speed: the mean approach-flow speed at the height \(H\) (each Data page gives the value used)
  • \(U_R\), \(H_R\), \(Z_R\) (m/s, m) — reference speed and height of a workbook: Case E, \(U_R\) at \(Z_R\) = 250 m full scale (1 m in the model); Case M, \(U_R\) and \(H_R\) at the reference point of the tunnel and of each field run
  • \(U_{\mathrm{ref}}\), \(L_{\mathrm{ref}}\) (m/s, m) — reference speed and length of a case’s normalisation: \(U_H\) and \(H\) (\(U_R\) and \(H_R\) in Case M); for the velocity ratios the approach speed at 15.9 m (Case E) or at 500 m (Case F)
  • \(U_b\) (m/s) — Case G: mean approach-flow speed at 9 m, the normalisation of its approach-flow table
  • \(q\), \(c_{\mathrm{gas}}\) (m³/s, ppm) — tracer release of the experiment: volume flow of the released gas, and its tracer content (\(10^6\) ppm when pure); \(Q\) is the source strength given to a solve
  • \(R_b\) (dimensionless) — bulk Richardson number of the heated-floor cases J and L (negative: unstable stratification)
  • \(\mathrm{Re_H}\), \(\mathrm{Re_D}\) (dimensionless) — Reynolds numbers \(U_H H/\nu\) and \(U_H D/\nu\) (\(\nu\): kinematic viscosity of air)
  • \(u_\ast\), \(z_0\), \(\kappa\) (m/s, mm, dimensionless) — friction velocity and roughness length of the log law fitted to the approach flow, and the von Kármán constant (0.41)
  • \(\mathrm{WD}\) (column wind_direction_deg; °) — wind direction (each frame says how it is counted); \(\mathrm{WD_R}\) is the mean direction of a field run at its reference point (Case M)
  • \(x\), \(y\), \(z\) (columns x, y, z; m) — coordinates in the case’s frame (\(+x\), \(+y\) and \(+z\) are the positive directions; each Data page says which way \(+x\) points), \(z\) up from the floor of the tunnel or from the ground
  • \(\mathrm{d}x\) (m) — lattice spacing of the OpenLB and FluidX3D runs, in metres or as a fraction of \(H\) (\(H/64\))
  • \(L_r\) (m) — reattachment length behind the building, read from a wake line at ground level; reported as \(L_r/H\)

Velocity and turbulence

  • \(U\), \(V\), \(W\) (columns U, V, W; m/s) — mean velocity along \(+x\), \(+y\), \(+z\); \(V\) is positive toward \(+y\) in every case
  • \(\lvert\mathbf{U}\rvert\) (m/s) — magnitude of the mean velocity vector, \(\sqrt{U^2+V^2+W^2}\)
  • \(V_{\mathrm{s}}\) (column Vs; m/s) — mean omnidirectional scalar speed of a thermistor (never a vector magnitude)
  • \(\overline{u'u'}\), \(\overline{v'v'}\), \(\overline{w'w'}\) (columns uu, vv, ww; m²/s²) — velocity variances (overbar: time average, prime: fluctuation about it)
  • \(\overline{u'v'}\), \(\overline{u'w'}\), \(\overline{v'w'}\) (columns uv, uw, vw; m²/s²) — Reynolds shear stresses
  • \(k = \tfrac{1}{2}\left(\overline{u'u'}+\overline{v'v'}+\overline{w'w'}\right)\) (column k; m²/s²) — turbulent kinetic energy
  • \(U/U_{\mathrm{ref}}\) (column velocity_ratio; dimensionless) — mean speed over the case’s reference speed (\(V_{\mathrm{s}}/U_{\mathrm{ref}}\) for a thermistor)
  • \(\sigma_{U/U_{\mathrm{ref}}}\) (column velocity_ratio_sd; dimensionless) — standard deviation of velocity_ratio over the observations behind a field value (Case F)
  • \(k/U_{\mathrm{ref}}^2\) (column k_ratio; dimensionless) — turbulent kinetic energy over the square of the reference speed, where only normalised values are published (Case G)

Concentration and temperature

  • \(C\) (column C; ppm) — mean tracer-gas concentration as published (volume fraction \(\times 10^6\) of the released gas diluted in air)
  • \(c_{\mathrm{rms}}\) (column c_rms; ppm) — root mean square of the concentration fluctuation
  • \(c_0\) (ppm) — reference concentration, defined for each case on its Data page: \(c_0 = \dfrac{c_{\mathrm{gas}}\thinspace q}{U_H H^2}\) (\(U_R H_R^2\) in the denominator in Case M)
  • \(c^\ast\) (column concentration_ratio; dimensionless) — dimensionless concentration \(c^\ast = C/c_0\); the value of a solve is \(c\thinspace U_H H^2/Q\) for its mean concentration \(c\) and its source strength \(Q\)
  • \(\mathrm{Sc_t}\) (dimensionless) — turbulent Schmidt number of a solve (0.3, 0.5 and 0.7)
  • \(T\), \(T_{\mathrm{rms}}\) (columns T, T_rms; °C, K) — mean air temperature as published (Cases J and L) and the root mean square of its fluctuation
  • \(\overline{u'c'}\), \(\overline{v'c'}\), \(\overline{w'c'}\) (columns uc, vc, wc; ppm·m/s) — turbulent concentration fluxes
  • \(\overline{u'\theta'}\), \(\overline{v'\theta'}\), \(\overline{w'\theta'}\) (columns uT, vT, wT; K·m/s) — turbulent heat fluxes (\(\theta'\): the temperature fluctuation)
  • \(\theta = \dfrac{T_f - T}{T_f - T_H}\) (dimensionless) — floor-referenced temperature the solves of Cases J and L are scored on: 0 at the floor, 1 in the approach air at \(H\); \(T_f\) is the floor temperature and \(T_H\) the temperature of the approach flow at \(H\)

Scores

  • \(n\) — number of pairs of a measured value \(o_i\) and a modelled value \(p_i\) at one point
  • \(R\) — Pearson correlation coefficient of the pairs
  • \(R^2\) — square of \(R\): share of the measured variance a linear fit to the model explains
  • \(\mathrm{FAC2}\) — fraction of pairs with \(0.5 \le p_i/o_i \le 2\)
  • \(\mathrm{FB}\) — fractional bias \(2(\overline{o}-\overline{p})/(\overline{o}+\overline{p})\), positive when the model is low
  • \(\mathrm{HR}\) (hit rate) — fraction of pairs with \(\lvert p_i-o_i\rvert/\lvert o_i\rvert \le \delta_{\mathrm{rel}}\) or \(\lvert p_i-o_i\rvert \le \delta_{\mathrm{abs}}\), where \(\delta_{\mathrm{rel}} = 0.25\) and \(\delta_{\mathrm{abs}} = 0.05\thinspace U_H\) for a velocity component
  • \(\mathrm{NMSE} = \dfrac{\overline{(o-p)^2}}{\overline{o}\thinspace \overline{p}}\) — normalised mean square error
  • \(\mathrm{NAD} = \dfrac{\overline{\lvert o-p\rvert}}{\overline{o}+\overline{p}}\) — normalised absolute difference
  • \(\mathrm{MG} = \exp\overline{(\ln o-\ln p)}\) — geometric mean bias
  • \(\mathrm{VG} = \exp\overline{(\ln o-\ln p)^2}\) — geometric variance
  • The ratio of \(\mathrm{FAC2}\) keeps its sign, so a model of the other sign than the measurement is a miss; \(\mathrm{FB}\), \(\mathrm{NMSE}\) and \(\mathrm{NAD}\) divide by the means, so they are undefined (shown as —) for a signed component unless the measured and the modelled mean are both positive
  • VDI 3783-9 calls the hit rate \(q\) and the tolerances \(D\) and \(W\); on this site those letters keep their other meanings (\(q\) the tracer release rate, \(D\) the block size of Case C, \(W\) the vertical velocity)
  • The detection limit of a concentration is one value per case, \(10^{-3}\) of the largest measured value. It sets \(\delta_{\mathrm{abs}}\) of the hit rate and the both-below rule of \(\mathrm{FAC2}\), and floors the values in \(\mathrm{MG}\) and \(\mathrm{VG}\).
  • The scores \(\mathrm{FB}\), \(\mathrm{FAC2}\), \(\mathrm{NMSE}\), \(\mathrm{NAD}\), \(\mathrm{MG}\) and \(\mathrm{VG}\) follow Chang & Hanna (2004); the hit rate follows VDI 3783-9.

Quantities scored

  • \(U\), \(V\) and \(W\) (mean velocity components) over \(U_H\)
  • \(k\) (turbulent kinetic energy) over \(U_H^2\)
  • the speed \(\lvert\mathbf{U}\rvert\) and \(\sqrt{\lvert\mathbf{U}\rvert^2+2k}\), against a thermistor’s \(V_{\mathrm{s}}\)
  • \(c^\ast = C/c_0\) (dimensionless concentration) at turbulent Schmidt numbers \(\mathrm{Sc_t}\) of 0.3, 0.5 and 0.7
  • \(\theta\) (floor-referenced temperature)

Case A — 1:1:2 building

Score R FAC2 FB Hit rate n coverage
\(U\) +0.954 0.823 +0.166 0.613 186 186/186
\(V\) +0.962 0.360 — 0.903 186 186/186
\(W\) +0.709 0.403 -1.362 0.833 186 186/186
\(\lvert\mathbf{U}\rvert\) +0.940 0.866 +0.130 0.667 186 186/186
\(k\) +0.390 0.677 +0.394 0.247 186 186/186

Case B — 1:4:4 slab

Score R FAC2 FB Hit rate n coverage
\(U\) +0.957 0.719 +0.113 0.540 224 224/224
\(V\) +0.919 0.272 — 0.638 224 224/224
\(W\) +0.916 0.473 +0.549 0.723 224 224/224
\(\lvert\mathbf{U}\rvert\) +0.943 0.857 +0.063 0.634 224 224/224
\(k\) +0.291 0.554 +0.305 0.201 224 224/224

Case C — 3 × 3 block array

config 0D, wind_direction_deg 0.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.839 0.917 +0.265 0.583 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.818 0.658 +0.468 0.292 120 120/120

config 0D, wind_direction_deg 22.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.859 0.983 +0.111 0.742 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.847 0.817 +0.310 0.425 120 120/120

config 0D, wind_direction_deg 45.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.841 0.933 +0.122 0.800 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.810 0.792 +0.312 0.533 120 120/120

config 1D, wind_direction_deg 0.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.794 0.850 +0.335 0.408 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.731 0.567 +0.546 0.325 120 120/120

config 1D, wind_direction_deg 22.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.905 0.967 +0.191 0.675 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.888 0.708 +0.399 0.333 120 120/120

config 1D, wind_direction_deg 45.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.877 0.925 +0.205 0.733 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.877 0.817 +0.365 0.417 120 120/120

config 2D, wind_direction_deg 0.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.862 0.875 +0.234 0.575 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.854 0.700 +0.428 0.317 120 120/120

config 2D, wind_direction_deg 22.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.907 0.983 +0.104 0.875 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.893 0.867 +0.264 0.592 120 120/120

config 2D, wind_direction_deg 45.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.923 0.992 +0.098 0.908 120 120/120
\(\lvert\mathbf{U}\rvert\) +0.925 0.900 +0.241 0.642 120 120/120

Case D — high-rise among city blocks

wind_direction_deg 0.0

Score R FAC2 FB Hit rate n coverage
\(\lvert\mathbf{U}\rvert\) +0.870 0.818 +0.066 0.485 33 33/33
\(k\) -0.194 0.273 +0.452 0.091 33 33/33
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.789 0.788 +0.202 0.530 66 66/66
\(\lvert\mathbf{U}\rvert\) +0.805 0.682 +0.355 0.409 66 66/66

wind_direction_deg 22.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.812 0.909 +0.040 0.652 66 66/66
\(\lvert\mathbf{U}\rvert\) +0.810 0.818 +0.148 0.591 66 66/66

wind_direction_deg 45.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.853 0.924 +0.057 0.652 66 66/66
\(\lvert\mathbf{U}\rvert\) +0.848 0.848 +0.145 0.697 66 66/66

Case E — Niigata district

config ac, wind_direction_deg 225.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.865 0.863 +0.216 0.525 80 80/80
\(\lvert\mathbf{U}\rvert\) +0.848 0.688 +0.350 0.438 80 80/80

config bc, wind_direction_deg 225.0

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.717 0.950 +0.023 0.675 80 80/80
\(\lvert\mathbf{U}\rvert\) +0.712 0.838 +0.176 0.550 80 80/80

Case F — Shinjuku district

config default, campaign field, wind_direction_deg 337.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.853 1.000 +0.008 0.538 13 13/13
\(\lvert\mathbf{U}\rvert\) +0.831 0.846 +0.169 0.462 13 13/13

config default, campaign wind_tunnel, wind_direction_deg 337.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.928 1.000 -0.013 0.615 13 13/13
\(\lvert\mathbf{U}\rvert\) +0.920 0.923 +0.147 0.462 13 13/13

config h20, campaign wind_tunnel, wind_direction_deg 337.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.754 0.923 -0.002 0.769 13 13/13
\(\lvert\mathbf{U}\rvert\) +0.751 0.923 +0.092 0.692 13 13/13

config h5, campaign wind_tunnel, wind_direction_deg 337.5

Score R FAC2 FB Hit rate n coverage
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.954 1.000 +0.017 0.714 7 7/7
\(\lvert\mathbf{U}\rvert\) +0.936 0.857 +0.201 0.714 7 7/7

Case G — flow behind a tree belt

Score R FAC2 FB Hit rate n coverage
\(k\) +0.344 0.357 -0.827 0.071 28 28/28
\(\sqrt{\lvert\mathbf{U}\rvert^2 + 2k}\) +0.325 0.929 -0.526 0.036 28 28/28
\(\lvert\mathbf{U}\rvert\) +0.327 1.000 -0.407 0.071 28 28/28

Case H — 1:1:2 building with a floor point source

Score R FAC2 FB Hit rate n coverage
\(U\) +0.890 0.634 +0.313 0.476 826 826/826
\(V\) +0.938 0.369 -0.400 0.702 826 826/826
\(W\) +0.870 0.297 — 0.714 826 826/826
\(\lvert\mathbf{U}\rvert\) +0.875 0.683 +0.318 0.471 826 826/826
\(k\) -0.011 0.608 +0.302 0.339 826 826/826
\(c^\ast\) +0.947 0.636 -0.739 0.489 826 826/826

Case K — 9 x 9 cube array, point source

Score R FAC2 FB Hit rate n coverage
\(U\) +0.960 0.631 +0.527 0.232 203 203/203
\(V\) -0.142 0.049 — 0.901 203 203/203
\(W\) +0.629 0.133 — 0.680 203 203/203
\(\lvert\mathbf{U}\rvert\) +0.945 0.606 +0.506 0.192 203 203/203
\(k\) +0.357 0.261 +0.955 0.039 203 203/203
\(c^\ast\) +0.949 0.808 -0.751 0.478 203 203/203

Case L — 9 x 14 cube array, line source, non-isothermal

Score R FAC2 FB Hit rate n coverage
\(U\) +0.937 0.619 +0.225 0.532 344 344/344
\(V\) +0.185 0.198 -0.077 0.814 344 344/344
\(W\) +0.084 0.262 — 0.762 344 344/344
\(\lvert\mathbf{U}\rvert\) +0.917 0.669 +0.160 0.547 344 344/344
\(k\) +0.001 0.573 +0.455 0.285 344 344/344
\(c^\ast\) +0.758 0.701 -0.547 0.445 344 344/344
\(\theta\) +0.935 1.000 +0.027 0.994 344 344/344

Case M — TPU Atsugi campus

campaign wind_tunnel, wind_direction_deg 180.0

Score R FAC2 FB Hit rate n coverage
\(U\) +0.627 0.200 +1.064 0.133 15 15/15
\(V\) +0.701 0.267 — 0.133 15 15/15
\(W\) +0.117 0.333 +1.938 0.667 15 15/15
\(\lvert\mathbf{U}\rvert\) +0.540 0.667 +0.169 0.533 15 15/15
\(k\) +0.463 0.267 +0.875 0.133 15 15/15
\(c^\ast\) +0.354 0.133 +1.083 0.067 15 15/15