Note

Please report issues with the manual on the GitHub page.

11. Benchmark Report

Since v2018a, SUEWS is benchmarked against observations collected at LUMO with emphases on surface energy balance components.

Note

ONLY the variables below are used for benchmark:
  • Kdown
  • Kup
  • Ldown
  • Lup
  • QE
  • QF
  • QH
  • QN
  • QS

11.1. Performance Score

Note

Large scores indicate better performance.

SUEWS benchmark score
score
cfg
ref 33.9307
v2016a 33.9307
v2018a 41.4831
v2018b 67.7732

The scores are calculated according to weighted averages of statistics for selected benchmark variables.

11.2. Detailed Statistics

Note

Grids are coloured based relative performance between different versions: a greener grid indicates better performance in the chosen variable using the specific release whereas a redder one shows poorer performance; and those with gray backgrounds indicate the same performance across different releases.

SUEWS benchmark statistics
cfg ref v2016a v2018a v2018b
stat var
MAE Kdown 22.06 22.06 22.06 22.06
Kup 4.24 4.24 4.24 4.23
Ldown 26.73 26.73 26.73 26.73
Lup 7.84 7.84 7.84 7.84
QE 16.76 16.76 18.46 14.3
QF 33.06 33.06 33.07 33.09
QH 35.73 35.73 34.51 35.14
QN 35.33 35.33 35.33 35.33
QS 71.5 71.5 68.23 63.84
MBE Kdown -0.94 -0.94 -0.94 -0.94
Kup -1.29 -1.29 -1.29 -1.31
Ldown 2.34 2.34 2.34 2.34
Lup -5.18 -5.18 -5.18 -5.18
QE 9.05 9.05 11.2 5.34
QF -26.23 -26.23 -26.19 -26.23
QH -2.32 -2.32 -4.42 -6.44
QN 7.87 7.87 7.87 7.89
QS 25.63 25.63 25.62 33.47
RMSE Kdown 41.06 41.06 41.06 41.06
Kup 6.71 6.71 6.71 6.69
Ldown 30.02 30.02 30.02 30.02
Lup 9.31 9.31 9.31 9.31
QE 24.05 24.05 27.72 20.29
QF 47.49 47.49 47.47 47.51
QH 45.16 45.16 43.31 45.09
QN 45.38 45.38 45.38 45.37
QS 88.06 88.06 83.76 78.48