11. Benchmark Report

Since v2018a, SUEWS is benchmarked against observations collected at LUMO with emphases on surface energy balance components.

11.1. Performance Score

Note

Large scores indicate better performance.

score
cfg
ref 41.6667
v2016a 41.6667
v2018a 58.3333

The scores are calculated according to weighted averages of statistics for selected benchmark variables.

11.2. Detailed Statistics

Note

Grids are coloured based relative performance between different versions: a greener grid indicates better performance in the chosen variable using the specific release whereas a redder one shows poorer performance; and those with gray backgrounds indicate the same performance across different releases.

cfg ref v2016a v2018a
stat var
MBE Kdown -0.94 -0.94 -0.94
Kup -1.29 -1.29 -1.29
Ldown 2.34 2.34 2.34
Lup -5.18 -5.18 -5.18
QE 9.05 9.05 11.2
QF -26.23 -26.23 -26.19
QH -2.32 -2.32 -4.42
QN 7.87 7.87 7.87
QS 25.63 25.63 25.62
MAE Kdown 22.06 22.06 22.06
Kup 4.24 4.24 4.24
Ldown 26.73 26.73 26.73
Lup 7.84 7.84 7.84
QE 16.76 16.76 18.46
QF 33.06 33.06 33.07
QH 35.73 35.73 34.51
QN 35.33 35.33 35.33
QS 71.5 71.5 68.23
RMSE Kdown 41.06 41.06 41.06
Kup 6.71 6.71 6.71
Ldown 30.02 30.02 30.02
Lup 9.31 9.31 9.31
QE 24.05 24.05 27.72
QF 47.49 47.49 47.47
QH 45.16 45.16 43.31
QN 45.38 45.38 45.38
QS 88.06 88.06 83.76