WLModelComparisons
22 Nov 2009 00:01 UTC 2009326+0001 UTC

WL Model Comparisons

You will find listed in the tables below performance comparisons for several water level forecasting models. The models are Harmonic Forecasts (HR) (also known as tide charts), Persistent Model (Pers), Linear Regression Model (LR), and Neural Networks Model (NN). The comparisons are for 24 hour forecasts and 48 hour forecasts. 2 benchmark tests are presented in the tables. The first test is labeled Operational Model Performance Comparisons and the second test is labeled Average Model Performance Comparisons. Read below for more details on the tests. The models are compared using the root mean square error (RMSE) and the following NOS criteria: Central Frequency (15 cm), Positive Outlier Frequency (30 cm), Negative Outlier Frequency (30 cm), Maximum Duration of Positive Outliers (30 cm) and Maximum Duration of Negative Outliers (30 cm).

TODO: add units for skill variables

NOS Procedures for Developing and Implementing Operational Nowcast and Forecast Systems for PORTS

OPERATIONAL MODEL PERFORMANCE COMPARISONS:

This test compares the performance of the models when applied to the three year span starting January 1st 2000 and ending December 31st 2002. The models are all trained and optimized over data originating before January 1st 2000. Predictions for the Harmonic, Persistence, and Neural Network models are updated at least hourly for all the stations below.

Bob Hall Pier (014)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.11484.220.3511.6481754
Pers 24hr0.08691.960.4540.16688
LR 24hr0.22493.230.3300.1661716
NN 24hr0.07594.640.3010.10486
Pers 48hr0.11484.301.5220.8793014
LR 48hr0.18876.630.726 2346
NN 48hr0.10288.220.9020.5702216

Rockport (015)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.11681.550.081.73660
Pers 24hr0.06496.530.080.0050
LR 24hr0.07477.860.1630.0060
NN 24hr0.05098.720.020.0020
Pers 48hr0.09588.570.400.281416
LR 48hr0.10382.540.3670.2301417
NN 48hr0.08292.850.210.0692

Port Aransas (009)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.11283.730.311.531943
Pers 24hr0.07594.180.250.0390
LR 24hr0.17294.851.0530.016242
NN 24hr0.07095.680.160.0270
Pers 48hr0.10386.981.140.412010
LR 48hr0.20889.761.7570.2564836
NN 48hr0.09389.890.510.24239

Sabine Pass ()

ModelRMSECFPOFNOFMDPOMDNO
Harmonic      
Pers 24hr      
LR 24hr      
NN 24hr      
Pers 48hr      
LR 48hr      
NN 48hr      

Packery Channel / JFK Causeway (005)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.10885.140.002.31071
Pers 24hr0.05597.480.060.0150
LR 24hr0.10197.310.7130.002240
NN 24hr0.04499.200.000.0000
Pers 48hr0.07893.020.250.12127
LR 48hr0.12493.271.1150.1614822
NN 48hr0.06896.000.120.0655

Pleasure Pier (021)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.14972.811.413.392872
Pers 24hr0.14679.653.072.292529
LR 24hr0.14983.692.4281.3142634
NN 24hr0.12384.602.340.802220
Pers 48hr0.17271.204.493.803933
LR 48hr0.13771.472.5011.5963547
NN 48hr0.14079.052.382.383824

Port O'Connor (057)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.11980.560.831.231946
Pers 24hr0.08791.110.600.09145
LR 24hr0.33891.921.4160.106336
NN 24hr0.07095.580.130.1074
Pers 48hr0.11782.581.570.903124
LR 48hr0.34668.552.0160.3113828
NN 48hr0.09988.150.850.521811

Port Isabel (018)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.09390.260.160.93831
Pers 24hr0.06995.620.140.0583
LR 24hr0.07896.420.1750.039175
NN 24hr0.05898.160.020.0312
Pers 48hr0.09090.770.650.14176
LR 48hr0.11493.140.5980.2292744
NN 48hr0.07794.350.270.151112

Morgans Point (503)

ModelRMSECFPOFNOFMDPOMDNO
Harmonic0.17467.313.884.564774
Pers 24hr0.17871.245.294.183134
LR 24hr0.11055.612.8571.3281822
NN 24hr0.14280.364.130.682612
Pers 48hr0.21961.647.837.224744
LR 48hr0.17364.544.7423.0245165
NN 48hr0.17571.356.261.695921

Page last modified on September 29, 2005, at 09:28 PM