WaterLevelPerformance
22 Mar 2010 08:57 UTC 2010081+0857 UTC

You will find in the tables below a comparison of the ANN performance with the Tide charts and a simple persistence model.

The performance is evaluated using a National Ocean Service standard, the Central Frequency of 15 cm for each model/location, i.e. the percentage of predictions that are within 15 cm of the measured water level. The models are evaluated based on a perfect prog approach for the wind predictions. While the performance of the NAM model was verified to be unbiased and of good quality for the stations below, the predictions are not perfect. Actual ANN water level predictions will be lower depending on the accuracy of the NAM wind predictions.

Bird Island

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction12hours (%)18 hours (%)24 hours (%)36 hours (%)48 hours (%)
ANN99.9799.9599.9799.999.6
Persistence Model99.9699.899.799.098.1
Tide Charts84.384.378.584.384.3

Root Mean Square Error (cm)

Prediction12 hours18 hours24 hours36 hours48 hours
ANN1.82.1 3.54.2
Persistence Model2.53.13.64.85.6
Tide Charts11.111.112.011.111.1

Optimized by Dr. Philippe Tissot

Bob Hall Pier

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)48 hours (%)
ANN99.598.697.396.394.891.0
Persistence Model98.896.193.591.789.184.2
Tide Charts81.381.381.381.381.381.3

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours48 hours
ANN4.35.56.36.97.68.8
Persistence Model5.17.08.18.99.811.6
Tide Charts12.112.112.112.112.112.1

Optimized by Dr. Philippe Tissot & Sergey Reid

Eagle Point

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.2597.0094.5493.1290.9489.5288.22
Persistence Model95.9388.4082.5178.4674.5771.6068.67
Tide Charts70.3570.3770.3870.3770.3470.2970.26

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN4.66.57.88.59.29.610.0
Persistence Model6.810.713.615.617.318.419.2
Tide Charts16.116.116.116.116.116.216.2

Optimized by Samantha Quisenberry

USCG Freeport

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN98.4796.1993.8792.5990.8489.6788.18
Persistence Model96.6591.3086.9084.4480.9078.2575.89
Tide Charts76.2176.2276.2276.1676.1076.0776.05

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN5.57.28.38.89.49.810.2
Persistence Model6.79.411.312.613.914.815.4
Tide Charts14.014.014.014.014.014.014.0

Optimized by Sergey Reid

Galveston Pleasure Pier

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN96.8994.5592.0290.9489.388.5687.23
Persistence Model93.5487.8982.5579.8476.273.7171.36
Tide Charts70.8670.8770.8670.8170.870.7670.76

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN6.67.99.09.49.910.210.5
Persistence Model8.311.013.515.016.317.217.6
Tide Charts15.615.615.615.615.615.615.6

Optimized by Sergey Reid

Ingleside

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.999.899.498.697.796.594.6
Persistence Model99.999.297.996.293.991.989.3
Tide Charts80.980.980.980.980.980.980.9

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN2.53.84.85.76.47.17.9
Persistence Model3.04.65.76.67.58.49.6
Tide Charts11.911.911.911.911.911.911.9

Optimized by Angelica Villarreal

Manchester Houston

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN96.7093.2990.3488.7586.8885.9084.90
Persistence Model89.1379.9573.9471.0964.9561.4559.76
Tide Charts65.5865.5965.6365.6365.6165.5865.60

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN7.49.510.811.512.212.612.9
Persistence Model10.615.118.320.422.724.225.2
Tide Charts19.719.719.619.719.719.719.7

Optimized by Cindy Valencia

Packery Channel

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.9499.7099.3098.8698.0897.2195.73
Persistence Model99.9198.5598.6697.4796.2595.0593.30
Tide Charts82.6782.6582.6382.6382.6382.6382.62

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN2.43.54.34.95.76.37.2
Persistence Model2.63.84.85.56.37.07.8
Tide Charts11.411.411.411.411.411.411.4

Optimized by Sergey Reid

Port Aransas

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)36 hours (%)48 hours (%)
ANN99.699.097.997.395.093.2
Persistence Model99.297.895.994.089.786.9
Tide Charts81.581.581.581.581.681.6

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours36 hours48 hours
ANN4.05.15.96.47.68.3
Persistence Model4.65.96.97.69.410.4
Tide Charts11.711.711.711.711.711.7

Optimized by Angelica Villarreal

Port Arthur

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN98.5895.7693.0191.4188.9689.5488.23
Persistence Model96.5691.4586.1382.7278.8376.2373.82
Tide Charts66.6466.6466.6466.6166.5666.5166.49

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN 7.08.49.19.9  
Persistence Model6.59.211.412.914.315.215.6
Tide Charts15.915.915.915.915.915.915.9

Optimized by Sergey Reid

Port Isabel

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.9399.6199.0598.4997.6396.8695.26
Persistence Model99.798.3796.6795.4593.7192.0990.32
Tide Charts85.9787.0187.0187.0187.0087.086.97

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN 4.45.15.76.26.77.5
Persistence Model4.05.76.67.17.98.59.3
Tide Charts10.710.410.410.410.410.410.4

Optimized by Angelica Villarreal & Sergey Reid

Rockport

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.8899.8499.7499.3198.3197.1094.86
Persistence Model99.8199.3898.0196.3894.2192.0388.89
Tide Charts80.0080.0080.0080.0080.0080.0180.00

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN1.93.03.74.65.56.37.4
Persistence Model2.74.25.46.57.58.39.5
Tide Charts12.012.012.012.012.012.012.0

Optimized by Sergey Reid

Sabine Pass

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN97.596.094.092.991.790.989.6
Persistence Model94.191.085.583.579.477.175.3
Tide Charts70.470.470.370.370.270.270.2

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN6.17.18.18.59.09.09.6
Persistence Model8.09.71.21.31.51.51.6
Tide Charts15.015.015.015.015.015.015.0

Optimized by Sergey Reid

Texas State Aquarium

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.999.899.498.998.097.095.2
Persistence Model99.898.997.796.093.891.588.8
Tide Charts80.480.480.480.580.580.580.5

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN2.83.74.65.36.16.87.6
Persistence Model3.55.06.06.77.78.69.7
Tide Charts12.012.012.012.012.012.012.0

Optimized by Sergey Reid

Page last modified on November 18, 2009, at 12:04 AM