WaterLevelPerformance
10 Oct 2008 22:01 UTC 2008284+2201 UTC

You will find in the tables below a comparison of the ANN performance with the Tide charts and a simple persistence model.

The performance is evaluated using a National Ocean Service standard, the Central Frequency of 15 cm for each model/location, i.e. the percentage of predictions that are within 15 cm of the measured water level.

Sabine Pass

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN97.596.094.092.991.790.989.6
Persistence Model94.191.085.583.579.477.175.3
Tide Charts70.470.470.370.370.270.270.2

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN6.17.18.18.59.09.09.6
Persistence Model8.09.71.21.31.51.51.6
Tide Charts15.015.015.015.015.015.015.0

Optimized by Sergey Reid

Port Aransas

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.699.097.997.3 95.093.2
Persistence Model99.297.895.994.0 89.786.9
Tide Charts81.581.581.581.5 81.681.6

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN4.05.15.96.4 7.68.3
Persistence Model4.65.96.97.6 9.410.4
Tide Charts11.711.711.711.7 11.711.7

Optimized by Angelica Villarreal

Ingleside

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.999.899.498.697.796.594.6
Persistence Model99.999.297.996.293.991.989.3
Tide Charts80.980.980.980.980.980.980.9

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN2.53.84.85.76.47.17.9
Persistence Model3.04.65.76.67.58.49.6
Tide Charts11.911.911.911.911.911.911.9

Optimized by Angelica Villarreal

Texas State Aquarium

Model trained on 1 year of hourly data, 2004. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.999.899.498.998.097.095.2
Persistence Model99.898.997.796.093.891.588.8
Tide Charts80.480.480.480.580.580.580.5

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN2.83.74.65.36.16.87.6
Persistence Model3.55.06.06.77.78.69.7
Tide Charts12.012.012.012.012.012.012.0

Optimized by Sergey Reid

Bob Hall Pier

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.598.697.396.394.8 91.0
Persistence Model98.896.193.591.789.1 84.2
Tide Charts81.381.381.381.381.3 81.3

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN4.35.56.36.97.6 8.8
Persistence Model5.17.08.18.99.8 11.6
Tide Charts12.112.112.112.112.1 12.1

Optimized by Dr. Philippe Tissot & Sergey Reid

Bird Island

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN 99.9799.9599.97 99.999.6
Persistence Model 99.9699.899.7 99.098.1
Tide Charts 84.384.378.5 84.384.3

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN 1.82.1  3.54.2
Persistence Model 2.53.13.6 4.85.6
Tide Charts 11.111.112.0 11.111.1

Optimized by Dr. Philippe Tissot

Port Isabel

Model trained on 1 year of hourly data, 1998. The performance is computed based on 4 years of hourly data (2000-2003).

Central Frequency (% within 15 cm)

Prediction6 hours (%)12hours (%)18 hours (%)24 hours (%)30 hours (%)36 hours (%)48 hours (%)
ANN99.9399.6199.05 97.6396.8695.26
Persistence Model99.798.3796.67 93.7192.0990.32
Tide Charts85.9787.0187.01 87.0087.086.97

Root Mean Square Error (cm)

Prediction6 hours12 hours18 hours24 hours30 hours36 hours48 hours
ANN 4.45.1 6.26.77.5
Persistence Model4.05.76.6 7.98.59.3
Tide Charts10.710.410.4 10.410.410.4

Optimized by Angelica Villarreal & Sergey Reid

Page last modified on October 10, 2008, at 03:16 PM