Hey, WeeWX'ers! TL:DR, scroll to the bottom for the question and scroll back as you need. ;-)
I posted last week about WU "capacity" issues and the need to increase wunderfixer timeout from 10 seconds to 20 seconds to compensate. That's working great, so far. This morning my RPI -> WMR300 comms went south due to the well-known, but as of yet unfixed issue somewhere between the Kernel/USB handling and the flakey firmware on the WMR300. :-/ My weewx_watchdog script went through all the paces that I designed it to do and all there worked perfectly. After my watchdog tried the weewx restart (which wasn't enough [never is in my case]), then after another 10 minutes passed, it did the reboot, and that got comms workings again. The reason I am writing is because of wunderfixer behavior that I though I had fully got my head around last week, but apparently not. :-/ My "outage" this morning started at 9:17 a.m. EDT., showing here: May 4 09:15:15 nixie weewx[9809]: manager: Added record 2019-05-04 09:15:00 EDT (1556975700) to database 'weewx.sdb' May 4 09:15:15 nixie weewx[9809]: manager: Added record 2019-05-04 09:15:00 EDT (1556975700) to daily summary in 'weewx.sdb' May 4 09:16:15 nixie weewx[9809]: manager: Added record 2019-05-04 09:16:00 EDT (1556975760) to database 'weewx.sdb' May 4 09:16:15 nixie weewx[9809]: manager: Added record 2019-05-04 09:16:00 EDT (1556975760) to daily summary in 'weewx.sdb' May 4 09:17:01 nixie CRON[21186]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) May 4 09:17:29 nixie weewx[9809]: wmr300: Loop data packets in heartbeat interval = 0 May 4 09:17:29 nixie weewx[9809]: wmr300: No loop data in heartbeat interval, restarting May 4 09:17:50 nixie weewx[9809]: wmr300: Loop data packets in heartbeat interval = 0 May 4 09:17:50 nixie weewx[9809]: wmr300: No loop data in heartbeat interval, restarting May 4 09:18:12 nixie weewx[9809]: wmr300: Loop data packets in heartbeat interval = 0 May 4 09:18:12 nixie weewx[9809]: wmr300: No loop data in heartbeat interval, restarting ... And the next recorded record after watchdog remediation was at 9:43 a.m. May 4 09:43:37 nixie weewx[382]: manager: Added record 2019-05-04 09:17:00 EDT (1556975820) to database 'weewx.sdb' So WU would have been missing any data between 9:16 a.m. and 9:44 a.m... In my weewx_watchdlog logs, which run wunderfixer for just such an occasion, I see that wunderfixer kicked in to upload missing records, which is expected, except look closely! Wunderfixer kept trying to upload records for every 1-minute of archive data, but from what I learned last week, I expected it would only try to upload records on roughly 5-minute boundaries, which I am further fudging with --epsilon=125 to workaround the WU issue with fractional minutes not aligned exactly to the 5-minute buckets. Scroll past for more... Sat 4 May 09:52:11 EDT 2019 Using configuration file /etc/weewx/weewx.conf. Sat 4 May 09:52:11 EDT 2019 Using database binding 'wx_binding', which is bound to database 'archive_sqlite' Sat 4 May 09:52:11 EDT 2019 Weather Underground Station: KMIDEARB5 Sat 4 May 09:52:11 EDT 2019 Date to check: 2019-05-04 Sat 4 May 09:52:11 EDT 2019 Number of archive records: 592 Sat 4 May 09:52:11 EDT 2019 Number of WU records: 115 Sat 4 May 09:52:11 EDT 2019 Number of missing records: 23 Sat 4 May 09:52:11 EDT 2019 Sat 4 May 09:52:11 EDT 2019 Missing records: Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:20:00 EDT (1556976000); 29.282"; 49.6F; 75%; 1.8 mph; 340 deg; 0.0 mph gust; 42.0F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:21:00 EDT (1556976060); 29.282"; 49.6F; 75%; 2.5 mph; 330 deg; 1.8 mph gust; 42.0F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:22:00 EDT (1556976120); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 2.9 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:23:00 EDT (1556976180); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 0.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:24:00 EDT (1556976240); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 4.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:25:00 EDT (1556976300); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 0.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:26:00 EDT (1556976360); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 4.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:27:00 EDT (1556976420); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 0.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:28:00 EDT (1556976480); 29.282"; 50.0F; 75%; 2.5 mph; 330 deg; 1.3 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:29:00 EDT (1556976540); 29.282"; 50.0F; 76%; 2.5 mph; 330 deg; 0.0 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:30:00 EDT (1556976600); 29.282"; 50.2F; 75%; 1.8 mph; 351 deg; 4.0 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:31:00 EDT (1556976660); 29.282"; 50.2F; 76%; 1.8 mph; 351 deg; 2.5 mph gust; 42.9F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:32:00 EDT (1556976720); 29.282"; 50.2F; 76%; 1.8 mph; 351 deg; 2.0 mph gust; 42.9F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:33:00 EDT (1556976780); 29.282"; 50.2F; 75%; 1.8 mph; 351 deg; 1.8 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:34:00 EDT (1556976840); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 4.0 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:35:00 EDT (1556976900); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 0.0 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:36:00 EDT (1556976960); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.9 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:37:00 EDT (1556977020); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.5 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:38:00 EDT (1556977080); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.5 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:39:00 EDT (1556977140); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 2.5 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:40:00 EDT (1556977200); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 2.9 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:41:00 EDT (1556977260); 29.279"; 50.5F; 74%; 1.8 mph; 2 deg; 2.0 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 09:52:11 EDT 2019 2019-05-04 09:42:00 EDT (1556977320); 29.279"; 50.5F; 75%; 1.8 mph; 2 deg; 0.0 mph gust; 42.9F; 0.00" rain ...published. I have weewx_watchdog running wunderfixer every 10 minutes, and it continued to try to re-upload those 23 records on that interval up until the following time-frame: Scroll past for more... Sat 4 May 12:22:10 EDT 2019 Using configuration file /etc/weewx/weewx.conf. Sat 4 May 12:22:10 EDT 2019 Using database binding 'wx_binding', which is bound to database 'archive_sqlite' Sat 4 May 12:22:10 EDT 2019 Weather Underground Station: KMIDEARB5 Sat 4 May 12:22:10 EDT 2019 Date to check: 2019-05-04 Sat 4 May 12:22:10 EDT 2019 Number of archive records: 742 Sat 4 May 12:22:10 EDT 2019 Number of WU records: 145 Sat 4 May 12:22:10 EDT 2019 Number of missing records: 23 Sat 4 May 12:22:10 EDT 2019 Sat 4 May 12:22:10 EDT 2019 Missing records: Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:20:00 EDT (1556976000); 29.282"; 49.6F; 75%; 1.8 mph; 340 deg; 0.0 mph gust; 42.0F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:21:00 EDT (1556976060); 29.282"; 49.6F; 75%; 2.5 mph; 330 deg; 1.8 mph gust; 42.0F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:22:00 EDT (1556976120); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 2.9 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:23:00 EDT (1556976180); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 0.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:24:00 EDT (1556976240); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 4.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:25:00 EDT (1556976300); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 0.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:26:00 EDT (1556976360); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 4.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:27:00 EDT (1556976420); 29.282"; 49.8F; 75%; 2.5 mph; 330 deg; 0.0 mph gust; 42.2F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:28:00 EDT (1556976480); 29.282"; 50.0F; 75%; 2.5 mph; 330 deg; 1.3 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:29:00 EDT (1556976540); 29.282"; 50.0F; 76%; 2.5 mph; 330 deg; 0.0 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:30:00 EDT (1556976600); 29.282"; 50.2F; 75%; 1.8 mph; 351 deg; 4.0 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:31:00 EDT (1556976660); 29.282"; 50.2F; 76%; 1.8 mph; 351 deg; 2.5 mph gust; 42.9F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:32:00 EDT (1556976720); 29.282"; 50.2F; 76%; 1.8 mph; 351 deg; 2.0 mph gust; 42.9F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:33:00 EDT (1556976780); 29.282"; 50.2F; 75%; 1.8 mph; 351 deg; 1.8 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:34:00 EDT (1556976840); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 4.0 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:35:00 EDT (1556976900); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 0.0 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:36:00 EDT (1556976960); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.9 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:37:00 EDT (1556977020); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.5 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:38:00 EDT (1556977080); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.5 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:39:00 EDT (1556977140); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 2.5 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:40:00 EDT (1556977200); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 2.9 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:41:00 EDT (1556977260); 29.279"; 50.5F; 74%; 1.8 mph; 2 deg; 2.0 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 12:22:10 EDT 2019 2019-05-04 09:42:00 EDT (1556977320); 29.279"; 50.5F; 75%; 1.8 mph; 2 deg; 0.0 mph gust; 42.9F; 0.00" rain ...published. Then on the next 10-minute interval, wunderfixer did what I would call exactly the right thing, because the remaining 8 missing records are all on 5-minute boundaries (or close as in within 125 seconds). Scroll past for more... Sat 4 May 12:42:12 EDT 2019 Using configuration file /etc/weewx/weewx.conf. Sat 4 May 12:42:12 EDT 2019 Using database binding 'wx_binding', which is bound to database 'archive_sqlite' Sat 4 May 12:42:12 EDT 2019 Weather Underground Station: KMIDEARB5 Sat 4 May 12:42:12 EDT 2019 Date to check: 2019-05-04 Sat 4 May 12:42:12 EDT 2019 Number of archive records: 762 Sat 4 May 12:42:12 EDT 2019 Number of WU records: 160 Sat 4 May 12:42:12 EDT 2019 Number of missing records: 8 Sat 4 May 12:42:12 EDT 2019 Sat 4 May 12:42:12 EDT 2019 Missing records: Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:35:00 EDT (1556976900); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 0.0 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:36:00 EDT (1556976960); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.9 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:37:00 EDT (1556977020); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.5 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:38:00 EDT (1556977080); 29.279"; 50.4F; 75%; 1.8 mph; 351 deg; 2.5 mph gust; 42.7F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:39:00 EDT (1556977140); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 2.5 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:40:00 EDT (1556977200); 29.279"; 50.4F; 74%; 1.8 mph; 351 deg; 2.9 mph gust; 42.4F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:41:00 EDT (1556977260); 29.279"; 50.5F; 74%; 1.8 mph; 2 deg; 2.0 mph gust; 42.6F; 0.00" rain ...published. Sat 4 May 12:42:12 EDT 2019 2019-05-04 09:42:00 EDT (1556977320); 29.279"; 50.5F; 75%; 1.8 mph; 2 deg; 0.0 mph gust; 42.9F; 0.00" rain ...published. The above 8 records did "stick" and after that, wunderfixer hasn't shown any missing records. So my question is as follows: Why would wunderfixer keep trying to post the every 1-minute records after loss of comms with the station? NOTE: My archive interval is 60 seconds, and those records would have in fact not been uploaded, but I don't get how wunderfixer would "know" to keep uploading them when I thought that I established last week that the WU historical query only ever returns 5-minute buckets anyway? Turns out, after wunderfixer was persistent enough, the WU query did in fact start showing some of those records on the 1-minute boundaries!!! https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=KMIDEARB5&month=5&day=4&year=2019&format=1 Hmm... I wasn't expecting wunderfixer would even "know" to keep uploading those 1-minute boundary records, when --epsilon is 125? OH! I get it! It's because in fact there was a ~30 minute actual gap in data and all those in between records are more than 125 seconds either side of the before/after outage timestamps. The --epsilon {secs} isn't trying to bound the records to 5-minute intervals, it's just comparing to the timestamps of whatever data is there, and there was a huge gap, so ALL the in-between records, even the ones on 1-minute intervals were deemed as needing to be re-uploaded. BUT, then still... How is it that WU will keep 1-minute records, when normally it apparently throws away everything other than those that are on the 5-minute boundaries? Strange that WU eventually kept those 1-minute records, but only after persistent re-uploads. In this case after 16 wunderfixer uploads, the 17th stuck! Or perhaps it is just that there is a huge lag from the time the records are uploaded until they are posted. Anyone know? Maybe by way of an enhancement, wunderfixer could further filter out records that are not within --epsilon {seconds} of a 5-minute boundary, just to save extra re-uploading / strain on the WU side. Maybe I'll try to find time to take that one on. HA! =D Regards, \Leon -- Leon Shaner :: Dearborn, Michigan (iPad Pro) -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
