Thanks, that seems pretty conclusive. There are two archive records in the console output you attached that contain leafTemp1 and friends, we have all of the loop packets for each of those archive intervals and none of the loop packets contain leafTemp1 or friends. This is consistent with the loop packets we were seeing direct from the driver yesterday; none of them contained leafTemp1 or friends either. The implication is that leafTemp1 is not appearing through the loop packets. So it must be coming in through the hardware archive record the driver obtains from the logger or some other code must be adding it. Within the 4.6.0b3 code base leafTempx only appears in the vantage driver, weewx/drivers/vantage.py. The only non-core WeeWX code you are running is the Windy uploader, the Windy uploader has no concept of leafTemp so it is not the source. One of the WeeWX services such as StdWXCalculate could be calculating leafTemp1, but if that was the case leafTemp1 would need to appear in your weewx.conf; it does not.
So we are left with the hardware archive record. I strongly suspect that when interrogated for a hardware archive record your logger is returning data in a number of fields for non-existent sensors, this suggests the logger is faulty. The driver is then decoding this data and leafTemp1 and friends appear in the archive record. Interesting, we have only seen two archive records but each field seems to always have the same value. I've not heard of such a fault before, but I am no Davis expert, perhaps when Tom is back he may have something to add. Actually, I do seem to remember a Davis user some time ago getting bogus UV or radiation values when they did not have either UV or solar sensors. Cannot remember any further details though. So what to do. There are a couple of things you can do within WeeWX. First you can force all of the bogus data fields to None using [StdCalibrate] [[Corrections]] <http://weewx.com/docs/usersguide.htm#[[Corrections]]> in weewx.conf, eg: [StdCalibrate] [[Corrections]] leafTemp1 = None leafTemp2 = None etc This will be applied to both loop packets and archive records before they are saved to database. Setting the field to None (rather than 0.0) effectively sees WeeWX ignore them and nothing will be written to database in those fields. Second, you could change record generation <http://weewx.com/docs/usersguide.htm#StdArchive> from hardware to software. With hardware generation the driver obtains the archive record from the hardware, with software record generation WeeWX synthesises an archive record from the accumulated loop data received during an archive interval. You are presently using hardware record generation so you would change to software record generation. To do this, in weewx.conf under [StdArchive] set record_generation = software and restart WeeWX. There are no disadvantages to software record generation that I am aware of, it was the case that you lost the ability to backfill archive records if WeeWX is off line for some reason, but that has not been the case for some time now. If your station does backfill if WeeWX goes offline hardware archive records will be obtained from the logger which could contain the bogus fields again. So I would make sure the corrections mentioned previously are in place. Non-WeeWX options wise you could replace the logger, though it's only supposition on my part that the logger is the problem. Perhaps an expensive test for perhaps little gain. You used wee_device --clear-memory to clear the logger memory, you could take that a step further and remove the logger from the console, remove all power from the console (including batteries), wait for ten minutes then re-seat the logger and re-power the console, do another wee_device --clear-memory and see if it comes good - this is real clutching at straws stuff though. Finally, whatever solution you do you once you have implemented it you are going to have to clear the bogus data from your archive again using an SQLite update query on each field concerned (setting each to NULL) and then you will need to rebuild the daily summaries again. Gary On Friday, 15 October 2021 at 12:54:33 UTC+10 bill.g...@gmail.com wrote: > > Here you go. > Oct 14 19:34:58 weewx weewx[20997] INFO __main__: Received signal TERM > (15). > Oct 14 19:34:58 weewx weewx[20997] INFO weewx.engine: Main loop exiting. > Shutting engine down. > Oct 14 19:34:58 weewx weewx[20997] INFO weewx.engine: Shutting down > StdReport thread > Oct 14 19:34:58 weewx weewx[20997] INFO __main__: Terminating weewx > version 4.6.0b3 > Oct 14 19:34:59 weewx weewx[29686]: Stopping weewx weather system: weewx. > Oct 14 19:35:24 weewx weewx[29782] INFO __main__: Initializing weewx > version 4.6.0b3 > Oct 14 19:35:24 weewx weewx[29782] INFO __main__: Using Python 3.7.3 > (default, Jan 22 2021, 20:04:44) #012[GCC 8.3.0] > Oct 14 19:35:24 weewx weewx[29782] INFO __main__: Platform > Linux-5.10.63-v7+-armv7l-with-debian-10.11 > Oct 14 19:35:24 weewx weewx[29782] INFO __main__: Locale is > 'LC_CTYPE=en_US.UTF-8;LC_NUMERIC=en_US.UTF-8;LC_TIME=C.UTF-8;LC_COLLATE=en_US.UTF-8;LC_MONETARY=en_US.UTF-8;LC_MESSAGES=en_US.UTF-8;LC_PAPER=en_US.UTF-8;LC_NAME=en_US.UTF-8;LC_ADDRESS=en_US.UTF-8;LC_TELEPHONE=en_US.UTF-8;LC_MEASUREMENT=en_US.UTF-8;LC_IDENTIFICATION=en_US.UTF-8' > Oct 14 19:35:24 weewx weewx[29782] INFO __main__: Using configuration file > /etc/weewx/weewx.conf > Oct 14 19:35:24 weewx weewx[29782] INFO __main__: Debug is 1 > Oct 14 19:35:24 weewx weewx[29782] DEBUG __main__: Initializing engine > Oct 14 19:35:24 weewx weewx[29782] INFO weewx.engine: Loading station type > Vantage (weewx.drivers.vantage) > Oct 14 19:35:24 weewx weewx[29782] DEBUG weewx.drivers.vantage: Driver > version is 3.2.3 > Oct 14 19:35:24 weewx weewx[29782] DEBUG weewx.drivers.vantage: Option > loop_request=1 > Oct 14 19:35:24 weewx weewx[29782] DEBUG weewx.drivers.vantage: Opened up > serial port /dev/ttyUSB0; baud 19200; timeout 5.00 > Oct 14 19:35:24 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:35:24 weewx weewx[29782] DEBUG weewx.drivers.vantage: Hardware > type is 17 > Oct 14 19:35:24 weewx weewx[29782] DEBUG weewx.drivers.vantage: ISS ID is 1 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.drivers.vantage: Hardware > name: Vantage Vue > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdTimeSynch > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdTimeSynch > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdConvert > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.engine: StdConvert target > unit is 0x1 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdConvert > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdCalibrate > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdCalibrate > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdQC > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdQC > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.wxservices.StdWXCalculate > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.wxservices: StdWXCalculate > will use data binding wx_binding > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.wxservices.StdWXCalculate > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.wxxtypes.StdWXXTypes > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.wxxtypes.StdWXXTypes > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.wxxtypes.StdPressureCooker > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.wxxtypes.StdPressureCooker > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.wxxtypes.StdRainRater > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.wxxtypes.StdRainRater > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.wxxtypes.StdDelta > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.wxxtypes.StdDelta > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdArchive > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.engine: Archive will use > data binding wx_binding > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.engine: Record generation > will be attempted in 'hardware' > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.engine: Using archive > interval of 300 seconds (specified by hardware) > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Use LOOP data in > hi/low calculations: 1 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdArchive > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.restx.StdStationRegistry > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.restx: StationRegistry: > Station will be registered. > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.restx.StdStationRegistry > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.restx.StdWunderground > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.restx: WU essentials: {} > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.restx: Wunderground-PWS: > Data for station KCAGEORG10 will be posted > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.restx.StdWunderground > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.restx.StdPWSweather > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.restx: PWSWeather: Data for > station KCAGEORG10 will be posted > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.restx.StdPWSweather > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.restx.StdCWOP > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.restx: CWOP: Data for > station EW6476 will be posted > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.restx.StdCWOP > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > user.windy.Windy > Oct 14 19:35:25 weewx weewx[29782] INFO user.windy: version is 0.7 > Oct 14 19:35:25 weewx weewx[29782] INFO user.windy: Data will be uploaded > to https://stations.windy.com/pws/update > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service user.windy.Windy > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdPrint > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdPrint > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Loading service > weewx.engine.StdReport > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.engine: Finished loading > service weewx.engine.StdReport > Oct 14 19:35:25 weewx weewx[29782] INFO __main__: Starting up weewx > version 4.6.0b3 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.engine: Clock error is 1.49 > seconds (positive is fast) > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.engine: Using binding > 'wx_binding' to database 'weewx.sdb' > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.manager: Starting backfill > of daily summaries > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:35:25 weewx weewx[29782] INFO weewx.manager: Daily summaries up > to date > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.drivers.vantage: Getting > archive packets since 2021-10-14 19:30:00 PDT (1634265000) > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.drivers.vantage: Retrieving > 1 page(s); starting index= 2 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:35:25 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:35:26 weewx weewx[29782] DEBUG weewx.drivers.vantage: Empty > record page 0; index 3 > Oct 14 19:35:26 weewx weewx[29782] INFO weewx.engine: Starting main packet > loop. > Oct 14 19:35:26 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:35:26 weewx weewx[29782] DEBUG weewx.drivers.vantage: Requesting > 200 LOOP packets. > Oct 14 19:35:26 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:35:26 weewx weewx[29782] DEBUG weewx.restx: CWOP: Connected to > server cwop.aprs.net:14580 > Oct 14 19:40:15 weewx weewx[29782] DEBUG weewx.drivers.vantage: Getting > archive packets since 2021-10-14 19:35:00 PDT (1634265300) > Oct 14 19:40:15 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:40:15 weewx weewx[29782] DEBUG weewx.drivers.vantage: Retrieving > 1 page(s); starting index= 3 > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.drivers.vantage: Empty > record page 0; index 4 > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.restx: StationRegistry: > wait interval (300 < 604800) has not passed for record 2021-10-14 19:40:00 > PDT (1634265600) > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.restx: CWOP: wait interval > (300 < 600) has not passed for record 2021-10-14 19:40:00 PDT (1634265600) > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.reportengine: Running > reports for latest time in the database. > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.drivers.vantage: Requesting > 200 LOOP packets. > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.reportengine: Running > report 'SeasonsReport' > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:40:16 weewx weewx[29782] DEBUG weewx.reportengine: Found > configuration file /etc/weewx/skins/Seasons/skin.conf for report > 'SeasonsReport' > Oct 14 19:40:17 weewx weewx[29782] DEBUG weewx.cheetahgenerator: Using > search list ['weewx.cheetahgenerator.Almanac', > 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Current', > 'weewx.cheetahgenerator.Stats', 'weewx.cheetahgenerator.UnitInfo', > 'weewx.cheetahgenerator.Extras', 'weewx.cheetahgenerator.JSONHelpers', > 'weewx.cheetahgenerator.Gettext'] > Oct 14 19:40:17 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:40:31 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:41:06 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'SmartphoneReport' not enabled. Skipping. > Oct 14 19:41:06 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'MobileReport' not enabled. Skipping. > Oct 14 19:41:06 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'StandardReport' not enabled. Skipping. > Oct 14 19:41:06 weewx weewx[29782] DEBUG weewx.reportengine: Report 'FTP' > not enabled. Skipping. > Oct 14 19:41:06 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'RSYNC' not enabled. Skipping. > Oct 14 19:45:01 weewx CRON[31005]: (root) CMD (command -v debian-sa1 > > /dev/null && debian-sa1 1 1) > Oct 14 19:45:15 weewx weewx[29782] DEBUG weewx.drivers.vantage: Getting > archive packets since 2021-10-14 19:40:00 PDT (1634265600) > Oct 14 19:45:15 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:45:15 weewx weewx[29782] DEBUG weewx.drivers.vantage: Retrieving > 1 page(s); starting index= 4 > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.restx: StationRegistry: > wait interval (600 < 604800) has not passed for record 2021-10-14 19:45:00 > PDT (1634265900) > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.reportengine: Running > reports for latest time in the database. > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.reportengine: Running > report 'SeasonsReport' > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.drivers.vantage: Requesting > 200 LOOP packets. > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.drivers.vantage: Gentle > wake up of console successful > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.reportengine: Found > configuration file /etc/weewx/skins/Seasons/skin.conf for report > 'SeasonsReport' > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.restx: CWOP: Connected to > server cwop.aprs.net:14580 > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.cheetahgenerator: Using > search list ['weewx.cheetahgenerator.Almanac', > 'weewx.cheetahgenerator.Station', 'weewx.cheetahgenerator.Current', > 'weewx.cheetahgenerator.Stats', 'weewx.cheetahgenerator.UnitInfo', > 'weewx.cheetahgenerator.Extras', 'weewx.cheetahgenerator.JSONHelpers', > 'weewx.cheetahgenerator.Gettext'] > Oct 14 19:45:16 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:45:25 weewx weewx[29782] DEBUG weewx.manager: Daily summary > version is 4.0 > Oct 14 19:45:59 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'SmartphoneReport' not enabled. Skipping. > Oct 14 19:45:59 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'MobileReport' not enabled. Skipping. > Oct 14 19:45:59 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'StandardReport' not enabled. Skipping. > Oct 14 19:45:59 weewx weewx[29782] DEBUG weewx.reportengine: Report 'FTP' > not enabled. Skipping. > Oct 14 19:45:59 weewx weewx[29782] DEBUG weewx.reportengine: Report > 'RSYNC' not enabled. Skipping. > Oct 14 19:47:04 weewx weewx[29782] INFO weewx.engine: Main loop exiting. > Shutting engine down. > Oct 14 19:47:04 weewx weewx[29782] INFO weewx.engine: Shutting down > StdReport thread > Oct 14 19:47:04 weewx weewx[29782] DEBUG weewx.engine: StdReport thread > has been terminated > Oct 14 19:47:04 weewx weewx[29782] DEBUG weewx.restx: Shut down Windy > thread. > Oct 14 19:47:04 weewx weewx[29782] DEBUG weewx.restx: Shut down CWOP > thread. > Oct 14 19:47:04 weewx weewx[29782] DEBUG weewx.restx: Shut down PWSWeather > thread. > Oct 14 19:47:04 weewx weewx[29782] DEBUG weewx.restx: Shut down > Wunderground-PWS thread. > Oct 14 19:47:04 weewx weewx[29782] DEBUG weewx.restx: Shut down > StationRegistry thread. > Oct 14 19:47:04 weewx weewx[29782] CRITICAL __main__: Keyboard interrupt. > > On Wednesday, October 13, 2021 at 11:59:24 PM UTC-7 gjr80 wrote: > >> This confirms my earlier testing, it's not coming from the console, >>> something is touching the LOOP packet, and it's the same value all the >>> time. >>> >> >> Well we don't know that for sure, certainly I've not seen a loop packet >> emitted directly by the driver/station that contains bogus data, but >> remember the driver also gets archive records from the station and it is >> possible that archive record from the station has the bogus data. >> >> >>> This is not a 'new" issue with 4.5.0.beta* >>> >> I meant 4.6.0.beta* >>> >> Agree, this has been there for a while, it is just the 4.6.0b3 changes to >> the Seasons skin have visually highlighted the problem. >> >> >>> sqlite> SELECT dateTime,datetime(dateTime, >>>> 'unixepoch','localtime'),leafTemp1 FROM archive WHERE leafTemp1 IS NOT >>>> NULL; >>>> 1634181300|2021-10-13 20:15:00|-26.0 >>>> 1634181600|2021-10-13 20:20:00|-26.0 >>>> 1634181900|2021-10-13 20:25:00|-26.0 >>>> 1634182200|2021-10-13 20:30:00|-26.0 >>>> 1634182500|2021-10-13 20:35:00|-26.0 >>>> 1634182800|2021-10-13 20:40:00|-26.0 >>>> 1634183100|2021-10-13 20:45:00|-26.0 >>>> >>> >> So it seems fairly safe to say it occurs regularly. Can you try one more >> thing: >> 1. Stop WeeWX >> 2. Edit weewx.conf and set debug = 1, save weewx.conf >> 3. Run WeeWX directly >> <http://weewx.com/docs/usersguide.htm#Running_directly> and let WeeWX >> run for at least 10 minutes. >> 4. There will be a lot of output to the console; 10 minutes of loop >> packets and at least two archive records. Post the entire console output >> showing the 10 minutes of loop packets/archive records. If you console >> buffer is not big enough you can pipe to a file and post the file. >> 5. Take a WeeWX log extract showing the entire WeeWX startup and the 10 >> minutes WeeWX was running directly. Don't edit the log extract and make >> sure you get the full WeeWX start. Post the log extract back here. >> >> Gary >> > -- You received this message because you are subscribed to the Google Groups "weewx-development" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-development+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-development/4d741f6f-fe3d-4b21-967f-1136f8fc62a9n%40googlegroups.com.
