Thanks, before you do anything drastic let me have a look at what weewx-WD 
is doing, some of the code there is old and somewhat 'naive'. I will have a 
look later today.

Gary

On Saturday, 4 February 2017 10:30:57 UTC+10, Daniel Rich wrote:
>
> I finally had time to run things in debug mode, there doesn't appear to be 
> a lot more info though. I still see the "start time (1485936000) is greater 
> than stop time (1485484500)" errors. It's interesting that the "start time" 
> is midnight on the 1st. I'm not sure where that is coming from... 
>
> I suppose I could just delete that last archive record from the database 
> and see if that clears things up.
>
> Two collection cycles of logs with debug=1 attached.
>
> On 2/1/17 6:04 AM, gjr80 wrote:
>
> Hi Daniel,
>
> I am not surprised that a hard powerdown might lead to some duplicate 
> archive records, but if they sorted themselves out I would have expected 
> the reports to fall into line. Could I ask for a bit more loggging? Could 
> you set debug=1, stop/start weewx and post from startup and include at 
> least 2 full report cyles. I am suspicious that the weewx-WD code that 
> calculates midnight in that particular SLE may be somewhat fragile.
>
> Gary
>
> On Wednesday, 1 February 2017 10:06:54 UTC+10, Daniel Rich wrote: 
>>
>> I had a hard powerdown of my WeeWX Pi the other day, and ever since it 
>> hasn't 
>> been updating the web pages or external weather feeds. 
>>
>> I see some archive update errors after the crash, the logs show the 
>> following 
>> and my last update was at 18:35: 
>>
>> Jan 25 18:35:16 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:20:00 PST (1485397200) to database 'weewx.sdb': UNIQUE 
>> constraint failed: archive.dateTime 
>> Jan 25 18:35:16 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:20:00 PST (1485397200) to database 'archive/weewxwd.sdb': 
>> UNIQUE constraint failed: archive.dateTime 
>> Jan 25 18:35:17 weather weewx[763]: restx: ISY: Published record 
>> 2017-01-25 18:20:00 PST (1485397200) 
>> Jan 25 18:35:17 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:25:00 PST (1485397500) to database 'weewx.sdb': UNIQUE 
>> constraint failed: archive.dateTime 
>> Jan 25 18:35:17 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:25:00 PST (1485397500) to database 'archive/weewxwd.sdb': 
>> UNIQUE constraint failed: archive.dateTime 
>> Jan 25 18:35:17 weather weewx[763]: restx: EmonCMS: Published record 
>> 2017-01-25 18:20:00 PST (1485397200) 
>> Jan 25 18:35:17 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:30:00 PST (1485397800) to database 'weewx.sdb': UNIQUE 
>> constraint failed: archive.dateTime 
>> Jan 25 18:35:17 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:30:00 PST (1485397800) to database 'archive/weewxwd.sdb': 
>> UNIQUE constraint failed: archive.dateTime 
>> Jan 25 18:35:17 weather weewx[763]: restx: PWSWeather: Published record 
>> 2017-01-25 18:20:00 PST (1485397200) 
>> Jan 25 18:35:17 weather weewx[763]: restx: ISY: Published record 
>> 2017-01-25 18:25:00 PST (1485397500) 
>> Jan 25 18:35:17 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:35:00 PST (1485398100) to database 'weewx.sdb': UNIQUE 
>> constraint failed: archive.dateTime 
>> Jan 25 18:35:17 weather weewx[763]: manager: unable to add record 
>> 2017-01-25 18:35:00 PST (1485398100) to database 'archive/weewxwd.sdb': 
>> UNIQUE constraint failed: archive.dateTime 
>>
>>
>> These errors show up until 19:05, then there are no more errors until 
>> after 
>> midnight on the 27th. After that each update cycle shows: 
>>
>> Jan 27 00:00:33 weather weewx[754]: reportengine: Caught unrecoverable 
>> exception in generator weewx.cheetahgenerator.CheetahGenerator 
>> Jan 27 00:00:33 weather weewx[754]:         ****  start time (1485504000) 
>> is greater than stop time (1485484500) 
>> Jan 27 00:00:33 weather weewx[754]:         ****  Traceback (most recent 
>> call last): 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/reportengine.py", line 238, in run 
>> Jan 27 00:00:33 weather weewx[754]:         ****      obj.start() 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/reportengine.py", line 271, in start 
>> Jan 27 00:00:33 weather weewx[754]:         ****      self.run() 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/cheetahgenerator.py", line 150, in run 
>> Jan 27 00:00:33 weather weewx[754]:         ****      ngen = 
>> self.generate(gen_dict[section_name], self.gen_ts) 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/cheetahgenerator.py", line 219, in generate 
>> Jan 27 00:00:33 weather weewx[754]:         ****      ngen += 
>> self.generate(section[subsection], gen_ts) 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/cheetahgenerator.py", line 219, in generate 
>> Jan 27 00:00:33 weather weewx[754]:         ****      ngen += 
>> self.generate(section[subsection], gen_ts) 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/cheetahgenerator.py", line 305, in generate 
>> Jan 27 00:00:33 weather weewx[754]:         ****      default_binding) 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weewx/cheetahgenerator.py", line 357, in _getSearchList 
>> Jan 27 00:00:33 weather weewx[754]:         ****      searchList += 
>> obj.get_extension_list(timespan, db_lookup) 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/user/wdSearchX3.py", line 859, in get_extension_list 
>> Jan 27 00:00:33 weather weewx[754]:         ****      (time_start_vt, 
>> time_stop_vt, wind_speed_vt) = 
>> db_lookup().getSqlVectors(weeutil.weeutil.TimeSpan(midnight_ts, 
>> timespan.stop), 'windSpeed') 
>> Jan 27 00:00:33 weather weewx[754]:         ****    File 
>> "/usr/share/weewx/weeutil/weeutil.py", line 315, in __new__ 
>> Jan 27 00:00:33 weather weewx[754]:         ****      raise 
>> ValueError("start time (%d) is greater than stop time (%d)" % (args[0], 
>> args[1])) 
>> Jan 27 00:00:33 weather weewx[754]:         ****  ValueError: start time 
>> (1485504000) is greater than stop time (1485484500) 
>> Jan 27 00:00:33 weather weewx[754]:         ****  Generator terminated 
>> Jan 27 00:00:33 weather weewx[754]: cheetahgenerator: Generated 1 files 
>> for report wdPWS in 0.37 seconds 
>> Jan 27 00:00:42 weather weewx[754]: cheetahgenerator: Generated 1 files 
>> for report wdClientraw in 8.55 seconds 
>>
>>
>> I'm assuming there are some bad records in the archive db, any tips on 
>> locating them and purging them? The archive data definitely stops at the 
>> time 
>> of the error: 
>>
>> > sqlite3 /var/lib/weewx/weewx.sdb 
>> SQLite version 3.8.7.1 2014-10-29 13:59:56 
>> Enter ".help" for usage hints. 
>> > select * from archive where dateTime > 1485484000; 
>> 1485484200|1|5|30.421|29.9812588051139|30.3939839514882|68.7|47.8|49.0|78.0|0.0||0.0||0.0|0.0|41.2786972752926|47.8|47.8|0.0||||||||||||||||||||99.9375||||||||||||
>>  
>>
>> 1485484500|1|5|30.421|29.9812416704312|30.3939666219138|68.7|47.5|49.0|78.0|0.0||0.0||0.0|0.0|40.9874488882043|47.5|47.5|0.0||||||||||||||||||||99.0833333333333||||||||||||
>>  
>>
>> sqlite> 
>>
>> > sqlite3 /var/lib/weewx/archive/weewxwd.sdb 
>> SQLite version 3.8.7.1 2014-10-29 13:59:56 
>> Enter ".help" for usage hints. 
>> sqlite> select * from archive where dateTime > 1485484000; 
>> 1485484200|1|5|46.6223678190296|45.8320586487554||47.8 
>> 1485484500|1|5|46.2230403396625|45.4734264426846||47.5 
>> sqlite> 
>>
>>
> -- 
> Dan Rich <dr...@employees.org> <javascript:> |   
> http://www.employees.org/~drich/
>                                |  "Step up to red alert!"  "Are you sure, sir?
>                                |   It means changing the bulb in the sign..."
>                                |          - Red Dwarf (BBC)
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-user+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to