[weewx-user] Re: Reading historical data from Klimalogg Pro

2017-12-29 Thread eddy B 
Hey Luc,

yes, that's also the idea I came up with. I set the batch length to 51.200 
as you suggested in your older post and it is populating a new database as 
we speak. I hope it will work :)

Any idea why it failed in the first place? or the reason why it sometimes 
failes to read historical data properly?

On Saturday, 30 December 2017 00:52:50 UTC+1, Luc Heijst wrote:
>
> Hi Eddy,
>
> At startup the klimalogg driver reads the timestamp of the most recent 
> record in the weewx database.
> It then tries to read all records in the klimalogg memory with a bigger 
> time stamp until no newer records can't be found.
> Then the driver starts collecting the recent data each five minutes.
> When you want to start all over with reading all records of the klimalogg 
> (this can be as many as 51.200 !!) you will have to stop weewx, delete or 
> rename your weewx database file and start weewx. This process can take many 
> hours, sometimes several days, to complete depending of the speed of your 
> computersystem.
>
> If you don't want to start all over, but read the data back since a 
> certain date, you need to delete all newer records in the weewx database 
> and then restart weewx.
>
> Luc
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-user+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[weewx-user] Re: Reading historical data from Klimalogg Pro

2017-12-29 Thread eddy B 
Hey, 

sorry to necro this thread, but I do have the exact same issue:
I set up weewx for a klimalogg which was already running since end of 2013. 
Once I connected everything it started reading out the historical data:





Dec 26 20:52:25 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: records cached=1782, records skipped=0, next=1783

Dec 26 20:52:25 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: records cached=1788, records skipped=0, next=1789

Dec 26 20:52:26 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: records cached=1794, records skipped=0, next=1795

Dec 26 20:52:26 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: records cached=1800, records skipped=0, next=1801

Dec 26 20:52:29 raspberrypi weewx[8067]: KlimaLogg: MainThread: Records 
scanned: 1800

Dec 26 20:52:29 raspberrypi weewx[8067]: KlimaLogg: MainThread: Found 1799 
historical records

Dec 26 20:52:29 raspberrypi weewx[8067]: KlimaLogg: MainThread: Handle 
record 1: 2013-11-04 11:30:00 CET (1383561000)

Dec 26 20:52:29 raspberrypi weewx[8067]: KlimaLogg: MainThread: Handle 
record 2: 2013-11-04 11:45:00 CET (1383561900)

Dec 26 20:52:29 raspberrypi weewx[8067]: manager: Added record 2013-11-04 11
:45:00 CET (1383561900) to database 'weewx-kl.sdb'

Dec 26 20:52:29 raspberrypi weewx[8067]: manager: Added record 2013-11-04 11
:45:00 CET (1383561900) to daily summary in 'weewx-kl.sdb'

[...] after a few minutes: 


Dec 26 20:57:35 raspberrypi weewx[8067]: manager: Added record 2013-12-11 03
:00:00 CET (1386727200) to database 'weewx-kl.sdb'

Dec 26 20:57:35 raspberrypi weewx[8067]: manager: Added record 2013-12-11 03
:00:00 CET (1386727200) to daily summary in 'weewx-kl.sdb'

Dec 26 20:57:35 raspberrypi weewx[8067]: KlimaLogg: MainThread: Saved 1799 
historical records; ts last saved record 2013-12-11 03:00:00 CET (1386727200
)

Dec 26 20:57:35 raspberrypi weewx[8067]: KlimaLogg: MainThread: Scan the 
next batch of 1800 historical records

Dec 26 20:57:35 raspberrypi weewx[8067]: KlimaLogg: MainThread: The scan 
will start after the next historical record is received.

Dec 26 20:58:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:58:20 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:58:35 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:58:50 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:59:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:59:20 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:59:35 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 20:59:50 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 21:00:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 21:00:06 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: request records since 2013-12-11 03:00:00 CET (1386727200
)

Dec 26 21:00:06 raspberrypi weewx[8067]: KlimaLogg: RFComm: Number of 
history records limited to: 51200

Dec 26 21:00:06 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: records cached=0, records skipped=0, next=39180

Dec 26 21:00:20 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

As you see on line with the time stamp 21:00:06 for some reason it now says 
"next=39180"

and five more minutes of "the next batch will start in 5 minutes" messages:

Dec 26 21:04:50 raspberrypi weewx[8067]: KlimaLogg: MainThread: The next 
batch of 1800 records will start within 5 minutes

Dec 26 21:05:02 raspberrypi weewx[8067]: KlimaLogg: RFComm: 
handleHistoryData: records cached=1, records skipped=5, next=39181

Dec 26 21:05:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: Records 
scanned: 1

Dec 26 21:05:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: Found 0 
historical records

Dec 26 21:05:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: Handle 
record 1801: 2017-12-26 21:05:00 CET (1514318700)

Dec 26 21:05:05 raspberrypi weewx[8067]: KlimaLogg: MainThread: Saved 0 
historical records; ts last saved record 2017-12-26 21:05:00 CET (1514318700
)

Dec 26 21:05:05 raspberrypi weewx[8067]: engine: Starting main packet loop.

Dec 26 21:10:16 raspberrypi weewx[8067]: manager: Added record 2017-12-26 21
:10:00 CET (1514319000) to database 'weewx-kl.sdb'

Dec 26 21:10:16 raspberrypi weewx[8067]: manager: Added record 2017-12-26 21
:10:00 CET (1514319000) to daily summary in 'weewx-kl.sdb'

Dec 26 21:10:17 ra