[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-22 Thread Andrew M
All was good with the import with the new wdimport.py file. Appreciate all the development efforts that have been done. Thank On Friday, September 18, 2020 at 7:19:47 AM UTC-4, gjr80 wrote: > > Andrew, > > Can you try the attached wdimport.py in place of your current version. To > install:

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-18 Thread gjr80
Andrew, Can you try the attached wdimport.py in place of your current version. To install: 1. rename your current wdimport.py: $ mv /usr/share/weewx/weeimport/wdimport.py /usr/share/weewx/weeimport/wdimport_orig.py 2. download the attached wdimport.py to /usr/share/weewx/weeimport/ 3. run

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-17 Thread gjr80
Apologies Andrew, I misread and thought you provided the data files for use in improving wee_import WD imports rather than seeking help with the import. Other things have taken up my time, I will try to have a look Friday. Gary On Thursday, 17 September 2020 at 08:39:49 UTC+10 Andrew M wrote:

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-16 Thread Andrew M
Bumping this post to see if anyone has any suggestions on my the attached is failing import. Thank you in advance. On Wednesday, September 9, 2020 at 11:02:01 PM UTC-4, Andrew M wrote: > > > I do appreciate the assistance. Hopefully this will help others in either > with what I am doing or

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-01 Thread gjr80
Didn’t take your post as a complaint, sorry if I came across in a manner that gave that impression. Just wanted to point out that development of the WD module was based on a very small sample of data rather than from some written specification. If the problem was a malformed data file that

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-01 Thread Andrew M
Please don't take what i have written as a complaint. I appreciate all the hard work it took in the creation of WeeWx and all the contributors to the forum. I have not looked at the content of those files it choked on to see if it has good data in it. Let me first do that. I will reply back

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-01 Thread gjr80
If you to provide some details on problems the handful of files experienced I am happy to look at wee_import to see if any changes can be made to improve its handling of such files. The WD import module of wee_import was developed based on a handful of WD log files found on the internet, so it

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-09-01 Thread Andrew M
After many, many hours the wee-import processed all but a handful of files. Have several that choked on the import. Ended up with 3,873,678 records. Next I need to validate that the data imported to look for any potential bad data. On Friday, August 21, 2020 at 7:31:36 PM UTC-4 Andrew M

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-08-21 Thread Andrew M
Thank you for the response. I actually changed up how I am going about this. My WD ran on a Windows10 box. I had a RaspPi box sitting in a box so i decided to use that for WeeWx. I was formatting the hard drive on the Win10 machine when i had the thought that I should just put Debian on that

[weewx-user] Re: Migrating/Importing WD data in MySql DB to WeeWx MySql DB

2020-08-19 Thread gjr80
Sorry can't help you with MySQL to MySQL migration. Regards wee_import though, yes it can be slow. When I wrote the WD import module the WD user who first used it in anger had something like (from memory) 10 years of data to import. The import had to be done in batches (again from memory) of