Re: [RE-wrenches] SD card data processing

2017-08-07 Thread Mac Lewis
My original stab at this works; its a script based in an open-source language called R. It easily handles the large data files. It will merge the files, based on device type, pull out error codes etc. The problem is that it is cmd line based and is a pain to customize when you are rusty with cod

Re: [RE-wrenches] SD card data processing

2017-08-07 Thread Chris Mason
Probably over qualified. My consultant for setting up MySQL wind and solar data dumps is a high > school kid ;-) > > ___ List sponsored by Redwood Alliance List Address: RE-wrenches@lists.re-wrenches.org Change listserver email address & settings: http

Re: [RE-wrenches] SD card data processing

2017-08-07 Thread Dan Fink
My consultant for setting up MySQL wind and solar data dumps is a high school kid ;-) Dan Fink Professor of Solar Energy Technology, Ecotech Institute IREC Certified Instructorâ„¢ for: ~ PV Installation Professional ~ Small Wind Installer Executive Director, Buckville Energy NABCEP Registered Contin

Re: [RE-wrenches] SD card data processing

2017-08-07 Thread Chris Mason
I would run MySQL on my computer and write a python script to import the data to MySQL, and use a front end package to graph the data - it's pretty easy to do. If that's more than you can handle, go to Guru.com and setup an account, describe what yo uwant done, and there's plenty of willing takers

Re: [RE-wrenches] SD card data processing

2017-08-07 Thread Dan Fink
Hi Mac -- yep, at about 50k data points Excel seizes up no matter how fast your computer. You really need to use a database program after that point. I had a friend arrange a web API into MySQL on our server and it works fine. Dan Fink Professor of Solar Energy Technology, Ecotech Institute IREC C

[RE-wrenches] SD card data processing

2017-08-07 Thread Mac Lewis
Hi Wrenches, I am getting more and more zipped up SD card data emailed from clients from their Outback Mate 3s, Sunny Islands and other systems that we have out there. The data can be very laborious to process and will crash Excel most of the time because of the sheer quantity of data. Also ofte