Re: [weewx-development] Reportgenerator 'hangs' with vector plot

I had the same issue with my webhost. After 5 years of arguing with them, I gave up and went to AWS Lightsail . Cheaper, faster, and I can do anything I want with my instance. Much happier now. -tk On Sun, Apr 5, 2020 at 12:38 PM Lucas Heijst wrote: > Vince, >

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Vince, My ISP in the Netherlands doesn't allow the use of rsync. Luc On Sunday, 5 April 2020 14:45:40 UTC-3, Vince Skahan wrote: > > On Friday, April 3, 2020 at 6:56:58 PM UTC-7, Vince Skahan wrote: >> >> On Friday, April 3, 2020 at 5:24:21 PM UTC-7, Lucas Heijst wrote: >> >> ftpgenerator: Ftp'd

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

On Friday, April 3, 2020 at 6:56:58 PM UTC-7, Vince Skahan wrote: > > On Friday, April 3, 2020 at 5:24:21 PM UTC-7, Lucas Heijst wrote: > > ftpgenerator: Ftp'd 79 files in 89.01 seconds > > > Also switching from ftp to rsync will dramatically improve how long it > takes to upload things to your r

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

mwall writes: > we started a postgres adapter years ago. it never made it into weewx core. Sorry -- I use a lot of programs and my memory was that weewx supported postgres. I have used it for various things over the years including one project that had frequent crashes due to laptop batteries

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

On Saturday, April 4, 2020 at 9:24:41 AM UTC-4, Greg Troxel wrote: > > > I wonder if people have tried postgresql. (I'm still on sqlite.) > here is a summary of how identifiers are treated in various databases: https://github.com/ontop/ontop/wiki/Case-sensitivity-for-SQL-identifiers the origi

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

On Saturday, April 4, 2020 at 9:24:41 AM UTC-4, Greg Troxel wrote: > > Glenn McKechnie > writes: > > > It's not weewx increasing in CPU usage, it's the CPU usage for > > mariadb. Check on your Synology NAS. > > I wonder if people have tried postgresql. (I'm still on sqlite.) > greg, we star

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Tom, The plots look good to me, see attachments. Luc On Saturday, 4 April 2020 10:19:06 UTC-3, Tom Keffer wrote: > > Before you get too excited, make sure the fix still gives the right > answer. It uses a different query strategy. > > On Sat, Apr 4, 2020 at 6:17 AM Glenn McKechnie > wrote: > >

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Glenn, The change in Toms xtypes.py is the way how the database query is done for max and min aggregation So I assume the old query kept the DB manager very busy (but I did not check it because in the new version the query is fast). Luc On Saturday, 4 April 2020 10:03:13 UTC-3, Glenn McKechnie

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

On 05/04/2020, Thomas Keffer wrote: > Before you get too excited, make sure the fix still gives the right answer. > It uses a different query strategy. My first thought was how can I tell without firing up a 3.9.2 version (Although I think I might have access to one of those :-) But then if I ch

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Tom, YES, it made a huge difference! With the new xtypes.py all reports now runned in only 102 seconds! Generated 76 images for report vproReport in 101.51 seconds The report was generated with the original skin.conf file with aggregate_type set to max and the aggregate_intervals set. Thanks!

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Glenn McKechnie writes: > It's not weewx increasing in CPU usage, it's the CPU usage for > mariadb. Check on your Synology NAS. I wonder if people have tried postgresql. (I'm still on sqlite.) -- You received this message because you are subscribed to the Google Groups "weewx-development" gr

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Before you get too excited, make sure the fix still gives the right answer. It uses a different query strategy. On Sat, Apr 4, 2020 at 6:17 AM Glenn McKechnie wrote: > Well, that fixed it on this machine! > > Back to the 16% mysqld usage with both 'aggregate_type = max' and > 'aggregate_interval

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Well, that fixed it on this machine! Back to the 16% mysqld usage with both 'aggregate_type = max' and 'aggregate_interval = 300' reinstated in skin.conf Wouldn't have a fix as smooth as that for covid-19 would you? On 04/04/2020, Thomas Keffer wrote: > Luc, could you try the attached version

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Luc, It's not weewx increasing in CPU usage, it's the CPU usage for mariadb. Check on your Synology NAS. Maybe it's not the same for yours, but I found this occurring in mine. Worked in 3.9.2, failed in weewx 4.0.06b where it sent the CPU through the roof, with the reports failing in the same ma

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Luc, could you try the attached version of xtypes.py and see if it makes any difference? -tk On Sat, Apr 4, 2020 at 5:10 AM Lucas Heijst wrote: > Tom, Vince, Glenn, > > Glenn, > Yes, I use external mariadb5 databases. > And no, during the creation of the vector plots the memory use of weewx is

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Tom, Vince, Glenn, Glenn, Yes, I use external mariadb5 databases. And no, during the creation of the vector plots the memory use of weewx is not much (2.7 %). Changing the aggregate_interval has effect, but is not the main cause. Tom, Vince, Glenn, The main cause of the slow vector calculation i

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Vince, The following set of weewx programs runs for years now on my raspberry pi 2B. 1. Vantage driver 2. Meteostick driver 3. Klimalogg drive4 4. Computer monitor. The programs run from a memory stick. The data is written to 4 external mariadb5 databases on my Synology NAS. The uploaded data is

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

On Friday, April 3, 2020 at 5:24:21 PM UTC-7, Lucas Heijst wrote: > > I included the syslog this time. > > I was wrong: the reportgenerator didn't hang, only it is VERY slow > I still think you are doing too much (and too frequently) for your model pi, the SD card, and your network. Generated

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

(Sigh, and to the list) Luc, I notice a "Launch of report thread aborted: existing report thread still running" Do you use mysql (mariadb)? If you do, does its CPU usage (from top) increase? If so try dropping the aggregate interval = 900 and see if there is a difference On 04/04/2020, Lucas H

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Tom, There was not much info in the syslog, thats why I didnt send it. I included the syslog this time. I was wrong: the reportgenerator didn't hang, only it is VERY slow First I generated all other plots: 71 images in 90 seconds Generated 71 images for report vproReport in 89.58 seconds Then I

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

Worked fine for me. Luc: you know better. We need a log! Perhaps the ReportGenerator is not finishing before the next report is due? Perhaps the program segfaulted? Who knows without a log? -tk [image: image.png] On Fri, Apr 3, 2020 at 4:09 PM Lucas Heijst wrote: > Currently running weewx 4.0.

[weewx-development] Reportgenerator 'hangs' with vector plot

Currently running weewx 4.0.0b18. The reportgenerator hangs (it never finishes) during calculating of the section below. [[[hourwindvec]]] windvec plot_type = vector windgustvec plot_type = vector