We've seen this problem with largish databases. Try setting the option --tranche to 5, or even 1
weectl database calc-missing --tranch=1 On Fri, Jan 19, 2024 at 4:03 PM Michael Sanphillipo <sanphill...@gmail.com> wrote: > What happens when the sudo weectl database calc-missing command stops on a > date and seems to stall? > > On Friday, January 19, 2024 at 5:53:11 PM UTC-5 Tom Keffer wrote: > >> Good sleuthing, Paul! >> >> On Fri, Jan 19, 2024 at 10:23 AM Paul R Anderson <pa...@pauland.net> >> wrote: >> >>> This was really fun to track down! Thanks for the challenge ! >>> I have been able to reproduce your issue... it's a little complicated, >>> but it can be fixed easily :) >>> It's caused by 2 factors >>> *1. Your station seems to have stopped reporting Barometric Pressure on >>> or about 2019-12-31 @ 16:45 * >>> *No idea why, hopefully you are aware of this and know the cause.* >>> >>> *2. Your using an older version of NOAA-%Y-%m.txt.tmpl* >>> The older version used this statement to determine if there was data for >>> each day >>> #for $day in $month.days >>> #if $day.barometer.count.raw >>> So it fails because there is no $day.barometer.count.raw >>> Your Monthly Report will look like this: >>> >>> MONTHLY CLIMATOLOGICAL SUMMARY for Jan 2020 >>> >>> TEMPERATURE (F), RAIN (in), WIND SPEED (mph) >>> >>> HEAT COOL AVG >>> MEAN DEG DEG WIND >>> DOM >>> DAY TEMP HIGH TIME LOW TIME DAYS DAYS RAIN SPEED >>> HIGH TIME DIR >>> ------------------------------------------------------------ >>> --------------------------- >>> 01 >>> 02 >>> 03 >>> 04 >>> 05 >>> 06 >>> 07 >>> 08 >>> 09 >>> 10 >>> 11 >>> 12 >>> 13 >>> 14 >>> 15 >>> 16 >>> 17 >>> 18 >>> 19 >>> 20 >>> 21 >>> 22 >>> 23 >>> 24 >>> 25 >>> 26 >>> 27 >>> 28 >>> 29 >>> 30 >>> 31 >>> ------------------------------------------------------------ >>> --------------------------- >>> 55.4 81.3 31 44.4 12 294.2 0.7 0.15 0.4 >>> 14.0 29 302 >>> >>> *Newer version of NOAA-%Y-%m.txt.tmp* >>> Changed how it determines if there was data for each day >>> #for $day in $month.days >>> #if $day.outTemp.has_data or $day.rain.has_data or $day.wind.has_data >>> So it will pass even if there is no $day.barometer.count.raw >>> Your Monthly Report will now look like this: >>> >>> MONTHLY CLIMATOLOGICAL SUMMARY for Jan 2020 >>> >>> TEMPERATURE (F), RAIN (in), WIND SPEED (mph) >>> >>> HEAT COOL AVG >>> MEAN DEG DEG WIND >>> DOM >>> DAY TEMP HIGH TIME LOW TIME DAYS DAYS RAIN SPEED >>> HIGH TIME DIR >>> >>> --------------------------------------------------------------------------------------- >>> 01 55.7 63.8 10:55 47.4 03:40 9.3 0.0 0.00 0.3 >>> 9.0 08:00 294 >>> 02 55.9 64.1 06:30 51.5 03:10 9.1 0.0 0.00 0.3 >>> 4.0 05:45 322 >>> 03 62.5 72.2 16:55 52.5 23:15 2.5 0.0 0.00 0.6 >>> 6.0 14:50 301 >>> 04 57.3 71.7 16:55 48.7 07:20 7.7 0.0 0.00 0.4 >>> 6.0 13:30 297 >>> 05 56.9 70.0 16:45 47.8 10:15 8.1 0.0 0.00 0.4 >>> 6.0 16:50 302 >>> 06 64.5 80.7 16:20 53.1 10:25 0.5 0.0 0.00 0.2 >>> 6.0 14:50 297 >>> 07 60.8 79.3 15:40 50.5 00:40 4.2 0.0 0.00 0.3 >>> 7.0 15:55 299 >>> 08 51.9 62.5 15:05 47.1 08:30 13.1 0.0 0.00 0.5 >>> 9.0 15:30 317 >>> 09 50.9 60.8 14:20 46.6 01:25 14.1 0.0 0.00 0.6 >>> 11.0 15:35 301 >>> 10 51.6 64.1 16:30 44.9 09:35 13.4 0.0 0.01 0.5 >>> 7.0 15:50 294 >>> 11 51.0 60.6 15:20 45.0 07:25 14.0 0.0 0.00 0.7 >>> 13.0 15:25 325 >>> 12 51.2 62.5 15:10 44.4 09:15 13.8 0.0 0.00 0.5 >>> 10.0 16:25 298 >>> 13 51.2 59.8 17:45 46.3 08:50 13.8 0.0 0.00 0.5 >>> 8.0 17:30 300 >>> 14 50.4 60.5 16:35 45.2 10:00 14.6 0.0 0.01 0.4 >>> 9.0 17:00 294 >>> 15 51.1 65.1 16:00 44.4 09:40 13.9 0.0 0.00 0.4 >>> 8.0 17:25 296 >>> 16 50.3 58.4 15:20 45.4 10:00 14.7 0.0 0.05 0.8 >>> 11.0 01:25 315 >>> 17 51.2 60.1 16:55 45.5 10:20 13.8 0.0 0.05 0.6 >>> 12.0 03:40 316 >>> 18 56.1 69.6 17:30 46.9 06:10 8.9 0.0 0.00 0.2 >>> 6.0 16:10 294 >>> 19 58.6 76.1 14:50 49.0 10:05 6.4 0.0 0.00 0.2 >>> 9.0 15:10 300 >>> 20 54.9 59.3 15:45 52.4 04:50 10.1 0.0 0.00 0.3 >>> 11.0 15:50 306 >>> 21 52.0 56.8 14:20 47.7 02:15 13.0 0.0 0.03 0.3 >>> 7.0 14:35 310 >>> 22 52.6 61.1 14:25 47.6 04:35 12.4 0.0 0.00 0.5 >>> 8.0 16:25 296 >>> 23 59.9 73.0 16:20 50.0 07:20 5.1 0.0 0.00 0.4 >>> 7.0 15:40 306 >>> 24 59.0 74.2 16:55 51.0 02:05 6.0 0.0 0.00 0.3 >>> 5.0 13:05 297 >>> 25 54.9 69.8 17:10 46.9 08:45 10.1 0.0 0.00 0.3 >>> 7.0 14:20 296 >>> 26 51.2 57.1 17:10 47.4 00:45 13.8 0.0 0.00 0.1 >>> 7.0 17:10 299 >>> 27 55.4 70.4 16:55 45.7 08:25 9.6 0.0 0.00 0.3 >>> 8.0 17:15 284 >>> 28 58.9 73.9 17:15 50.9 08:15 6.1 0.0 0.00 0.6 >>> 7.0 15:15 296 >>> 29 58.9 71.3 18:15 45.7 08:35 6.1 0.0 0.00 0.1 >>> 14.0 16:10 176 >>> 30 59.0 71.3 16:50 48.9 09:50 6.0 0.0 0.00 0.5 >>> 9.0 15:30 302 >>> 31 65.7 81.3 17:50 53.1 08:55 0.0 0.7 0.00 0.2 >>> 7.0 15:25 304 >>> >>> --------------------------------------------------------------------------------------- >>> 55.4 81.3 31 44.4 12 294.2 0.7 0.15 0.4 >>> 14.0 29 302 >>> >>> *Solution:* >>> Stop WeeWX >>> Backup whatever NOAA-%Y-%m.txt.tmp template you're using , perhaps >>> Seasons Skin? >>> Download the newest version from say the Seasons skin >>> wget >>> https://raw.githubusercontent.com/weewx/weewx/master/src/weewx_data/skins/Seasons/NOAA/NOAA-%25Y-%25m.txt.tmpl >>> Replace your existing NOAA-%Y-%m.txt.tmp template with the newer version >>> Completely deleting all NOAA reports >>> Start WeeWx , verify that the monthly reports appear correctly. >>> >>> You could also entirely update all the WeeWX normal skins with Upgrade >>> an existing station >>> <https://weewx.com/docs/5.0/utilities/weectl-station/#reconfigure-an-existing-station> >>> see >>> the --what option >>> However be sure you have not made modifications to them, altho the >>> weectl station upgrade --what skins command will backup your existing >>> skins. >>> >>> Paul >>> >>> >>> >>> On Wed, Jan 17, 2024 at 12:32 PM Blaine <bgri...@gmail.com> wrote: >>> >>>> Way back in 2020 my NOAA reports stopped populating their daily values. >>>> The average values for the month continue to be populated at the bottom of >>>> the table. Since 2020 every year or so I have spent hours banging my head >>>> against the wall following any and all instructions on the wiki, github, >>>> google and this user group to attempt to repair this issue. None of the >>>> published instructions seem to help. I have never been successful. >>>> >>>> If this is a problem that can be solved I would be more than happy to >>>> pay someone to help fix this issue knowing full well there are no >>>> guarantees recovery is possible. This data is important to me and having >>>> essentially lost years worth with no chance of recovery is a real bummer. >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "weewx-user" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to weewx-user+...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/weewx-user/6be270a2-961f-4952-85b0-6074332671een%40googlegroups.com >>>> <https://groups.google.com/d/msgid/weewx-user/6be270a2-961f-4952-85b0-6074332671een%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "weewx-user" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to weewx-user+...@googlegroups.com. >>> >> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/weewx-user/CAOAVAef%3DqwYYtCPdikBZkTprbwoXzgXFo8D2S9%3DT6wnswA_adA%40mail.gmail.com >>> <https://groups.google.com/d/msgid/weewx-user/CAOAVAef%3DqwYYtCPdikBZkTprbwoXzgXFo8D2S9%3DT6wnswA_adA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to weewx-user+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/1dbaaade-5a3e-40b5-b6c1-df25bd40e8adn%40googlegroups.com > <https://groups.google.com/d/msgid/weewx-user/1dbaaade-5a3e-40b5-b6c1-df25bd40e8adn%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/CAPq0zEBxmpzkULqjK4EK103kUyoeCdAVKUnA8E-eXxJe7M%2Bvqg%40mail.gmail.com.