Here is syslog from shortly before the crash.. Is there any other files that may be useful for analysis?
Jan 28 23:44:15 raspberrypi weewx[9770]: manager: Added record 2019-01-28 23:44:00 EST (1548737040) to database 'weewx.sdb' Jan 28 23:44:16 raspberrypi weewx[9770]: manager: Added record 2019-01-28 23:44:00 EST (1548737040) to daily summary in 'weewx.sdb' Jan 28 23:44:18 raspberrypi weewx[9770]: restx: PWSWeather: Published record 2019-01-28 23:44:00 EST (1548737040) Jan 28 23:44:26 raspberrypi weewx[9770]: cheetahgenerator: Generated 14 files for report StandardReport in 8.67 seconds Jan 28 23:44:36 raspberrypi weewx[9770]: imagegenerator: Generated 13 images for StandardReport in 9.49 seconds Jan 28 23:44:36 raspberrypi weewx[9770]: copygenerator: copied 0 files to /home/weewx/public_html Jan 28 23:44:47 raspberrypi weewx[9770]: ftpgenerator: ftp'd 27 files in 11.38 seconds Jan 28 23:46:15 raspberrypi weewx[9770]: manager: Added record 2019-01-28 23:46:00 EST (1548737160) to database 'weewx.sdb' Jan 28 23:46:16 raspberrypi weewx[9770]: manager: Added record 2019-01-28 23:46:00 EST (1548737160) to daily summary in 'weewx.sdb' Jan 28 23:46:39 raspberrypi systemd[1]: apt-daily.service: Failed to fork: Cannot allocate memory Jan 28 23:46:39 raspberrypi systemd[1]: apt-daily.service: Failed to run 'start' task: Cannot allocate memory Jan 28 23:46:39 raspberrypi systemd[1]: Failed to start Daily apt download activities. Jan 28 23:46:39 raspberrypi systemd[1]: apt-daily.timer: Adding 1h 13min 18.732028s random time. Jan 28 23:46:39 raspberrypi systemd[1]: apt-daily.service: Unit entered failed state. Jan 28 23:46:39 raspberrypi systemd[1]: apt-daily.timer: Adding 9h 23min 52.201118s random time. Jan 28 23:46:39 raspberrypi systemd[1]: apt-daily.service: Failed with result 'resources'. Jan 28 23:48:31 raspberrypi weewx[9770]: engine: Garbage collected 248392 objects Jan 28 23:48:32 raspberrypi kernel: [3815265.633466] top invoked oom-killer: gfp_mask=0x14040d0(GFP_KERNEL|__GFP_COMP|__GFP_RECLAIMABLE), nodemask=(null), order=0, oom_score_adj=0 Jan 28 23:48:32 raspberrypi kernel: [3815265.633480] top cpuset=/ mems_allowed=0 Jan 28 23:48:32 raspberrypi kernel: [3815265.633495] CPU: 3 PID: 17293 Comm: top Tainted: G C 4.14.87-v7+ #1178 Jan 28 23:48:32 raspberrypi kernel: [3815265.633497] Hardware name: BCM2835 Jan 28 23:48:32 raspberrypi kernel: [3815265.633521] [<8010ff30>] (unwind_backtrace) from [<8010c174>] (show_stack+0x20/0x24) Jan 28 23:48:32 raspberrypi kernel: [3815265.633531] [<8010c174>] (show_stack) from [<8078b424>] (dump_stack+0xd4/0x118) Jan 28 23:48:32 raspberrypi kernel: [3815265.633543] [<8078b424>] (dump_stack) from [<80224bac>] (dump_header+0xac/0x208) Jan 28 23:48:32 raspberrypi kernel: [3815265.633553] [<80224bac>] (dump_header) from [<80223f14>] (oom_kill_process+0x478/0x584) Jan 28 23:48:32 raspberrypi kernel: [3815265.633560] [<80223f14>] (oom_kill_process) from [<80224874>] (out_of_memory+0x124/0x334) Jan 28 23:48:32 raspberrypi kernel: [3815265.633570] [<80224874>] (out_of_memory) from [<8022a3b8>] (__alloc_pages_nodemask+0x10cc/0x11c0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633579] [<8022a3b8>] (__alloc_pages_nodemask) from [<80275a60>] (new_slab+0x454/0x558) Jan 28 23:48:32 raspberrypi kernel: [3815265.633587] [<80275a60>] (new_slab) from [<802778a4>] (___slab_alloc.constprop.11+0x228/0x2c0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633595] [<802778a4>] (___slab_alloc.constprop.11) from [<80277980>] (__slab_alloc.constprop.10+0x44/0x90) Jan 28 23:48:32 raspberrypi kernel: [3815265.633602] [<80277980>] (__slab_alloc.constprop.10) from [<80278118>] (kmem_cache_alloc+0x1f4/0x230) Jan 28 23:48:32 raspberrypi kernel: [3815265.633611] [<80278118>] (kmem_cache_alloc) from [<802f764c>] (proc_alloc_inode+0x2c/0x5c) Jan 28 23:48:32 raspberrypi kernel: [3815265.633622] [<802f764c>] (proc_alloc_inode) from [<802a7ca8>] (alloc_inode+0x2c/0xb4) Jan 28 23:48:32 raspberrypi kernel: [3815265.633631] [<802a7ca8>] (alloc_inode) from [<802aa01c>] (new_inode_pseudo+0x18/0x5c) Jan 28 23:48:32 raspberrypi kernel: [3815265.633639] [<802aa01c>] (new_inode_pseudo) from [<802aa07c>] (new_inode+0x1c/0x30) Jan 28 23:48:32 raspberrypi kernel: [3815265.633646] [<802aa07c>] (new_inode) from [<802fb850>] (proc_pid_make_inode+0x24/0xc0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633654] [<802fb850>] (proc_pid_make_inode) from [<802fbdc8>] (proc_pident_instantiate+0x2c/0xb0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633660] [<802fbdc8>] (proc_pident_instantiate) from [<802fbee8>] (proc_pident_lookup+0x9c/0xf0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633667] [<802fbee8>] (proc_pident_lookup) from [<802fbf84>] (proc_tgid_base_lookup+0x20/0x28) Jan 28 23:48:32 raspberrypi kernel: [3815265.633675] [<802fbf84>] (proc_tgid_base_lookup) from [<8029ad60>] (path_openat+0xe0c/0x10c0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633684] [<8029ad60>] (path_openat) from [<8029c2c4>] (do_filp_open+0x70/0xd4) Jan 28 23:48:32 raspberrypi kernel: [3815265.633693] [<8029c2c4>] (do_filp_open) from [<80288f80>] (do_sys_open+0x120/0x1d0) Jan 28 23:48:32 raspberrypi kernel: [3815265.633701] [<80288f80>] (do_sys_open) from [<8028905c>] (SyS_open+0x2c/0x30) Jan 28 23:48:32 raspberrypi kernel: [3815265.633709] [<8028905c>] (SyS_open) from [<80108000>] (ret_fast_syscall+0x0/0x28) Jan 28 23:48:32 raspberrypi kernel: [3815265.633713] Mem-Info: Jan 28 23:48:32 raspberrypi kernel: [3815265.633724] active_anon:111538 inactive_anon:112531 isolated_anon:0 Jan 28 23:48:32 raspberrypi kernel: [3815265.633724] active_file:502 inactive_file:552 isolated_file:32 Jan 28 23:48:32 raspberrypi kernel: [3815265.633724] unevictable:0 dirty:3 writeback:13 unstable:0 Jan 28 23:48:32 raspberrypi kernel: [3815265.633724] slab_reclaimable:1872 slab_unreclaimable:2785 Jan 28 23:48:32 raspberrypi kernel: [3815265.633724] mapped:962 shmem:1453 pagetables:906 bounce:0 Jan 28 23:48:32 raspberrypi kernel: [3815265.633724] free:4134 free_pcp:28 free_cma:435 Jan 28 23:48:32 raspberrypi kernel: [3815265.633731] Node 0 active_anon:446152kB inactive_anon:450124kB active_file:2008kB inactive_file:2208kB unevictable:0kB isolated(anon):0kB isolated(file):128kB mapped:3848kB dirty:12kB writeback:52kB shmem:5812kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Jan 28 23:48:32 raspberrypi kernel: [3815265.633742] Normal free:16536kB min:16384kB low:20480kB high:24576kB active_anon:446152kB inactive_anon:449608kB active_file:2452kB inactive_file:2316kB unevictable:0kB writepending:0kB present:970752kB managed:949448kB mlocked:0kB kernel_stack:1144kB pagetables:3624kB bounce:0kB free_pcp:72kB local_pcp:0kB free_cma:1740kB Jan 28 23:48:32 raspberrypi kernel: [3815265.633744] lowmem_reserve[]: 0 0 Jan 28 23:48:32 raspberrypi kernel: [3815265.633751] Normal: 123*4kB (UMEHC) 104*8kB (UEHC) 105*16kB (UEHC) 76*32kB (UEHC) 39*64kB (UEHC) 20*128kB (UEH) 16*256kB (UEHC) 2*512kB (H) 1*1024kB (C) 0*2048kB 0*4096kB = 16636kB Jan 28 23:48:32 raspberrypi kernel: [3815265.633790] 2600 total pagecache pages Jan 28 23:48:32 raspberrypi kernel: [3815265.633794] 18 pages in swap cache Jan 28 23:48:32 raspberrypi kernel: [3815265.633797] Swap cache stats: add 967890, delete 967873, find 539252/1220763 Jan 28 23:48:32 raspberrypi kernel: [3815265.633799] Free swap = 0kB Jan 28 23:48:32 raspberrypi kernel: [3815265.633801] Total swap = 102396kB Jan 28 23:48:32 raspberrypi kernel: [3815265.633803] 242688 pages RAM Jan 28 23:48:32 raspberrypi kernel: [3815265.633806] 0 pages HighMem/MovableOnly Jan 28 23:48:32 raspberrypi kernel: [3815265.633808] 5326 pages reserved Jan 28 23:48:32 raspberrypi kernel: [3815265.633810] 2048 pages cma reserved Jan 28 23:48:32 raspberrypi kernel: [3815265.633812] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name Jan 28 23:48:32 raspberrypi kernel: [3815265.633832] [ 92] 0 92 8780 34 15 0 75 0 systemd-journal Jan 28 23:48:32 raspberrypi kernel: [3815265.633839] [ 124] 0 124 3638 13 8 0 157 -1000 systemd-udevd Jan 28 23:48:32 raspberrypi kernel: [3815265.633846] [ 246] 100 246 4320 8 9 0 102 0 systemd-timesyn Jan 28 23:48:32 raspberrypi kernel: [3815265.633852] [ 294] 0 294 5969 12 10 0 245 0 rsyslogd Jan 28 23:48:32 raspberrypi kernel: [3815265.633857] [ 298] 108 298 1601 28 7 0 63 0 avahi-daemon Jan 28 23:48:32 raspberrypi kernel: [3815265.633863] [ 299] 65534 299 1324 4 6 0 58 0 thd Jan 28 23:48:32 raspberrypi kernel: [3815265.633868] [ 304] 105 304 1629 40 8 0 77 -900 dbus-daemon Jan 28 23:48:32 raspberrypi kernel: [3815265.633874] [ 326] 108 326 1601 0 6 0 77 0 avahi-daemon Jan 28 23:48:32 raspberrypi kernel: [3815265.633879] [ 336] 0 336 1845 10 7 0 101 0 systemd-logind Jan 28 23:48:32 raspberrypi kernel: [3815265.633885] [ 339] 0 339 1325 13 6 0 43 0 cron Jan 28 23:48:32 raspberrypi kernel: [3815265.633890] [ 424] 0 424 2533 16 9 0 119 0 wpa_supplicant Jan 28 23:48:32 raspberrypi kernel: [3815265.633897] [ 461] 0 461 524 0 4 0 31 0 hciattach Jan 28 23:48:32 raspberrypi kernel: [3815265.633902] [ 465] 0 465 1818 0 8 0 84 0 bluetoothd Jan 28 23:48:32 raspberrypi kernel: [3815265.633907] [ 466] 0 466 8759 0 13 0 108 0 bluealsa Jan 28 23:48:32 raspberrypi kernel: [3815265.633913] [ 530] 0 530 737 8 6 0 94 0 dhcpcd Jan 28 23:48:32 raspberrypi kernel: [3815265.633918] [ 546] 0 546 1470 2 8 0 115 0 login Jan 28 23:48:32 raspberrypi kernel: [3815265.633923] [ 571] 0 571 2552 11 8 0 127 -1000 sshd Jan 28 23:48:32 raspberrypi kernel: [3815265.633929] [ 806] 1000 806 2414 2 9 0 178 0 systemd Jan 28 23:48:32 raspberrypi kernel: [3815265.633935] [ 810] 1000 810 2815 0 9 0 315 0 (sd-pam) Jan 28 23:48:32 raspberrypi kernel: [3815265.633940] [ 817] 1000 817 1526 2 6 0 316 0 bash Jan 28 23:48:32 raspberrypi kernel: [3815265.633945] [ 841] 0 841 1808 2 8 0 93 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.633951] [ 845] 0 845 877 0 5 0 22 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.633957] [ 857] 0 857 1808 2 7 0 93 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.633962] [ 861] 0 861 877 0 5 0 22 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.633968] [ 2317] 0 2317 11818 48 18 0 308 0 packagekitd Jan 28 23:48:32 raspberrypi kernel: [3815265.633974] [ 2321] 0 2321 10046 40 14 0 160 0 polkitd Jan 28 23:48:32 raspberrypi kernel: [3815265.633979] [ 2424] 0 2424 1808 2 7 0 93 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.633985] [ 2428] 0 2428 877 0 5 0 22 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.633990] [ 2491] 0 2491 1808 2 8 0 93 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.633995] [ 2495] 0 2495 877 0 5 0 22 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634001] [ 2570] 0 2570 1808 2 7 0 93 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634007] [ 2574] 0 2574 877 0 7 0 22 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634012] [ 5138] 0 5138 1808 2 8 0 92 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634018] [ 5142] 0 5142 877 0 6 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634023] [ 7788] 0 7788 1808 2 7 0 92 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634029] [ 7792] 0 7792 877 0 6 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634035] [ 7924] 0 7924 1808 2 7 0 91 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634040] [ 7928] 0 7928 877 0 6 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634045] [ 9770] 0 9770 243016 221290 473 0 9449 0 weewxd Jan 28 23:48:32 raspberrypi kernel: [3815265.634051] [ 9793] 0 9793 1808 2 7 0 91 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634056] [ 9797] 0 9797 877 0 5 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634061] [ 6926] 1000 6926 2028 1 8 0 126 0 top Jan 28 23:48:32 raspberrypi kernel: [3815265.634067] [12607] 0 12607 1808 0 7 0 92 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634072] [12611] 0 12611 877 0 6 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634077] [12661] 0 12661 1808 2 8 0 92 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634083] [12665] 0 12665 877 0 6 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634089] [12895] 0 12895 1808 2 8 0 92 0 sudo Jan 28 23:48:32 raspberrypi kernel: [3815265.634094] [12899] 0 12899 877 0 6 0 21 0 tail Jan 28 23:48:32 raspberrypi kernel: [3815265.634099] [17160] 0 17160 2882 184 10 0 2 0 sshd Jan 28 23:48:32 raspberrypi kernel: [3815265.634105] [17171] 1000 17171 2915 195 10 0 3 0 sshd Jan 28 23:48:32 raspberrypi kernel: [3815265.634111] [17174] 1000 17174 1526 281 7 0 38 0 bash Jan 28 23:48:32 raspberrypi kernel: [3815265.634116] [17194] 1000 17194 2028 128 9 0 1 0 top Jan 28 23:48:32 raspberrypi kernel: [3815265.634122] [17211] 1000 17211 2028 0 8 0 129 0 top Jan 28 23:48:32 raspberrypi kernel: [3815265.634127] [17290] 1000 17290 2028 113 10 0 1 0 top Jan 28 23:48:32 raspberrypi kernel: [3815265.634132] [17293] 1000 17293 2028 391 8 0 1 0 top Jan 28 23:48:32 raspberrypi kernel: [3815265.634140] Out of memory: Kill process 9770 (weewxd) score 852 or sacrifice child Jan 28 23:48:32 raspberrypi kernel: [3815265.634171] Killed process 9770 (weewxd) total-vm:972064kB, anon-rss:885160kB, file-rss:0kB, shmem-rss:0kB Jan 28 23:48:32 raspberrypi kernel: [3815265.972280] oom_reaper: reaped process 9770 (weewxd), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB Jan 29 00:17:01 raspberrypi CRON[17411]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 01:17:01 raspberrypi CRON[17456]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 02:17:01 raspberrypi CRON[17500]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 03:17:01 raspberrypi CRON[17526]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 04:17:01 raspberrypi CRON[17555]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 05:17:01 raspberrypi CRON[17581]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 06:13:38 raspberrypi systemd[1]: Starting Daily apt upgrade and clean activities... Jan 29 06:13:41 raspberrypi systemd[1]: Started Daily apt upgrade and clean activities. Jan 29 06:13:41 raspberrypi systemd[1]: apt-daily-upgrade.timer: Adding 24min 23.836691s random time. Jan 29 06:13:41 raspberrypi systemd[1]: apt-daily-upgrade.timer: Adding 4min 9.519638s random time. Jan 29 06:17:02 raspberrypi CRON[17652]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Jan 29 06:25:01 raspberrypi CRON[17667]: (root) CMD (test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.daily )) Jan 29 06:25:02 raspberrypi liblogging-stdlog: [origin software="rsyslogd" swVersion="8.24.0" x-pid="294" x-info="http://www.rsyslog.com";] rsyslogd was HUPed -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
