[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 Dariusz Nawrocki changed: What|Removed |Added CC||dnawr...@gmail.com --- Comment #22 from Dariusz Nawrocki --- The same issue here. I upgraded from Ubuntu 20.04 to 22.04 yesterday. Today I noticed that there is no space available to see ~200 GB WAL file: ``` > $ ls -alh ./.local/share/kactivitymanagerd/resources/ > total 197G > drwxrwxr-x 4 xtb xtb 4,0K paź 15 22:45 . > drwxrwxr-x 3 xtb xtb 4,0K lis 10 2020 .. > -rw-r--r-- 1 xtb xtb 844K paź 16 13:08 database > -rw-r--r-- 1 xtb xtb 390M paź 16 17:07 database-shm > -rw-r--r-- 1 xtb xtb 196G paź 16 17:08 database-wal > drwxrwxr-x 2 xtb xtb 4,0K paź 15 22:45 test-backup > drwxrwxr-x 2 xtb xtb 4,0K paź 15 22:45 working-backup ``` -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 Ahmad Samir changed: What|Removed |Added CC||a.samir...@gmail.com --- Comment #21 from Ahmad Samir --- (In reply to Tilman Vogel from comment #20) > > Are you all on Arch? > > No, I am on openSUSE Tumbleweed and had that problem. Also, > kactivitymanagerd ate 100% of one of my cores. I removed database and config > files. After that, it did not happen again yet. I had this same issue on Tumbleweed, and deleting the database files fixed the issue, I thought it was a fluke on my system, so never reported it. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 Miguel Hernandez changed: What|Removed |Added CC||poetahal...@protonmail.com -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #20 from Tilman Vogel --- > Are you all on Arch? No, I am on openSUSE Tumbleweed and had that problem. Also, kactivitymanagerd ate 100% of one of my cores. I removed database and config files. After that, it did not happen again yet. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #19 from Piotr Mierzwinski --- (In reply to Ivan Čukić from comment #16) > Also, what is the content of > .local/share/kactivitymanagerd/resources/errors.log > ? "2022-05-19T00:10:28 error: near ".": syntax error Unable to execute statement" BTW. That day I got huge "database-wal" file. I reported this, also. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #18 from Ivan Čukić --- Thanks, will try to set it up in a VM to see whether I can reproduce it on Arch. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #17 from Piotr Mierzwinski --- (In reply to Ivan Čukić from comment #15) > Still haven't been able to reproduce the issue. > > I'm working on a health checker that will disable adding recent documents to > the database if the wal file becomes larger than the database itself. But > that is not a proper fix for the issue. > > Are you all on Arch? Yes. To be detailed. My previous distribution was Antergos, but after it died has been migrated to Arch, automatically. I think it happened couple years ago. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #16 from Ivan Čukić --- Also, what is the content of .local/share/kactivitymanagerd/resources/errors.log ? -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #15 from Ivan Čukić --- Still haven't been able to reproduce the issue. I'm working on a health checker that will disable adding recent documents to the database if the wal file becomes larger than the database itself. But that is not a proper fix for the issue. Are you all on Arch? -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 Tilman Vogel changed: What|Removed |Added CC||tilman.vo...@web.de -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #14 from Piotr Mierzwinski --- (In reply to John from comment #11) > (In reply to Piotr Mierzwinski from comment #9) > > And today issue happened again. > > Again found notification that my home partition has no free space. Opened > > folder: ~/.local/share/kactivitymanagerd/resources/ and of course found huge > > database-wal file. Check my result of ls: > > $ ls -lh > > total 77G > > drwxr-xr-x 2 piotra piotra 4.0K 16.05.2022 20:35 test-backup/ > > drwxr-xr-x 2 piotra piotra 4.0K 09.05.2022 09:24 working-backup/ > > -rw-r--r-- 1 piotra piotra 12M 16.05.2022 20:36 database > > -rw-r--r-- 1 piotra piotra 153M 16.05.2022 23:44 database-shm > > -rw-r--r-- 1 piotra piotra 77G 16.05.2022 23:45 database-wal > > > > Below please find version of sqlite I have installed: > > $ pacman -Q | grep sqlite > > lib32-sqlite 3.37.0-1 > > mopidy-local-sqlite 1.0.0-1 > > sqlite 3.38.5-1 > > > > @Ivan > > Do you think that downgrade of sqlite could help in this case? > > > > In attachment please find result of lsof command. > > For the last few days I've dodged the problem. What I did was delete/rename > the entire `~/.local/share/kactivitymanagerd/resources/` folder instead of > just specific files. Ever since none of them has grown like that. > > Might wanna give it a try. Thanks for advise. I applied your solution. We will see if issue will happen again for me. Worth to notice that removed structure of directories have been recreated. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #13 from Piotr Mierzwinski --- Created attachment 148977 --> https://bugs.kde.org/attachment.cgi?id=148977=edit lsof_kactivitymanagerd_20220518 -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #12 from Piotr Mierzwinski --- And today again happened mentioned issue :/-. $ ls -lh total 77G drwxr-xr-x 2 piotra piotra 4.0K 17.05.2022 00:19 test-backup/ drwxr-xr-x 2 piotra piotra 4.0K 17.05.2022 00:19 working-backup/ -rw-r--r-- 1 piotra piotra 11M 18.05.2022 13:52 database -rw-r--r-- 1 piotra piotra 152M 19.05.2022 00:02 database-shm -rw-r--r-- 1 piotra piotra 76G 19.05.2022 00:04 database-wal This starts to be really annoying. What is going on with that? Attached lsof result. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #11 from John --- (In reply to Piotr Mierzwinski from comment #9) > And today issue happened again. > Again found notification that my home partition has no free space. Opened > folder: ~/.local/share/kactivitymanagerd/resources/ and of course found huge > database-wal file. Check my result of ls: > $ ls -lh > total 77G > drwxr-xr-x 2 piotra piotra 4.0K 16.05.2022 20:35 test-backup/ > drwxr-xr-x 2 piotra piotra 4.0K 09.05.2022 09:24 working-backup/ > -rw-r--r-- 1 piotra piotra 12M 16.05.2022 20:36 database > -rw-r--r-- 1 piotra piotra 153M 16.05.2022 23:44 database-shm > -rw-r--r-- 1 piotra piotra 77G 16.05.2022 23:45 database-wal > > Below please find version of sqlite I have installed: > $ pacman -Q | grep sqlite > lib32-sqlite 3.37.0-1 > mopidy-local-sqlite 1.0.0-1 > sqlite 3.38.5-1 > > @Ivan > Do you think that downgrade of sqlite could help in this case? > > In attachment please find result of lsof command. For the last few days I've dodged the problem. What I did was delete/rename the entire `~/.local/share/kactivitymanagerd/resources/` folder instead of just specific files. Ever since none of them has grown like that. Might wanna give it a try. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #10 from Piotr Mierzwinski --- Created attachment 148900 --> https://bugs.kde.org/attachment.cgi?id=148900=edit lsof_kactivitymanagerd_20220516 -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #9 from Piotr Mierzwinski --- And today issue happened again. Again found notification that my home partition has no free space. Opened folder: ~/.local/share/kactivitymanagerd/resources/ and of course found huge database-wal file. Check my result of ls: $ ls -lh total 77G drwxr-xr-x 2 piotra piotra 4.0K 16.05.2022 20:35 test-backup/ drwxr-xr-x 2 piotra piotra 4.0K 09.05.2022 09:24 working-backup/ -rw-r--r-- 1 piotra piotra 12M 16.05.2022 20:36 database -rw-r--r-- 1 piotra piotra 153M 16.05.2022 23:44 database-shm -rw-r--r-- 1 piotra piotra 77G 16.05.2022 23:45 database-wal Below please find version of sqlite I have installed: $ pacman -Q | grep sqlite lib32-sqlite 3.37.0-1 mopidy-local-sqlite 1.0.0-1 sqlite 3.38.5-1 @Ivan Do you think that downgrade of sqlite could help in this case? In attachment please find result of lsof command. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #8 from John --- Created attachment 148785 --> https://bugs.kde.org/attachment.cgi?id=148785=edit Actitivies application crash -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #7 from John --- Created attachment 148784 --> https://bugs.kde.org/attachment.cgi?id=148784=edit another lsof output for the wal file -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 John changed: What|Removed |Added CC||john.athanasi...@gmail.com --- Comment #6 from John --- I have been experiencing the same issue. The wal file grows to 200GB+ end doesn't stop until my disk is full. Furthermore, I the settings/activities app is crashing now so I cannot change the history options. I will attach my own `lsof` output as well, plus the crash report for the "Activities" app, in case that helps -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #5 from Piotr Mierzwinski --- Created attachment 148747 --> https://bugs.kde.org/attachment.cgi?id=148747=edit lsof_kactivitymanagerd.txt -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #4 from Piotr Mierzwinski --- (In reply to Ivan Čukić from comment #3) > > Never should grow that much, but in fact I met such huge file, what > > described. > > Yes, I believe you, just meant to say that this is really unexpected. On a > properly working sqlite, WAL should not be bigger than the DB itself. :) > > Do you use anything out of the ordinary which might keep the database locked > so that WAL can not be flushed? Or some uncommon plasma applets, or strange > filesystems (NFS being a common problem)? Since some time (couple months) I use the same stuff in my system. And for sure nothing not ordinary I didn't use between April 21st (when wal file had normal size) and day when file became huge. If you know some application or plasma applet which could cause the problem tell me please I will verify all I use. I didn't install nothing new since couple moths. I can provide you the list of applications I usually use and what applets working in my Plasma session everyday since several months. I use NFS file system since long time. By this filesystem I mount my resources placed in Synology server. I'm not sure if this will be helpful here, but they are not always mounted correctly when system starts. I mean that one day all is mounted find and another nothing mounted. I don't know what this depend on. I use such command in /etc/fstab ds214plus:/volume1/my_disk /home/piotra/My_Disk nfs rsize=8192,wsize=8192,timeo=14,intr,nosuid BTW. Today nothing was mounted, but I don't see nothing not ordinary in wal file. Its size looks like below: -rw-r--r-- 1 piotra piotra 11M 11.05.2022 09:37 database -rw-r--r-- 1 piotra piotra 32K 11.05.2022 09:37 database-shm -rw-r--r-- 1 piotra piotra 1.5M 11.05.2022 09:37 database-wal > Does the following return anything other than plasmashell, kactivitymanagerd? > > lsof | grep > /home/YOUR_USER_NAME/.local/share/kactivitymanagerd/resources/database I found only "plasmashe" and "kactivity". Detailed result in attached file. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 --- Comment #3 from Ivan Čukić --- > Never should grow that much, but in fact I met such huge file, what described. Yes, I believe you, just meant to say that this is really unexpected. On a properly working sqlite, WAL should not be bigger than the DB itself. :) Do you use anything out of the ordinary which might keep the database locked so that WAL can not be flushed? Or some uncommon plasma applets, or strange filesystems (NFS being a common problem)? Does the following return anything other than plasmashell, kactivitymanagerd? lsof | grep /home/YOUR_USER_NAME/.local/share/kactivitymanagerd/resources/database > Maybe there is an option in configuration of sqlite which limits size of log > file, > if so then would be nice to set it. There is, but it doesn't really do anything. There is some work on a new WAL system, but that doesn't help us now. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 Piotr Mierzwinski changed: What|Removed |Added CC||piotr.mierzwin...@gmail.com --- Comment #2 from Piotr Mierzwinski --- (In reply to Ivan Čukić from comment #1) > The wal file is sqlite's write-ahead log. It should never grow that much. > Will see what can be done about it. In the early days, sqlite gave us a few > headaches, but nothing recently. Esp nothing of this magnitude... :/ Never should grow that much, but in fact I met such huge file, what described. Maybe there is an option in configuration of sqlite which limits size of log file, if so then would be nice to set it. > As for the notification, the default plasma setup notifies on low space on > any hard drive. Yes, and thanks that I found out about the problem. As I said I got 0 free space on /home. I had to do investigation to find out what took so much space in my home partition. Very helpful was Filelight. Saying about notification I meant watching side of mentioned file, but if is possible to limits this file in different way then of course this is not necessary. -- You are receiving this mail because: You are watching all bug changes.
[frameworks-kactivities] [Bug 453570] activitymanagerd created database which took 80 GB in file system
https://bugs.kde.org/show_bug.cgi?id=453570 Ivan Čukić changed: What|Removed |Added Status|REPORTED|ASSIGNED Ever confirmed|0 |1 --- Comment #1 from Ivan Čukić --- The wal file is sqlite's write-ahead log. It should never grow that much. Will see what can be done about it. In the early days, sqlite gave us a few headaches, but nothing recently. Esp nothing of this magnitude... :/ As for the notification, the default plasma setup notifies on low space on any hard drive. -- You are receiving this mail because: You are watching all bug changes.
