Re: verify dovecot 2.3.19.1 + fts_tika + tika-server 2.4.1 attachment scanning?
> On 19/07/2022 05:04 EEST PGNet Dev wrote: > > > On 7/18/22 7:20 AM, PGNet Dev wrote: > > On 7/18/22 5:53 AM, Aki Tuomi wrote: > >> Can you provide logs & doveconf -n? > > > > referencing prior mention of a tika ML thread, > ... > > tika upstream enabled a DEBUG build > > debugging receipt via fts-tika, with that build, of the failed-to-scan PDF is > discussed here > > https://lists.apache.org/thread/b2qkj6mp5f6x57qs5xxncqf29cnj3br9 > > and the DEBUG logs are at > > https://pastebin.com/raw/sk5xevAM Jul 18 21:28:23 mx-test tika[18970]: DEBUG [qtp977522995-24] 21:28:23,264 org.apache.tika.parser.pdf.PDFParser File: /tmp/apache-tika-9115808773791090696.tmp, length: 104932, md5: 092bf24b2cac33fac27965549c99613a You can see if this matches with your PDF file. But after that, it complains that the PDF is corrupted. So I think the first step would be to validate if length and MD5 sum matches with your input data. Aki
Re: Tools to get a report of which folders have new mail?
> On 19/07/2022 06:18 EEST Steve Litt wrote: > > > Hi all, > > I use a Dovecot IMAP server on my Linux desktop computer, and I'm > pretty good at writing shellscripts. Is there any way I could use > doveadm or other tools to create a report that shows all my folders in a > hierarchy? Also, is there a way to show only those with new mail? > > Thanks, > > SteveT > > Steve Litt > Summer 2022 featured book: Thriving in Tough Times > http://www.troubleshooters.com/bookstore/thrive.htm doveadm -fjson mailbox status -u user unseen "*" Aki
Re: Tools to get a report of which folders have new mail?
On 19/07/22 3:18 pm, Steve Litt wrote: Is there any way I could use doveadm or other tools to create a report that shows all my folders in a hierarchy? See doveadm(1) and doveadm-mailbox(1), specifically the `doveadm mailbox list` command. Also, is there a way to show only those with new mail? Look at doveadm-search(1) and doveadm-search-query(7) for this. You can loop through the list of mailboxes from doveadm mailbox list and pass them one at a time to `doveadm search NEW MAILBOX mailboxname` to see if any messages are returned from the search. Peter
Re: Tools to get a report of which folders have new mail?
Remo Mattei said on Mon, 18 Jul 2022 20:51:16 -0700 >Are you using maildrop or flat files In your config? Thanks Remo, If by "maildrop" you mean "maildir", I'm using maildir. Otherwise, I don't know what maildrop is. > If you are using >maildrop where there is a file for each file then you could use free >into the folder new My Dovecot setup uses maildir and there's definitely one file per message. When I type "free" at my Linux command line it just lists statistics about memory. The doveadm man page doesn't list a command called "free". So I'm not sure what "free into the new folder" means. > but I do not know what config you have check tre >command and see if that does some of what you want. Thanks, SteveT > >> Il giorno 18 lug 2022, alle ore 20:20, Steve Litt >> ha scritto: >> >> Hi all, >> >> I use a Dovecot IMAP server on my Linux desktop computer, and I'm >> pretty good at writing shellscripts. Is there any way I could use >> doveadm or other tools to create a report that shows all my folders >> in a hierarchy? Also, is there a way to show only those with new >> mail? >> >> Thanks, >> >> SteveT >> >> Steve Litt >> Summer 2022 featured book: Thriving in Tough Times >> http://www.troubleshooters.com/bookstore/thrive.htm >
Re: Tools to get a report of which folders have new mail?
Are you using maildrop or flat files In your config? If you are using maildrop where there is a file for each file then you could use free into the folder new but I do not know what config you have check tre command and see if that does some of what you want. > Il giorno 18 lug 2022, alle ore 20:20, Steve Litt > ha scritto: > > Hi all, > > I use a Dovecot IMAP server on my Linux desktop computer, and I'm > pretty good at writing shellscripts. Is there any way I could use > doveadm or other tools to create a report that shows all my folders in a > hierarchy? Also, is there a way to show only those with new mail? > > Thanks, > > SteveT > > Steve Litt > Summer 2022 featured book: Thriving in Tough Times > http://www.troubleshooters.com/bookstore/thrive.htm
Tools to get a report of which folders have new mail?
Hi all, I use a Dovecot IMAP server on my Linux desktop computer, and I'm pretty good at writing shellscripts. Is there any way I could use doveadm or other tools to create a report that shows all my folders in a hierarchy? Also, is there a way to show only those with new mail? Thanks, SteveT Steve Litt Summer 2022 featured book: Thriving in Tough Times http://www.troubleshooters.com/bookstore/thrive.htm
Re: verify dovecot 2.3.19.1 + fts_tika + tika-server 2.4.1 attachment scanning?
On 7/18/22 7:20 AM, PGNet Dev wrote: On 7/18/22 5:53 AM, Aki Tuomi wrote: Can you provide logs & doveconf -n? referencing prior mention of a tika ML thread, ... tika upstream enabled a DEBUG build debugging receipt via fts-tika, with that build, of the failed-to-scan PDF is discussed here https://lists.apache.org/thread/b2qkj6mp5f6x57qs5xxncqf29cnj3br9 and the DEBUG logs are at https://pastebin.com/raw/sk5xevAM
Re: Deleting "folders only" folder doesn't actually delete
Hi Christian, thought I'd follow up and see if you had any further thoughts
on this?
The permissions of the directory are as follows:
$ ls -ld tmpfolder
drwxrwsr-x 2 alex mail 10 Jul 15 11:59 tmpfolder
I can remove it without difficulty just using rmdir.
Again, here is the output from doveadm:
# doveadm acl rights -u alex tmpfolder
doveadm(alex): Error: ACL not enabled for alex
Rights
Thanks,
Alex
On Fri, Jul 15, 2022 at 2:10 PM Alex wrote:
> >
>> > I'm using dovecot-2.3.17.1-1.fc34.x86_64 on fedora34 and Thunderbird 91
>> on
>> > fedora35. When creating a folder of type "folders only" in Thunderbird,
>> > then trying to delete it, it doesn't actually delete it from the
>> > filesystem. Is this a permissions problem? Or perhaps a Thunderbird
>> problem?
>> >
>> > I don't see any messages in the logs that would indicate some type of
>> > failed attempt to delete. How do I troubleshoot this?
>> >
>>
>> What do you get from the following command?
>> (Substitude the shell variables with your case.)
>>
>> doveadm acl rights -u ${YOUR_USER} ${FOLDER_NAME}
>>
>
> # doveadm acl rights -u alex tmpfolder
> doveadm(alex): Error: ACL not enabled for alex
> Rights
>
> It was removed from view in Thunderbird, but not from the filesystem.
>
> It was necessary for me to add acl support to mail_plugins as well.
>
> Thanks,
> Alex
>
>
Interfacing mutt with Dovecott
Hi all, All my email for the past 20 years is held on a Dovecot IMAP server (version 2.3.19.1 (9b53102964)) on my desktop. I've been using Claws-Mail but want to switch to Mutt. In the past I've tried this, but Mutt was unreliable in reading folders from my local Dovecot server. It didn't see a lot of the folders. I know some people have been very successful running Mutt to access an IMAP server, so it appears to be possible. How should I run Mutt to access my Dovecot? Also, in the past I've used Claws-Mail to admin my Dovecot folders (make new folders, move folders, etc). I've heard there are one or more Dovecot provided tools to do this kind of admin. What are the names of those tools? Thanks, SteveT Steve Litt Summer 2022 featured book: Thriving in Tough Times http://www.troubleshooters.com/bookstore/thrive.htm
Re: verify dovecot 2.3.19.1 + fts_tika + tika-server 2.4.1 attachment scanning?
On 7/18/22 5:53 AM, Aki Tuomi wrote: On 17/07/2022 18:30 EEST PGNet Dev wrote: 1st Q: can anyone _here_ verify successful (no error/fail) PDF attachment scanning using dovecot 2.3.19.1 + fts_tika, with tika-server 2.4.1 Can you provide logs & doveconf -n? apart from continuing to debug the current problem *i* see, still interested in any '3rd party' verification that this setup is working - for someone.
Re: verify dovecot 2.3.19.1 + fts_tika + tika-server 2.4.1 attachment scanning?
On 7/18/22 5:53 AM, Aki Tuomi wrote:
Can you provide logs & doveconf -n?
referencing prior mention of a tika ML thread,
https://dovecot.org/pipermail/dovecot/2022-July/125024.html
latest tika logs, as part of the ongoing thread there, are,
https://tika.markmail.org/message/e2oyz55l6xd234yh
here's dovecot debug log output
('mail_debug=yes', since 'log_debug=(category=fts-tika)' is not yet supported)
...
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug:
Loading modules from directory: /usr/lib64/dovecot
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug: Module
loaded: /usr/lib64/dovecot/lib01_acl_plugin.so
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug: Module
loaded: /usr/lib64/dovecot/lib20_fts_plugin.so
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug: Module
loaded: /usr/lib64/dovecot/lib20_virtual_plugin.so
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug: Module
loaded: /usr/lib64/dovecot/lib21_fts_flatcurve_plugin.so
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug:
auth-master: userdb lookup(myu...@example.com): Started userdb lookup
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug:
auth-master: conn unix:/run/dovecot/auth-userdb: Connecting
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug:
auth-master: conn unix:/run/dovecot/auth-userdb (pid=49802,uid=0): Client connected
(fd=14)
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug:
auth-master: userdb lookup(myu...@example.com): auth USER input: myu...@example.com
home=/data/vmail/example.com/myuser/Maildir uid=5000 gid=5000
quota=dirsize:storage=1024
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug:
auth-master: userdb lookup(myu...@example.com): Finished userdb lookup
(username=myu...@example.com home=/data/vmail/example.com/myuser/Maildir uid=5000
gid=5000 quota=dirsize:storage=1024)
2022-07-18 06:47:43 indexer-worker(myu...@example.com)<>: Debug: Added
userdb setting: plugin/quota=dirsize:storage=1024
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: Effective uid=5000, gid=5000, home=/data/vmail/example.com/myuser/Maildir
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: shared: root=/run/dovecot/, index=, indexpvt=, control=, inbox=, alt=
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts: Indexes disabled for namespace 'shared/%u/'
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: initializing backend with data:
vfile:/home/vmail/conf.d/example.com/acls:cache_secs=300
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: acl username = myu...@example.com
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: owner = 0
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fs: root=/data/vmail/example.com/myuser/Maildir,
index=/var/vmail-index/example.com/myuser, indexpvt=,
control=/data/vmail/example.com/myuser/_control,
inbox=/data/vmail/example.com/myuser/Maildir, alt=
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: initializing backend with data:
vfile:/home/vmail/conf.d/example.com/acls:cache_secs=300
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: acl username = myu...@example.com
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: owner = 1
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fs: root=/data/vmail/virtual, index=, indexpvt=, control=, inbox=, alt=
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts: Indexes disabled for namespace 'virtual/'
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: initializing backend with data:
vfile:/home/vmail/conf.d/example.com/acls:cache_secs=300
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: acl username = myu...@example.com
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: acl: owner = 1
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts-flatcurve: Xapian library version: 1.4.19
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts-flatcurve(INBOX): Opened DB (RO) messages=3901 version=1 shards=2
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts-flatcurve(INBOX): Last UID uid=146399
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts-flatcurve(INBOX): Last UID uid=146399
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts-flatcurve(INBOX): Opened DB (RW; current.1654048601101678) messages=342
version=1
2022-07-18 06:47:43
indexer-worker(myu...@example.com):
Debug: fts-flatcurve(INBOX):
Re: verify dovecot 2.3.19.1 + fts_tika + tika-server 2.4.1 attachment scanning?
> On 17/07/2022 18:30 EEST PGNet Dev wrote: > > > debugging a reproducible tika-server fail with fts_tika has proved a bit > challenging, upstream > > 1st Q: can anyone _here_ verify successful (no error/fail) PDF attachment > scanning using > > dovecot 2.3.19.1 + fts_tika, with tika-server 2.4.1 > > ? > > i'm seeing issues with any/all PDF attachments. > > this one, from smallpdf.com, > > "Get_Started_With_Smallpdf.pdf" > DL @: https://ufile.io/dkew7k0u > > is the/a sample that reproduces the problem Can you provide logs & doveconf -n? Aki
