Re: IMAP FETCH management

2024-03-22 Thread Benoit TELLIER
Hello all. The streaming approach turned out to be a terrible idea! ChunkStream was doing massive blocking reads on the event loop. InputStream is just not the right abstraction for non blocking reads. Rewriting everything to support something like Flux looks doable but requires a major

Re: IMAP FETCH management

2024-03-20 Thread Benoit TELLIER
Hello all, Today I did put together a POC where the following IMAP command     a0 FETCH 1:* (BODY[]) would directly stream content from the S3 storage without storing the full input in a byte array. I did test it a bit manually on top of the S3 AES implementation. Link:

IMAP FETCH management

2024-03-19 Thread Benoit TELLIER
Hello all, As I had already been writing here, I did encounter significant issues during a recent deployment [1] [1] https://www.mail-archive.com/server-dev@james.apache.org/msg73848.html This did lead to [2] implementing backpressure for IMAP FETCH. Which had been mitigating the issue.