Re: [PATCH] lei_to_mail+mbox_reader: fix handling of empty/bogus emails

2021-09-07 Thread Eric Wong
Konstantin Ryabitsev wrote: > Okay, I guess it's not any different from someone doing the same thing over > the web interface. It would be nice to have a way to limit how many messages > are returned for gzipped mailbox downloads, seeing as they cannot be paginated > in the same way web views are,

Re: [PATCH] lei_to_mail+mbox_reader: fix handling of empty/bogus emails

2021-09-07 Thread Konstantin Ryabitsev
On Tue, Sep 07, 2021 at 08:56:17PM +, Eric Wong wrote: > > 1. this means that each "lei up" call will be increasingly larger and > > larger, > >since when we init the search with rt:, it gets resolved into a datestamp > >(e.g. rt:2.weeks.ago becomes rt:1625699031). I'm worried that thi

Re: [PATCH] lei_to_mail+mbox_reader: fix handling of empty/bogus emails

2021-09-07 Thread Eric Wong
Konstantin Ryabitsev wrote: > On Sat, Sep 04, 2021 at 09:36:58PM +, Eric Wong wrote: > > Konstantin Ryabitsev wrote: > > > Yep, that seems to work fine. Question -- I noticed that lei just issues a > > > regular query, retrieves results with curl and then parses the output. Is > > > there a d

Re: [PATCH] lei_to_mail+mbox_reader: fix handling of empty/bogus emails

2021-09-07 Thread Konstantin Ryabitsev
On Sat, Sep 04, 2021 at 09:36:58PM +, Eric Wong wrote: > Konstantin Ryabitsev wrote: > > Yep, that seems to work fine. Question -- I noticed that lei just issues a > > regular query, retrieves results with curl and then parses the output. Is > > there a danger of potentially running into issue

[PATCH] lei_to_mail+mbox_reader: fix handling of empty/bogus emails

2021-09-04 Thread Eric Wong
anges in the future? It's actually parsing gzipped mboxrd (&x=m). But you're right we could use stronger safeguards in case we see gzipped HTML or something else... --8<- Subject: [PATCH] lei_to_mail+mbox_reader: fix handling of empty/bogus emails We may be handling i