How to debug 'ignoring non-mail file' issues

2014-08-31 Thread Perttu Luukko
Hi, I indexed my archive of emails from recent years with notmuch (about 10k messages so not much). I have quite a lot of messages 'notmuch new' ignores as non-mail files, about 1000 of them. They are not obviously malformed, meaning that the files certainly look like emails when opened in a text

How to debug 'ignoring non-mail file' issues

2014-08-31 Thread Perttu Luukko
Hi, I indexed my archive of emails from recent years with notmuch (about 10k messages so not much). I have quite a lot of messages 'notmuch new' ignores as non-mail files, about 1000 of them. They are not obviously malformed, meaning that the files certainly look like emails when opened in a text

How to debug 'ignoring non-mail file' issues

2014-08-31 Thread David Bremner
Perttu Luukko writes: > The vast majority of these ignored mails are not ignored after I > transfer them with offlineimap to another computer. I can non-ignore > these files probably by copying the renamed file back to the mail > server, so this is fixable. Offlineimap shouldn't mess with the fi

How to debug 'ignoring non-mail file' issues

2014-08-31 Thread David Bremner
Perttu Luukko writes: > I understand that the list of non-mail files is stored in the notmuch > database and the files are completely ignored from there on. This > actually makes it harder to debug these kind of issues since the list of > ignored mails is only visible on the first invocation of

How to debug 'ignoring non-mail file' issues

2014-09-01 Thread Perttu Luukko
On 2014-08-31 09:46:12, David Bremner wrote: > Perttu Luukko writes: > > > I understand that the list of non-mail files is stored in the > > notmuch database and the files are completely ignored from there on. > > This actually makes it harder to debug these kind of issues since > > the list of i

How to debug 'ignoring non-mail file' issues

2014-09-01 Thread Perttu Luukko
On 2014-08-31 07:41:42, David Bremner wrote: > Perttu Luukko writes: > > The vast majority of these ignored mails are not ignored after I > > transfer them with offlineimap to another computer. I can non-ignore > > these files probably by copying the renamed file back to the mail > > server, so th

How to debug 'ignoring non-mail file' issues

2014-09-01 Thread Perttu Luukko
On 2014-09-01 09:52:20, Perttu Luukko wrote: > If the files really are ignored because of GMime it also explains why so > much more files are ignored on my mail provider's server than on my > laptop. The server probably has an older version of GMime. I'll upgrade > and see if that makes a differenc

How to debug 'ignoring non-mail file' issues

2014-09-01 Thread Tomi Ollila
On Mon, Sep 01 2014, Perttu Luukko wrote: > On 2014-08-31 07:41:42, David Bremner wrote: >> Perttu Luukko writes: >> > The vast majority of these ignored mails are not ignored after I >> > transfer them with offlineimap to another computer. I can non-ignore >> > these files probably by copying t

How to debug 'ignoring non-mail file' issues

2014-09-02 Thread Jani Nikula
On Mon, 01 Sep 2014, Perttu Luukko wrote: > Yes, upgrading to GMime 2.6.20 caused all the messages on my server > classified as mail. What was the old version? If it was 2.4 we should probably consider dropping support for that in future notmuch. > Even more reason to give a separate warning for

How to debug 'ignoring non-mail file' issues

2014-09-03 Thread Perttu Luukko
On 2014-09-02 23:37:12, Jani Nikula wrote: > On Mon, 01 Sep 2014, Perttu Luukko wrote: > > Yes, upgrading to GMime 2.6.20 caused all the messages on my server > > classified as mail. > > What was the old version? If it was 2.4 we should probably consider > dropping support for that in future notm

How to debug 'ignoring non-mail file' issues

2014-09-03 Thread Jani Nikula
On Wed, 03 Sep 2014, Perttu Luukko wrote: > What I mean that there would be a separate error for cases "Does not > resemble an email message at all", i.e., some control file your mail > server happens to store in the mailbox, and "Looks like mail but we > can't parse it", i.e., better find out why

How to debug 'ignoring non-mail file' issues

2014-09-04 Thread Perttu Luukko
On 2014-09-03 19:03:40, Jani Nikula wrote: > On Wed, 03 Sep 2014, Perttu Luukko wrote: > > What I mean that there would be a separate error for cases "Does not > > resemble an email message at all", i.e., some control file your mail > > server happens to store in the mailbox, and "Looks like mail

How to debug 'ignoring non-mail file' issues

2014-09-04 Thread Perttu Luukko
On 2014-09-01 09:41:06, Perttu Luukko wrote: > Yes, that indeed works. I'll probably move these ignored files to a > separate folder for inspection. I looked at the mails that are still ignored after upgrading GMime to latest version, and I think I have found what they have in common. All of my ig

Re: How to debug 'ignoring non-mail file' issues

2014-08-31 Thread David Bremner
Perttu Luukko writes: > The vast majority of these ignored mails are not ignored after I > transfer them with offlineimap to another computer. I can non-ignore > these files probably by copying the renamed file back to the mail > server, so this is fixable. Offlineimap shouldn't mess with the fi

Re: How to debug 'ignoring non-mail file' issues

2014-08-31 Thread David Bremner
Perttu Luukko writes: > I understand that the list of non-mail files is stored in the notmuch > database and the files are completely ignored from there on. This > actually makes it harder to debug these kind of issues since the list of > ignored mails is only visible on the first invocation of

Re: How to debug 'ignoring non-mail file' issues

2014-08-31 Thread Perttu Luukko
On 2014-08-31 09:46:12, David Bremner wrote: > Perttu Luukko writes: > > > I understand that the list of non-mail files is stored in the > > notmuch database and the files are completely ignored from there on. > > This actually makes it harder to debug these kind of issues since > > the list of i

Re: How to debug 'ignoring non-mail file' issues

2014-08-31 Thread Perttu Luukko
On 2014-08-31 07:41:42, David Bremner wrote: > Perttu Luukko writes: > > The vast majority of these ignored mails are not ignored after I > > transfer them with offlineimap to another computer. I can non-ignore > > these files probably by copying the renamed file back to the mail > > server, so th

Re: How to debug 'ignoring non-mail file' issues

2014-09-01 Thread Perttu Luukko
On 2014-09-01 09:52:20, Perttu Luukko wrote: > If the files really are ignored because of GMime it also explains why so > much more files are ignored on my mail provider's server than on my > laptop. The server probably has an older version of GMime. I'll upgrade > and see if that makes a differenc

Re: How to debug 'ignoring non-mail file' issues

2014-09-01 Thread Tomi Ollila
On Mon, Sep 01 2014, Perttu Luukko wrote: > On 2014-08-31 07:41:42, David Bremner wrote: >> Perttu Luukko writes: >> > The vast majority of these ignored mails are not ignored after I >> > transfer them with offlineimap to another computer. I can non-ignore >> > these files probably by copying t

Re: How to debug 'ignoring non-mail file' issues

2014-09-02 Thread Jani Nikula
On Mon, 01 Sep 2014, Perttu Luukko wrote: > Yes, upgrading to GMime 2.6.20 caused all the messages on my server > classified as mail. What was the old version? If it was 2.4 we should probably consider dropping support for that in future notmuch. > Even more reason to give a separate warning for

Re: How to debug 'ignoring non-mail file' issues

2014-09-02 Thread Perttu Luukko
On 2014-09-02 23:37:12, Jani Nikula wrote: > On Mon, 01 Sep 2014, Perttu Luukko wrote: > > Yes, upgrading to GMime 2.6.20 caused all the messages on my server > > classified as mail. > > What was the old version? If it was 2.4 we should probably consider > dropping support for that in future notm

Re: How to debug 'ignoring non-mail file' issues

2014-09-03 Thread Jani Nikula
On Wed, 03 Sep 2014, Perttu Luukko wrote: > What I mean that there would be a separate error for cases "Does not > resemble an email message at all", i.e., some control file your mail > server happens to store in the mailbox, and "Looks like mail but we > can't parse it", i.e., better find out why

Re: How to debug 'ignoring non-mail file' issues

2014-09-03 Thread Perttu Luukko
On 2014-09-03 19:03:40, Jani Nikula wrote: > On Wed, 03 Sep 2014, Perttu Luukko wrote: > > What I mean that there would be a separate error for cases "Does not > > resemble an email message at all", i.e., some control file your mail > > server happens to store in the mailbox, and "Looks like mail

Re: How to debug 'ignoring non-mail file' issues

2014-09-04 Thread Perttu Luukko
On 2014-09-01 09:41:06, Perttu Luukko wrote: > Yes, that indeed works. I'll probably move these ignored files to a > separate folder for inspection. I looked at the mails that are still ignored after upgrading GMime to latest version, and I think I have found what they have in common. All of my ig