Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-13 Thread Jonathan Ryshpan
Sorry for the delay replying.  I've been away from the list for a while.
I thank you for your help, despite it's occasionally sharp tone.

On Fri, 2011-07-08 at 09:29 +0100, Pete Biggs wrote:
  
  I created the folder fred.  It appeared to be created in local only; nothing
  showed up in local_mbox, though it did show up in evolution's folder list.
 
 Why would you expect it to be in local_mbox?  local_mbox is a copy of
 the old, unconverted local files from before the initial conversion.
 It's not used for anything.

Thanks for the info.  The info It's not used for anything. is
extremely interesting, and not clear from the documentation or earlier
postings on this thread to the list.  I suppose now I can delete it, or
at least its contents.

  While deleting the mail folder fred, this message appeared in a red error
  panel:
  Error while Storing folder 'fred'.
  Cannot open maildir directory path:
  /home/jonrysh/.local/share/evolution/mail/local/.fred: No such file or
  directory

This problem has gone away for unknown reasons.

 After you created the folder within Evolution under local, does the
 directory ~/.local/share/evolution/mail/local/.fred exist?  What are its
 permissions and ownership?  What are the permissions on the directory
 ~/.local/share/evolution/mail/local?

Directory ~/.local/share/evolution/mail/local/.fred does exist.
Permissions are:
$ ll -d .fred
drwx--. 5 jonrysh jonrysh 4096 Jul  6 12:07 .fred/

  What is the output of the
 command 
   ls -la ~/.local/share/evolution/mail/local/
$ ls -la ~/.local/share/evolution/mail/local/ | head -20
total 302276
drwx--. 127 jonrysh jonrysh 20480 Jul 12 22:21 .
drwx--.  11 jonrysh jonrysh  4096 Jul  6 11:55 ..
-rw-rw-r--.   1 jonrysh jonrysh 7 Jul 12 20:40 
..#evolution.Junk.cmeta
-rw-rw-r--.   1 jonrysh jonrysh13 Jul 12 22:21 ..cmeta
-rw---.   1 jonrysh jonrysh   8080384 Jul 12 10:42 ..ibex.index
-rw---.   1 jonrysh jonrysh  17086516 Jul 12 10:42 ..ibex.index.data
-rw-rw-r--.   1 jonrysh jonrysh 9 Jul  6 11:55 ..maildir++
drwx--.   5 jonrysh jonrysh  4096 Jul  6 12:06 .Drafts
-rw-rw-r--.   1 jonrysh jonrysh13 Jul 12 21:55 .Drafts.cmeta
-rw---.   1 jonrysh jonrysh 17408 Jul 12 20:40 
.Drafts.ibex.index
-rw---.   1 jonrysh jonrysh  8288 Jul 12 20:40 
.Drafts.ibex.index.data
drwx--.   5 jonrysh jonrysh  4096 Jul  6 12:09 .Outbox
-rw-rw-r--.   1 jonrysh jonrysh13 Jul 12 20:40 .Outbox.cmeta
-rw---.   1 jonrysh jonrysh  7168 Jul  6 15:09 
.Outbox.ibex.index
-rw---.   1 jonrysh jonrysh 8 Jul  6 15:10 
.Outbox.ibex.index.data
drwx--.   5 jonrysh jonrysh  4096 Jul  6 12:09 .Sent
-rw-rw-r--.   1 jonrysh jonrysh13 Jul 12 22:16 .Sent.cmeta
-rw---.   1 jonrysh jonrysh771072 Jul 12 21:47 .Sent.ibex.index
-rw---.   1 jonrysh jonrysh   1040308 Jul 12 21:47 
.Sent.ibex.index.data

 What sort of filesystem is your home directory on?
ext3

The datastructures are becoming clear.  It seems that each folder (say
fred) is matched by files and a directory in .../evolution/mail/local of
the form:
$ lf .fred*
.fred.cmeta  .fred.ibex.index  .fred.ibex.index.data

.fred:
cur/  new/  tmp/
with the files forming an index into the messages, which are stored
in .mackay/cur .  I hadn't thought to do an ls -A on .local, and so
didn't see any of these files.  (Why are these named .fred, etc rather
than fred?)  Also, what is the function of the visible files:
$ lf local
cur/  folders.db  new/  tmp/
that is to say, what kind of messages are stored in .../mail/local/cur ?

  The folder mackay was converted from the 2.26.x version to the 3.0.x 
  version.
  
  While moving a message from mail folder Sent to mail folder mackay, this
  message appeared in a red error panel:
  Error while Moving messages to
  'maildir:/home/jonrysh/.local/share/evolution/mail/local#mackay
  Cannot transfer message to destination folder: No such file or
  directory
 
 That doesn't look like a valid path, it should end in mail/local/.mackay

I would think so too.  But the message was cut from the error box and
pasted into my posting.  This problem has also gone away after *copying*
a message into the folder mackay.

 The bottom line is that all the things you are talking about work fine
 for everyone else.  One possibility is that you have corrupted binaries
 somewhere - you can test this by creating a new Linux account and
 setting up evolution on that - you don't need to connect it to a server
 or download any mail or convert anything.  You should be able to do the
 operations you are talking about (like create folders etc.) without any
 problems on the pristine 

Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-13 Thread Pete Biggs

   
   I created the folder fred.  It appeared to be created in local only; 
   nothing
   showed up in local_mbox, though it did show up in evolution's folder list.
  
  Why would you expect it to be in local_mbox?  local_mbox is a copy of
  the old, unconverted local files from before the initial conversion.
  It's not used for anything.
 
 Thanks for the info.  The info It's not used for anything. is
 extremely interesting, and not clear from the documentation or earlier
 postings on this thread to the list.  I suppose now I can delete it, or
 at least its contents.

The problem probably stems from the aborted initial conversion - after
the conversion completes correctly you should be presented with a
dialogue box that tells you about local_mbox.


 
  What sort of filesystem is your home directory on?
 ext3
 

The permissions all look fine - the reason I ask about the filesystem is
that I've seen issues where people try to use an NFS mounted filesystem
as their $HOME and locking becomes a major issue.  You should also see
the mess when someone was using an SMB filesystem as their home.


 The datastructures are becoming clear.  It seems that each folder (say
 fred) is matched by files and a directory in .../evolution/mail/local of
 the form:
 $ lf .fred*
 .fred.cmeta  .fred.ibex.index  .fred.ibex.index.data
 
 .fred:
 cur/  new/  tmp/
 with the files forming an index into the messages, which are stored
 in .mackay/cur .  I hadn't thought to do an ls -A on .local, and so
 didn't see any of these files.  (Why are these named .fred, etc rather
 than fred?)

Because that's the Maildir standard - or rather in this case Maildir++

   Also, what is the function of the visible files:
 $ lf local
 cur/  folders.db  new/  tmp/
 that is to say, what kind of messages are stored in .../mail/local/cur ?

Again that's the Maildir standard - received messages are initially put
in tmp, then when the whole of the message is written, they are moved to
new.  When an MUA reads the message it is moved to cur.  This storage
method is to ensure the integrity of the message during various
operations.

The other files you see are Evolution specific and contain indexes and
meta data to speed up searches.

There is information out there on the net about Maildir - I would
suggest wikipedia, but the article about Maildir is not brilliant!

P.


___
evolution-list mailing list
evolution-list@gnome.org
To change your list options or unsubscribe, visit ...
http://mail.gnome.org/mailman/listinfo/evolution-list


Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-08 Thread Pete Biggs

 
 I created the folder fred.  It appeared to be created in local only; nothing
 showed up in local_mbox, though it did show up in evolution's folder list.

Why would you expect it to be in local_mbox?  local_mbox is a copy of
the old, unconverted local files from before the initial conversion.
It's not used for anything.

 
 While deleting the mail folder fred, this message appeared in a red error
 panel:
 Error while Storing folder 'fred'.
 Cannot open maildir directory path:
 /home/jonrysh/.local/share/evolution/mail/local/.fred: No such file or
 directory

After you created the folder within Evolution under local, does the
directory ~/.local/share/evolution/mail/local/.fred exist?  What are its
permissions and ownership?  What are the permissions on the directory
~/.local/share/evolution/mail/local ?  What is the output of the
command 

  ls -la ~/.local/share/evolution/mail/local/

What sort of filesystem is your home directory on?

 
 The folder mackay was converted from the 2.26.x version to the 3.0.x version.
 
 While moving a message from mail folder Sent to mail folder mackay, this
 message appeared in a red error panel:
 Error while Moving messages to
 'maildir:/home/jonrysh/.local/share/evolution/mail/local#mackay
 Cannot transfer message to destination folder: No such file or
 directory

That doesn't look like a valid path, it should end in mail/local/.mackay

The bottom line is that all the things you are talking about work fine
for everyone else.  One possibility is that you have corrupted binaries
somewhere - you can test this by creating a new Linux account and
setting up evolution on that - you don't need to connect it to a server
or download any mail or convert anything.  You should be able to do the
operations you are talking about (like create folders etc.) without any
problems on the pristine evolution.  If you can't, then there is
something seriously borked with your system.

P.


___
evolution-list mailing list
evolution-list@gnome.org
To change your list options or unsubscribe, visit ...
http://mail.gnome.org/mailman/listinfo/evolution-list


Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-07 Thread Jonathan Ryshpan
On Wed, 2011-07-06 at 00:52 -0700, Jonathan Ryshpan wrote:
 I have reinitialized Evolution starting with a backup that I made before
 upgrading Fedora.  The problem continues, and seem to have nothing to do with
 the crash that happened when Evolution initialized itself the first time
 (reported in comment 3).

The situation is rather worse than I had thought.  I've submitted a long
comment to bug 653957
https://bugzilla.gnome.org/show_bug.cgi?id=653957
A summary of the problems follows; there's more info in the comment to
the bug report.

I created the folder fred.  It appeared to be created in local only; nothing
showed up in local_mbox, though it did show up in evolution's folder list.

While deleting the mail folder fred, this message appeared in a red error
panel:
Error while Storing folder 'fred'.
Cannot open maildir directory path:
/home/jonrysh/.local/share/evolution/mail/local/.fred: No such file or
directory
The mail folder was deleted.


The folder mackay was converted from the 2.26.x version to the 3.0.x version.

While moving a message from mail folder Sent to mail folder mackay, this
message appeared in a red error panel:
Error while Moving messages to
'maildir:/home/jonrysh/.local/share/evolution/mail/local#mackay
Cannot transfer message to destination folder: No such file or
directory
The message was not moved.


If messages are copied from a newly created folder (not converted), to an old
(converted) folder, the Sender: field is lost.  That is, the Sender field
appears as blank when the message is displayed.


If there is a filter on outgoing mail which requires a message to be refiled
into a converted folder, evolution crashes.  (The original crash report is an
example of this.)  However if the folder is newly created (not converted) the
sending process hangs, and the message is never sent.



___
evolution-list mailing list
evolution-list@gnome.org
To change your list options or unsubscribe, visit ...
http://mail.gnome.org/mailman/listinfo/evolution-list


Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-05 Thread Patrick O'Callaghan
On Tue, 2011-07-05 at 08:58 -0700, Jonathan Ryshpan wrote:
 I have just upgraded from Fedora-13 to Fedora-15, which uses a maildir
 format rather than the mbox format previously used.

Yet again: telling people the version of the OS is not helpful. You need
to mention the version of Evolution. Since I also use Fedora, I happen
to know that it's 3.0.x, but not everyone on the list will know that.

 Evolution crashed
 in the conversion process, leaving me in a mixed state with a few of the
 maildir folders, which are (I think) in 
 ~/.local/share/evolution/mail/local/cur
 and most of the remaining data structure in mbox form in various files in
 ~/.local/share/evolution/mail/local_mbox

Did it say anything when it crashed? Is there anything
in /var/log/messages? Did abrt intervene (since this is Fedora)?

 Since I've been using evolution about 4 days since the upgrade, some of
 my messages are in one format, and some in the other, and some in both. 
 
 Also, Evolution now crashes whenever it has to file a message I have
 sent in a folder other than Sent, probably because there is no folder
 available of the right kind.

A bug in the version of Evo 3 distributed with Fedora 15 (now corrected
in updates) means you have to explicitly select your Sent, Drafts etc.
folders the first time. However the symptom is not a crash but an error
message. Which is it?

You can import mbox files into Evo, so that might be a way of unifying
your mailboxes.

poc

___
evolution-list mailing list
evolution-list@gnome.org
To change your list options or unsubscribe, visit ...
http://mail.gnome.org/mailman/listinfo/evolution-list


Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-05 Thread Patrick O'Callaghan
On Tue, 2011-07-05 at 10:29 -0700, Jonathan Ryshpan wrote:
[...]
 Do you know the version of the buggy system, the version of the
 corrected one? (8-).

No, but if you already ran Evo it doesn't matter as it won't try to
convert again. Just go to the account info under Preferences, select
Defaults and point to the Sent and Draft folders. That should be enough.

  You can import mbox files into Evo, so that might be a way of unifying
  your mailboxes.
 
 How can I avoid duplicate instances of the same message?

There's supposed to be a Detect Duplicates plugin somewhere, though it
doesn't seem to be in the default Fedora install.

poc

___
evolution-list mailing list
evolution-list@gnome.org
To change your list options or unsubscribe, visit ...
http://mail.gnome.org/mailman/listinfo/evolution-list


Re: [Evolution] Conversion failure, Datastructure mess, Crashes

2011-07-05 Thread Matthew Barnes
On Tue, 2011-07-05 at 15:17 -0430, Patrick O'Callaghan wrote: 
 There's supposed to be a Detect Duplicates plugin somewhere, though it
 doesn't seem to be in the default Fedora install.

It's built in now as of 3.0.

Message - Remove Duplicate Messages

However it's very conservative in what it considers a duplicate.  It
uses both the Message-ID and a SHA-256 checksum of the entire message to
check for equality.  Sometimes messages that appear to be duplicates in
the message list actually aren't.

___
evolution-list mailing list
evolution-list@gnome.org
To change your list options or unsubscribe, visit ...
http://mail.gnome.org/mailman/listinfo/evolution-list