Re: cyrus.index file

2011-11-11 Thread Nic Bernstein
Bron,
Thanks so much for these tools.  Is there anything interesting in 
CacheFile.pm or HeaderFile.pm which you could share, or is that all 
Fastmail specific?

One assumes that the ME::User and ME::Machine stuff is all Fastmail-centric.

Anyhow, thanks for sharing.  These already solved some problems for us.

Cheers,
 -nic

On 11/07/2011 10:29 AM, Bron Gondwana wrote:
 The attached bits of perl can read most of the more modern cyrus.index
 file formats (I haven't backported to version 6 from 2.2.x).  Some perl
 skill required to make it all work though - and you may need to strip
 out the dependencies on FastMail specific stuff.
-- 
Nic Bernstein n...@onlight.com
Onlight, Inc. www.onlight.com
219 N. Milwaukee St., Suite 2av. 414.272.4477
Milwaukee, Wisconsin  53202


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: cyrus.index file

2011-11-11 Thread Bron Gondwana
Oh, sorry - nothing that exciting.  Here they are, plus some other old rubbish
like my Perl 'sync_client' implementation for 2.3 series replication.

I really should write one that can do 2.4 replication!

Bron.

On Friday, November 11, 2011 8:22 AM, Nic Bernstein n...@onlight.com wrote:
 Bron,
 Thanks so much for these tools.  Is there anything interesting in 
 CacheFile.pm or HeaderFile.pm which you could share, or is that all 
 Fastmail specific?
 
 One assumes that the ME::User and ME::Machine stuff is all Fastmail-centric.
 
 Anyhow, thanks for sharing.  These already solved some problems for us.
 
 Cheers,
  -nic
 
 On 11/07/2011 10:29 AM, Bron Gondwana wrote:
  The attached bits of perl can read most of the more modern cyrus.index
  file formats (I haven't backported to version 6 from 2.2.x).  Some perl
  skill required to make it all work though - and you may need to strip
  out the dependencies on FastMail specific stuff.
 -- 
 Nic Bernstein n...@onlight.com
 Onlight, Inc. www.onlight.com
 219 N. Milwaukee St., Suite 2av. 414.272.4477
 Milwaukee, Wisconsin  53202
 
 
-- 
  Bron Gondwana
  br...@fastmail.fm



HeaderFile.pm
Description: Perl program


CacheFile.pm
Description: Perl program


Skiplist.pm
Description: Perl program


SyncClient.pm
Description: Perl program

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: cyrus.index file

2011-11-09 Thread Ian Eiloart

On 7 Nov 2011, at 14:23, Adrian Kovacs wrote:

 hi
 
 how can I check if a user deleted a mail ?
 Is there is history somewhere?
 How can I read the cyrus.index file?

If the message isn't in the mailbox, presumably it's been deleted. You can work 
out the file name from the delivery time. Delivery is logged. Files are named 
sequentially, by number. 

If your backup system made a backup of the file, then you can verify by 
restoring the backup. Otherwise, you're relying on delivery logs.

On our system, /var/log/mail logs the following, all with timestamps of course:
message deliveries: with message id, and mailbox.
logins: username.
Expunges: mailbox, number of messages expunged.

So, if the message was delivered, and you can tie up the message id with your 
smtp logs, and then you can see that the user logged in and expunged the 
mailbox, and the message isn't there, that should be pretty good evidence.



 We are using cyrus  postfix, and would like to check if a user deleted a 
 certain mail
 
 thanks
 
 a
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

-- 
Ian Eiloart
Postmaster, University of Sussex
+44 (0) 1273 87-3148


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


cyrus.index file

2011-11-07 Thread Adrian Kovacs
hi

how can I check if a user deleted a mail ?
Is there is history somewhere?
How can I read the cyrus.index file?

We are using cyrus  postfix, and would like to check if a user deleted a
certain mail

thanks

a

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: cyrus.index file

2011-11-07 Thread Adam Tauno Williams
Quoting Adrian Kovacs adrian...@gmail.com:
 how can I check if a user deleted a mail ?
 Is there is history somewhere?

If you are using delayed expunge [*HIGHLY* recommended] then this is  
pretty trivial.  Otherwise I think deleted/expunged is just gone.

 How can I read the cyrus.index file?

cyr_dbtool is one option.  Other you can use cvt_cyrusdb to dump a  
database to a text file.

  cvt_cyrusdb  [ -C config-file ] old-file old-format new-file  
new-format

 We are using cyrus  postfix, and would like to check if a user deleted a
 certain mail

You might have something in your log file(s).  But logging an  
individual deletion seems unlikely.


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: cyrus.index file

2011-11-07 Thread Adrian Kovacs
many thanks for the quick answer, I check it

~
a

On Mon, Nov 7, 2011 at 3:30 PM, Adam Tauno Williams
awill...@whitemice.orgwrote:

 Quoting Adrian Kovacs adrian...@gmail.com:
  how can I check if a user deleted a mail ?
  Is there is history somewhere?

 If you are using delayed expunge [*HIGHLY* recommended] then this is
 pretty trivial.  Otherwise I think deleted/expunged is just gone.

  How can I read the cyrus.index file?

 cyr_dbtool is one option.  Other you can use cvt_cyrusdb to dump a
 database to a text file.

  cvt_cyrusdb  [ -C config-file ] old-file old-format new-file
 new-format

  We are using cyrus  postfix, and would like to check if a user deleted a
  certain mail

 You might have something in your log file(s).  But logging an
 individual deletion seems unlikely.

 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: cyrus.index file

2011-11-07 Thread Joseph Brennan

 how can I check if a user deleted a mail ?
 Is there is history somewhere?
 How can I read the cyrus.index file?


If it's not expunged, only marked deleted, give your account lrs on
the mailbox temporarily and open it with a client. I find that a
very usable way to read the cyrus.index :-)

If it's expunged, if you use delayed expunge and it was expunged
within the delay period, unexpunge -l user.xxx will show it.

If neither, you might be able to make a guess based on the known
delivery time (from postfix logs) and timestamps on the message
files on the file system. E.g. postfix says it was delivered at
Nov 1 10:25, and you have in the mailbox message 4566. at 10:10,
no message 4567., and message 4568. at 10:30... conclusion, it
was there and was deleted and expunged.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: cyrus.index file

2011-11-07 Thread Bron Gondwana


On Monday, November 07, 2011 9:30 AM, Adam Tauno Williams 
awill...@whitemice.org wrote:
 Quoting Adrian Kovacs adrian...@gmail.com:
  how can I check if a user deleted a mail ?
  Is there is history somewhere?
 
 If you are using delayed expunge [*HIGHLY* recommended] then this is  
 pretty trivial.  Otherwise I think deleted/expunged is just gone.
 
  How can I read the cyrus.index file?
 
 cyr_dbtool is one option.  Other you can use cvt_cyrusdb to dump a  
 database to a text file.
 
   cvt_cyrusdb  [ -C config-file ] old-file old-format new-file  
 new-format

Neither of them are any use with cyrus.index, which is its own custom format.

The attached bits of perl can read most of the more modern cyrus.index
file formats (I haven't backported to version 6 from 2.2.x).  Some perl
skill required to make it all work though - and you may need to strip
out the dependencies on FastMail specific stuff.

  We are using cyrus  postfix, and would like to check if a user deleted a
  certain mail
 
 You might have something in your log file(s).  But logging an  
 individual deletion seems unlikely.

If you turn on auditlog, you'll get all expunges as individual log items.

Bron.
-- 
  Bron Gondwana
  br...@fastmail.fm



IndexFile.pm
Description: Binary data


index_uids.pl
Description: Binary data

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: cyrus.index file

2011-11-07 Thread Wolfgang Breyha
Eric Luyten wrote, on 07.11.2011 17:36:
 and ... busy servers will probably produce huge audit trace files ... Who
 is running production service with auditlog: 1 in their imapd.conf ?

I am. I patched cyrus 2.4 to get similar logs in custom format and use
auditlog since 2.4 for all our 100k users. No problem at all. On the other
hand not knowing which way a mail took until it was deleted by the user is not
an option.

Greetings, Wolfgang
-- 
Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/
Vienna University Computer Center | Austria


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/