[Dbmail-dev] [SCM]Paul's DBMail tree branch, master, updated. 3ba5a5308239c2790d278f74c8d303cecc19114d

2009-12-11 Thread Paul J Stevens
This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project Paul's DBMail tree. The branch, master has been updated via 3ba5a5308239c2790d278f74c8d303cecc19114d (commit) via

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Paul J Stevens
Michael Monnerie wrote: On Donnerstag, 10. Dezember 2009 Tomas Kuliavas wrote: DBMail might find its niche in some setups, but large mailboxes are not in that niche. 750 GB DB proves it. You can't do text search raw email sources. There is no point of storing them in DB. And you believe

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Michael Monnerie
On Freitag, 11. Dezember 2009 Josh Marshall wrote: I have found that since linux kernel 2.6 series, LVM snapshots have caused system lockups. I used it happily in the 2.4 series. That's why LVM snapshots are not used in XenServer 5.x. They also said it's unstable, especially under high load.

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Michael Monnerie
On Freitag, 11. Dezember 2009 Daniel Urstöger wrote: Well, one can also do that with a filesystem based storage, you just need something similar to the MySQL replication for flat files. DRDB for example. DRBD puts a burden on the server all the time. For a secure replication you need to

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Michael Monnerie
On Freitag, 11. Dezember 2009 Michael Monnerie wrote: LVM snapshots Another thing to remember: You can only do a snapshot of a single filesystem at a time. So if you have your DB and attachments in different volumes, snapshots are not transactions anymore. Some people may be happy to live

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Michael Monnerie
On Freitag, 11. Dezember 2009 Paul J Stevens wrote: Currently, a full body text search will do a full table scan of the mimeparts table and pull in all mimeparts part of the messages in the mailbox being searched. If we want to skip all non text/* mimeparts (as allowed by the imap rfc), we'd

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Michael Monnerie
On Freitag, 11. Dezember 2009 Tomas Kuliavas wrote: Emails are not raw text. There are at least two ways to write test in email and if you go to 8bit text, number of same text variations multiplies. SQL can't search emails stored in DB, because SQL does not know about encodings, mime

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Tomas Kuliavas
2009.12.11 13:14 Michael Monnerie rašė: On Freitag, 11. Dezember 2009 Tomas Kuliavas wrote: Emails are not raw text. There are at least two ways to write test in email and if you go to 8bit text, number of same text variations multiplies. SQL can't search emails stored in DB, because SQL

Re: [Dbmail] Optimizing Dbmail Database

2009-12-11 Thread Michael Monnerie
On Freitag, 11. Dezember 2009 Tomas Kuliavas wrote: Are you sure that syntax of your select query is correct? No, that was pseudo code to demonstrate you can search for variations within one query. how complex select call you will make in order to cover all variations? flowed format,