[SOGo] BTS activities for Tuesday, August 11 2020
Title: BTS activities for Tuesday, August 11 2020 BTS Activities Home page: https://sogo.nu/bugs Project: SOGo For the period covering: Tuesday, August 11 2020 idlast updatestatus (resolution)categorysummary 5124 2020-08-11 15:40:39 updated (open) Packaging (Debian) Unable to install SOGo on Ubuntu 20.04.1 5119 2020-08-11 07:09:19 updated (open) Web Mail display errors in To/From/CC fields when display name contains umlaut + comma (MISSING_DOMAIN / unspecified domain,...) 5123 2020-08-11 06:05:55 updated (open) Web Mail error in encoding "arabic" when received message from outlook 5078 2020-08-11 21:01:20 assigned (reopened) Backend Mail Does the latest nightly build support STARTTLS and SSL for SMTP service? 5074 2020-08-11 11:24:16 closed (not a bug) Packaging (RedHat) Failed to start sogo service -- users@sogo.nuhttps://inverse.ca/sogo/lists
[SOGo] Duplicated inbox appeared on folder list
Hello, I have a SOGo 4.2.0 installion and one of my users reports that a new Inbox folder appeared in the folder list on the web interface. By clicking on it shows the content of the real inbox. I have checked the IMAP server, there is no other inbox folder in maildir, checked the dovecot files, but nothing shows any suspicious. No references, no symlinks. Also checked disk usage, no duplicates found. Searching the database in profileurl view shows normal. What can cause such a "ghost" folder? Where can I start search for any clues in this case? Thank you for your help! Regards, Peter -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Sogo scalability
Hello Christian, On 11/08/2020 13:55, Christian Mack (christian.m...@uni-konstanz.de) has written: Hello First, most of your questions are not SOGo related, but IMAP and database server related. That said, let's start :-) You can optimize your setup for either speed, high availability or easy setup. As you seem to go for redundancy and/or speed, you should split up your setup into loadbalancer, SOGo + reverse Proxy, database and IMAP/SMTP server. Ouch, yes, I forgot to write that we are changing the webmail and collaboration suite only. So, we are evaluating a new webmail because our older one (Open-Xchange) become too expensive. So I expect to don't touch other setup about IMAP, SMTP and LDAP. They are already working as well. In particular we use LDAP for authentication and we use a kind of sharding of mailboxes over IMAP servers. About this aspect I appreciate SOGo, which let me to define the IMAP server through an LDAP attribute (such as mailHost). So I can choose a different IMAP server for every account! This is not really true, I have to grant the IMAP sharing among the mailboxes. But the idea is working, we separate accounts and disks over multiple IMAP hosts. [...] IMAP sessions are bound to one connection. As long as the connection exists, the session can survive. One connection can provide multiple sessions. There can be multiple connections at the same time. Therefore it is irrelevant which server a session connects, as long as the server doesn't die and all servers have the same content. Ok, If I well understand a set of equally configured (cloned) virtual machines for SOGo could be a good solution. Database: Independent to SOGo, can be reused for multiple services. SOGo only stores authentication information, settings, address books and calendars in database. Those are tiny compared to emails. For 25,000 users only, no database will get into a sweat. They usually are made for datasets in the hundreds of millions. If you need high redundancy, you can even use a cluster setup, but they are hard to do right and expensive. This sounds very good. SOGo: How many accounts one SOGo server can serve, depends on the usage. Example: We have split our servers like outlined at the start of this message. We have ~20,000 accounts and provide no ActiveSync. There are roughly 120 parallel, active SOGo sessions per minute in high usage times. Active SOGo session means, that the user clicked at least one time in that minute or accessed any information via DAV. This is served by an 16 core 32 GB RAM 200 GB SSD/HD VM. RAM is the most limiting factor here. Especially for large emails and folders with a lot of emails we had to increase max Limit of RAM per worker SxVMemLimit to 512. Else we had seen a lot of respawned workers after one access. We have 350 workers running. If you want to use multiple SOGo servers (as you are planning for dedicated ActiveSync and web + DAV), you have to use one shared memcached server. You also have to use one shared NFS or cifs server for email composition and encoding storage (SOGoMailSpoolPath + NGMimeBuildMimeTempDirectory). If you don't use those, you will have diverse problems when creating emails or change settings and content. Thank you for these very useful details. On our current Open-Xchange we see about 400 parallel sessions as maximum. These are equally likely distributed over IMAP and over Active Sync. Using balanced solution, I wonder if it is better to separate sogod for EAS and sogod processes for IMAP on the same host (as described in documentation FAQ), or if it is better to provide different separated hosts for EAS. Ie, balanced hosts for IMAP and separated balanced hosts for EAS. The shared Memcache server is another task where I have to define an appropriate resources of RAM. Thank you very much for these hints. Cheers Marco Hope that helps a bit. Kind regards, Christian Mack Am 06.08.20 um 15:20 schrieb Marco (fa...@ruparpiemonte.it): Hello, I read that SOGo can manage at least 25000 mailboxes and more. But I don't understand how to setup the hosts through an high availability balancer. At the moment I have about 2 mailboxes accessed through IMAP. Many mailboxes are large (over 10GB) and very intensively accessed. They are highly accessed through ActiveSynch too, so I'll setup a separate installation for this protocol, as suggested on SOGo site. I wonder how many mailboxes can manage a single SOGo host. I would like to know if an IMAP session must stay on a single host, or if it can land on a random balanced host. For instance, I remember that Horde can have multiple hosts equally configured with the same DB (in particular one session table). So it's not important what balanced host a client contacts: even in the same IMAP session the host can change. I would like to know if you have some hints or best practices how to configure SOGo in a large environment. For instance, a typical resource
Re: [SOGo] Change password functionality
Hello Am 11.08.20 um 12:05 schrieb Jérémy Carnus (jer...@carnus.me): > > I am writing on the mailing list for a simple question that I am not > able to find any topic / documentation > > I have a Sogo installed using a database backend for authentification > (that database being used by dovecot for the authentication also), does > Sogo offers a way for the user to change its password and Sogo will > update the database table ? > Yes, check documentation https://sogo.nu/files/docs/SOGoInstallationGuide.html for configuration options: SOGoPasswordChangeEnabled userPasswordAlgorithm prependPasswordScheme keyPath Kind regards, Christian Mack -- Christian Mack Universität Konstanz Kommunikations-, Informations-, Medienzentrum (KIM) Abteilung IT-Dienste Forschung und Lehre 78457 Konstanz +49 7531 88-4416 smime.p7s Description: S/MIME Cryptographic Signature
Re: [SOGo] Sogo scalability
Hello First, most of your questions are not SOGo related, but IMAP and database server related. That said, let's start :-) You can optimize your setup for either speed, high availability or easy setup. As you seem to go for redundancy and/or speed, you should split up your setup into loadbalancer, SOGo + reverse Proxy, database and IMAP/SMTP server. IMAP: This is independent from SOGo. SOGo is only one other IMAP client like any other. There are different IMAP setups, depending on your needs and available infrastructure. You can have single hardware machines with local SSDs. Those are fast and have really low latencies. But the max storage they can handle is limited to less than 100 TB right now and can get really costly. You can have hardware or VM machines connected with a SAN or NAS for Storage, preferable with local SSD cache. They are slower, but can provide a lot of storage up to PB range for each machine. Last option is to use a shared storage via NFS. With that you have all servers connecting the same storage, but you have to ensure, that only one server is trying to access the same mailbox for writing, which usually means locking. This will slow down your access considerably. Also see caching below. In order to overcome the storage limitation of IMAP servers with local SSD storage, you can use a technique called "sharding". With that you propagate your users across different machines. That means, you can access emails of one user only on one machine, not others. In order to know which user is located on which machine, you need an IMAP proxy/balancer, which has that information either by using a hash or some info stored in authentication source. Beware: If you use "sharding" and sharing of folders between mailboxes, you need a proxy/balancer capable of serving different sources/mailboxes to one authenticated user. Check dovecot-director as example for such a proxy/balancer. In order to get redundancy, you usually synchronize your mailboxes to at least one other machine. Beware, this always comes with a time delay. And there is something called caching, which will store new content in RAM first, then from time to time get it to disk. Because of that you can lose emails, when synchronizing files on disk only. In dovecot you have a built-in IMAP synchronization mechanism, which will synchronize all IMAP transactions to one other machine. This prevents the caching problem. You can set up both machines synchronizing to each other. With that you would have 2 machines providing one mailbox in active-active mode. IMAP sessions are bound to one connection. As long as the connection exists, the session can survive. One connection can provide multiple sessions. There can be multiple connections at the same time. Therefore it is irrelevant which server a session connects, as long as the server doesn't die and all servers have the same content. Database: Independent to SOGo, can be reused for multiple services. SOGo only stores authentication information, settings, address books and calendars in database. Those are tiny compared to emails. For 25,000 users only, no database will get into a sweat. They usually are made for datasets in the hundreds of millions. If you need high redundancy, you can even use a cluster setup, but they are hard to do right and expensive. If you want best speed for authentication, or need integration in some existing Identity Management system, you should use an LDAP/AD in addition. They are made to do authentication. SOGo: How many accounts one SOGo server can serve, depends on the usage. Example: We have split our servers like outlined at the start of this message. We have ~20,000 accounts and provide no ActiveSync. There are roughly 120 parallel, active SOGo sessions per minute in high usage times. Active SOGo session means, that the user clicked at least one time in that minute or accessed any information via DAV. This is served by an 16 core 32 GB RAM 200 GB SSD/HD VM. RAM is the most limiting factor here. Especially for large emails and folders with a lot of emails we had to increase max Limit of RAM per worker SxVMemLimit to 512. Else we had seen a lot of respawned workers after one access. We have 350 workers running. If you want to use multiple SOGo servers (as you are planning for dedicated ActiveSync and web + DAV), you have to use one shared memcached server. You also have to use one shared NFS or cifs server for email composition and encoding storage (SOGoMailSpoolPath + NGMimeBuildMimeTempDirectory). If you don't use those, you will have diverse problems when creating emails or change settings and content. Hope that helps a bit. Kind regards, Christian Mack Am 06.08.20 um 15:20 schrieb Marco (fa...@ruparpiemonte.it): > Hello, > > I read that SOGo can manage at least 25000 mailboxes and more. But I > don't understand how to setup the hosts through an high availability > balancer. > > At the moment I have about 2 mailboxes accessed through IMAP.
[SOGo] Change password functionality
Hi I am writing on the mailing list for a simple question that I am not able to find any topic / documentation I have a Sogo installed using a database backend for authentification (that database being used by dovecot for the authentication also), does Sogo offers a way for the user to change its password and Sogo will update the database table ? Thanks -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGO Clalenders
So obvious thank you William Bowden | JMRIT Consultants Consultant Engineer m:07525 645105 | e:will...@jmrit.co.uk On 11 Aug 2020, 11:01 +0100, Christian Mack , wrote: > Hello > > As you use ActiveSync for synchronization, check if those other > calendars are enabled for ActiveSync synchronization in your SOGo web > frontend. > Click on three dots after calendar name -> "Properties", select Option > "Synchronize (Microsoft Enterprise ActiveSync)". > Then "SAVE" those properties. > > > Kind regards, > Christian Mack > > Am 11.08.20 um 11:47 schrieb William Bowden (will...@jmrit.co.uk): > > I wish it was in screenshot attached it is the Andrew one > > > > William Bowden | JMRIT Consultants > > Consultant Engineer > > > > m:07525 645105 | e:will...@jmrit.co.uk > > On 11 Aug 2020, 09:50 +0100, Götz Reinicke , wrote: > > > Check the calendar setting on the iPhone; may be the view is just > > > disabled for other calendars? > > > > > > /Götz > > > > > > > Am 10.08.2020 um 16:59 schrieb William Bowden (will...@jmrit.co.uk) > > > > : > > > > > > > > Hi > > > > I have a client running the latest SOGO on the web interface they have > > > > all their calendars on there client software Apple Calendar they > > > > See all their calendars but on iPhone just the personal one > > > > Any ideas > > > > Also used Exchange to install it on phone > > > > > > > > > > -- > Christian Mack > Universität Konstanz > Kommunikations-, Informations-, Medienzentrum (KIM) > Abteilung IT-Dienste Forschung und Lehre > 78457 Konstanz > +49 7531 88-4416 > -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGO Clalenders
Hello As you use ActiveSync for synchronization, check if those other calendars are enabled for ActiveSync synchronization in your SOGo web frontend. Click on three dots after calendar name -> "Properties", select Option "Synchronize (Microsoft Enterprise ActiveSync)". Then "SAVE" those properties. Kind regards, Christian Mack Am 11.08.20 um 11:47 schrieb William Bowden (will...@jmrit.co.uk): > I wish it was in screenshot attached it is the Andrew one > > William Bowden | JMRIT Consultants > Consultant Engineer > > m:07525 645105 | e:will...@jmrit.co.uk > On 11 Aug 2020, 09:50 +0100, Götz Reinicke , wrote: >> Check the calendar setting on the iPhone; may be the view is just disabled >> for other calendars? >> >> /Götz >> >>> Am 10.08.2020 um 16:59 schrieb William Bowden (will...@jmrit.co.uk) >>> : >>> >>> Hi >>> I have a client running the latest SOGO on the web interface they have all >>> their calendars on there client software Apple Calendar they >>> See all their calendars but on iPhone just the personal one >>> Any ideas >>> Also used Exchange to install it on phone >>> >> -- Christian Mack Universität Konstanz Kommunikations-, Informations-, Medienzentrum (KIM) Abteilung IT-Dienste Forschung und Lehre 78457 Konstanz +49 7531 88-4416 smime.p7s Description: S/MIME Cryptographic Signature
Re: [SOGo] SOGO Clalenders
I wish it was in screenshot attached it is the Andrew one William Bowden | JMRIT Consultants Consultant Engineer m:07525 645105 | e:will...@jmrit.co.uk On 11 Aug 2020, 09:50 +0100, Götz Reinicke , wrote: > Check the calendar setting on the iPhone; may be the view is just disabled > for other calendars? > > /Götz > > > Am 10.08.2020 um 16:59 schrieb William Bowden (will...@jmrit.co.uk) > > : > > > > Hi > > I have a client running the latest SOGO on the web interface they have all > > their calendars on there client software Apple Calendar they > > See all their calendars but on iPhone just the personal one > > Any ideas > > Also used Exchange to install it on phone > > > -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGO Clalenders
Check the calendar setting on the iPhone; may be the view is just disabled for other calendars? /Götz > Am 10.08.2020 um 16:59 schrieb William Bowden (will...@jmrit.co.uk) > : > > Hi > I have a client running the latest SOGO on the web interface they have all > their calendars on there client software Apple Calendar they > See all their calendars but on iPhone just the personal one > Any ideas > Also used Exchange to install it on phone > smime.p7s Description: S/MIME cryptographic signature
