Re: [Dovecot] Dovecot: pipe() failed: Too many open files
Thanks for the input Jack. As I am using debian, the location to edit the ulimit is /etc/default/dovecot. There is no effect even after changing this value. I tried putting the value in the /etc/init.d/dovecot script without success. Fasil. On 10/18/2012 05:13 AM, Jack Bates wrote: I'm using RHEL6 instead of ubuntu, but check the startup scripts. In RHEL's case, the following file is sourced, so I updated it instead of the startup scripts. cat /etc/sysconfig/dovecot # Here you can specify your dovecot command line options. # #OPTIONS="" ulimit -n 4096 ulimit -u 5120 In addition, I had to also up the max allowed processes in the dovecot config. 2.x and 1.x are different on this. http://wiki1.dovecot.org/LoginProcess <-1.x method Jack On 10/17/2012 6:16 PM, Fasil wrote: Thanks Frank. Followed the URL and could not find any luck. Is there a way to change the value of 'max open files' of dovecot. I have tried to set the value in /etc/default/dovecot by setting ulimit. But the value is not getting applied. Could anyone help on this regard. Fasil. On 08/16/2012 09:17 AM, Frank Bonnet wrote: hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoyé de mon iPhone. Le 16 août 2012 à 02:52, Fasil a écrit : Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files1024 1024 files Please advice how to get rid off this. Fasil.
Re: [Dovecot] Dovecot: pipe() failed: Too many open files
I'm using RHEL6 instead of ubuntu, but check the startup scripts. In RHEL's case, the following file is sourced, so I updated it instead of the startup scripts. cat /etc/sysconfig/dovecot # Here you can specify your dovecot command line options. # #OPTIONS="" ulimit -n 4096 ulimit -u 5120 In addition, I had to also up the max allowed processes in the dovecot config. 2.x and 1.x are different on this. http://wiki1.dovecot.org/LoginProcess <-1.x method Jack On 10/17/2012 6:16 PM, Fasil wrote: Thanks Frank. Followed the URL and could not find any luck. Is there a way to change the value of 'max open files' of dovecot. I have tried to set the value in /etc/default/dovecot by setting ulimit. But the value is not getting applied. Could anyone help on this regard. Fasil. On 08/16/2012 09:17 AM, Frank Bonnet wrote: hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoyé de mon iPhone. Le 16 août 2012 à 02:52, Fasil a écrit : Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files1024 1024 files Please advice how to get rid off this. Fasil.
Re: [Dovecot] Dovecot: pipe() failed: Too many open files
Thanks Frank. Followed the URL and could not find any luck. Is there a way to change the value of 'max open files' of dovecot. I have tried to set the value in /etc/default/dovecot by setting ulimit. But the value is not getting applied. Could anyone help on this regard. Fasil. On 08/16/2012 09:17 AM, Frank Bonnet wrote: hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoyé de mon iPhone. Le 16 août 2012 à 02:52, Fasil a écrit : Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files1024 1024 files Please advice how to get rid off this. Fasil.
Re: [Dovecot] Dovecot: pipe() failed: Too many open files
hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoyé de mon iPhone. Le 16 août 2012 à 02:52, Fasil a écrit : > Dear all, > > Thank you all for such a wonderful support. Hats off to all :) > > Few times I came across imap login issues where new users will not be allowed > to login. > /var/log/mail.err shows the error below > Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login > processes, slowing down for now > Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files > > I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 > > # ulimit -Hn > 1024 > > # ulimit -Sn > 1024 > > # cat /proc/sys/fs/file-max > 1238548 > > # cat /proc/`pidof dovecot`/limits | grep 'Max open' > Max open files1024 1024 files > > Please advice how to get rid off this. > > Fasil.
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On Fre, 2009-12-18 at 18:32 -0500, Charles Marcus wrote: > On 12/18/2009, JW (j...@mailsw.com) wrote: > > I'm sorry, I forgot to specify that I was using Debian Linux: > > You also forgot the bare neceesities, like dovecot version, dovecot -n > output and log entries exhibiting the problem. And for the current case looking into /proc/$(pidof dovecot)/fd should show all open fds (and $(ls -1 /proc/$(pidof dovecot)/fd | wc -l) should be somewhat near the limit). > I'm actually amazed at how many people post on support lists and say > 'Help! Its not working!! What did I do wrong?!' - do they really expect > meaningful help? > > Even more amazing, on this list Timo can often divine the answer anyway... He has probably am extremely good crystal ball;-) Bernd -- mobil: +43 664 4416156 http://bernd.petrovitsch.priv.at/ Linux Software Entwicklung, Beratung und Dienstleistungen
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On 12/18/2009, JW (j...@mailsw.com) wrote: > I'm sorry, I forgot to specify that I was using Debian Linux: You also forgot the bare neceesities, like dovecot version, dovecot -n output and log entries exhibiting the problem. I'm actually amazed at how many people post on support lists and say 'Help! Its not working!! What did I do wrong?!' - do they really expect meaningful help? Even more amazing, on this list Timo can often divine the answer anyway...
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On Dec 18, 2009, at 6:12 PM, Mario Antonio wrote: > JW wrote:You could try: > /etc/security/limits.conf > > > > your_dovecot_user soft nofile 524288 > your_dovecot_user hard nofile 524288 I think these are read by PAM when user logs in. Dovecot never uses them. I'm not sure if even setting root's limits here will affect software started by init.d scripts at system startup.
Re: [Dovecot] dovecot: pipe() failed: Too many open files
JW wrote: On Friday 18 December 2009 16:00:48 Timo Sirainen wrote: On Dec 18, 2009, at 4:47 PM, JW wrote: I've researched this problem a number of times, usually I see suggestions to increase ulimit. I've done this a number of times, all the way up to: ulimit -n 8192 I've put that in the init script right above the daemon start line. What exactly is the "daemon start line" I'm sorry, I forgot to specify that I was using Debian Linux: case "$1" in start) if grep protocols /etc/dovecot/dovecot.conf | sed 's/#.*$//' | tr -d '"' | \ egrep -q '[^#]*(\bpop3s?\b|\bimaps?\b)'; then if [ -x /usr/lib/dovecot/imap-login -a -x /usr/lib/dovecot/imap ] \ || [ -x /usr/lib/dovecot/pop3-login -a -x /usr/lib/dovecot/pop3 ]; then echo -n "Starting $DESC: $NAME" ulimit -n 8192 start-stop-daemon --start --quiet --oknodo --exec $DAEMON echo "." fi fi ;; stop) echo -n "Stopping $DESC: $NAME " start-stop-daemon --stop --quiet --oknodo --exec $DAEMON echo "." ;; ? Many Linux distros override ulimit in their internal scripts. If you're using Linux, you could check if dovecot process really has 8192 limit: cat /proc/`pidof dovecot`/limits | grep 'Max open' I've seen this suggestion on the web a few times, but there's no such directory, /proc/`pidof dovecot`/limits or /proc/*/limits for that matter pidof dovecot shows the pid for: /usr/sbin/dovecot I've tried "grep -i max" and grep -i open in the /proc/$pid/* directory for every pid of every dovecot process on the system, none of the files in there contain either word. mail:/var/log# ps auxw | grep dove root 23299 0.0 0.0 1948 648 ?Ss 00:41 0:07 /usr/sbin/dovecot root 23300 0.0 0.2 8752 2700 ?S00:41 0:05 dovecot-auth mail:/var/log# ls /proc/23299 attr cmdline cwd exe maps mounts oom_adjroot stat status wchan auxv cpuset environ fd mem mountstats oom_score smaps statm task Is there a different place I should put the ulimit? JW You could try: /etc/security/limits.conf your_dovecot_user soft nofile 524288 your_dovecot_user hard nofile 524288 Not sure if instead of your_dovecot_user, you should increase the limits for the root user ?? Regards, Mario Antonio
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On Dec 18, 2009, at 5:46 PM, JW wrote: > I'm sorry, I forgot to specify that I was using Debian Linux: > > >echo -n "Starting $DESC: $NAME" >ulimit -n 8192 >start-stop-daemon --start --quiet --oknodo --exec $DAEMON Well, this seemed to work in Debian unstable.. So maybe the problem is that something just causes Dovecot to eat all available file descriptors. When it happens again you should get the lsof output of dovecot and save it. Also you never mentioned your Dovecot version. It's possible it's already been fixed in recent versions. >> ? Many Linux distros override ulimit >> in their internal scripts. If you're using Linux, you could check if >> dovecot process really has 8192 limit: >> >> cat /proc/`pidof dovecot`/limits | grep 'Max open' > > > I've seen this suggestion on the web a few times, but there's no such > directory, /proc/`pidof dovecot`/limits or /proc/*/limits for that matter I guess you've old enough kernel that it doesn't support it.
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On Friday 18 December 2009 16:00:48 Timo Sirainen wrote: > On Dec 18, 2009, at 4:47 PM, JW wrote: > > I've researched this problem a number of times, usually I see suggestions > > to increase ulimit. > > > > I've done this a number of times, all the way up to: > > > > ulimit -n 8192 > > > > I've put that in the init script right above the daemon start line. > > What exactly is the "daemon start line" I'm sorry, I forgot to specify that I was using Debian Linux: case "$1" in start) if grep protocols /etc/dovecot/dovecot.conf | sed 's/#.*$//' | tr -d '"' | \ egrep -q '[^#]*(\bpop3s?\b|\bimaps?\b)'; then if [ -x /usr/lib/dovecot/imap-login -a -x /usr/lib/dovecot/imap ] \ || [ -x /usr/lib/dovecot/pop3-login -a -x /usr/lib/dovecot/pop3 ]; then echo -n "Starting $DESC: $NAME" ulimit -n 8192 start-stop-daemon --start --quiet --oknodo --exec $DAEMON echo "." fi fi ;; stop) echo -n "Stopping $DESC: $NAME " start-stop-daemon --stop --quiet --oknodo --exec $DAEMON echo "." ;; > ? Many Linux distros override ulimit > in their internal scripts. If you're using Linux, you could check if > dovecot process really has 8192 limit: > > cat /proc/`pidof dovecot`/limits | grep 'Max open' I've seen this suggestion on the web a few times, but there's no such directory, /proc/`pidof dovecot`/limits or /proc/*/limits for that matter pidof dovecot shows the pid for: /usr/sbin/dovecot I've tried "grep -i max" and grep -i open in the /proc/$pid/* directory for every pid of every dovecot process on the system, none of the files in there contain either word. mail:/var/log# ps auxw | grep dove root 23299 0.0 0.0 1948 648 ?Ss 00:41 0:07 /usr/sbin/dovecot root 23300 0.0 0.2 8752 2700 ?S00:41 0:05 dovecot-auth mail:/var/log# ls /proc/23299 attr cmdline cwd exe maps mounts oom_adjroot stat status wchan auxv cpuset environ fd mem mountstats oom_score smaps statm task Is there a different place I should put the ulimit? JW -- -- System Administrator - Cedar Creek Software http://www.cedarcreeksoftware.com
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On Dec 18, 2009, at 4:47 PM, JW wrote: > I've researched this problem a number of times, usually I see suggestions to > increase ulimit. > > I've done this a number of times, all the way up to: > > ulimit -n 8192 > > I've put that in the init script right above the daemon start line. What exactly is the "daemon start line"? Many Linux distros override ulimit in their internal scripts. If you're using Linux, you could check if dovecot process really has 8192 limit: cat /proc/`pidof dovecot`/limits | grep 'Max open'
Re: [Dovecot] dovecot: pipe() failed: Too many open files
* Timo Sirainen <[EMAIL PROTECTED]>: > You have too many login/auth/mail processes running and/or your ulimit > -n is too small. It was "ulimit -n" > I doubt any change in 1.0.6 or 1.0.7 itself caused this. Coincidence, I guess -- Ralf Hildebrandt ([EMAIL PROTECTED]) [EMAIL PROTECTED] Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de God does not play dice. -- Einstein
Re: [Dovecot] dovecot: pipe() failed: Too many open files
On Wed, 2007-10-31 at 13:55 +0100, Ralf Hildebrandt wrote: > I'm encountering lots of > Oct 31 11:14:25 postamt dovecot: pipe() failed: Too many open files > errors around midday ever since the latest upgrade to 1.0.7. > > The errors appear in pairs like this one: > Oct 31 11:20:01 postamt dovecot: pipe() failed: Too many open files You have too many login/auth/mail processes running and/or your ulimit -n is too small. I doubt any change in 1.0.6 or 1.0.7 itself caused this. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] dovecot: pipe() failed: Too many open files
* Ralf Hildebrandt <[EMAIL PROTECTED]>: > I'm encountering lots of > Oct 31 11:14:25 postamt dovecot: pipe() failed: Too many open files > errors around midday ever since the latest upgrade to 1.0.7. > > The errors appear in pairs like this one: > Oct 31 11:20:01 postamt dovecot: pipe() failed: Too many open files > Oct 31 11:20:01 postamt dovecot: imap-login: Internal login failure: > user=, method=PLAIN, rip=193.175.174.239, lip=141.42.4.250, TLS > > What gives? Some more details (why is that still 1.0.6 when I made a hg checkout just today?): # 1.0.6: /usr/local/etc/dovecot.conf protocols: imap imaps pop3s ssl_cert_file: /etc/ssl/certs/postamt.pem ssl_key_file: /etc/ssl/private/postamt.key disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_process_per_connection: no login_process_size: 64 login_processes_count: 16 login_max_processes_count: 256 verbose_proctitle: yes mail_location: maildir:~/Maildir mail_read_mmaped: yes fsync_disable: yes maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle netscape-eoh imap_client_workarounds(imap): outlook-idle netscape-eoh imap_client_workarounds(pop3): outlook-idle pop3_lock_session(default): no pop3_lock_session(imap): no pop3_lock_session(pop3): yes pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %v-%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: . prefix: INBOX. inbox: yes auth default: mechanisms: plain login cache_size: 64 master_user_separator: * verbose: yes passdb: driver: passwd-file args: /usr/local/etc/dovecot.masterusers pass: yes master: yes passdb: driver: shadow passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota: maildir quota: maildir:ignore=Trash quota_warning: storage=10%% /usr/local/scripts/quota-warning 90 quota_warning2: storage=5%% /usr/local/scripts/quota-warning 95 quota_warning3: storage=1%% /usr/local/scripts/quota-warning 99 -- Ralf Hildebrandt ([EMAIL PROTECTED]) [EMAIL PROTECTED] Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de | <- You must be smarter than this stick to ride the Internet
