Well - I didn't imagine the ulimit of 1024 - Debian did. And when I do changes to reasonable system defaults, I tend to do it moderately. The high number of opened files can of course easily be seen e.g. by "lsof | grep -c /".
In this case though, the problem isn't really open files. I tried to start with ulimit = 8192 without success. Something is faulty with the connection to SNMP. I will try to figure that out later, it is not esssential to me. Regards Dirk -----Ursprüngliche Nachricht----- Von: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Gesendet: Mittwoch, 5. November 2014 08:18 An: ASSP development mailing list Betreff: Re: [Assp-test] ASSP crashes after updates - too many open files >When I raise it (1536 or 2048) ASSP still crashes, but tells me more: THERE should be NO limit for ANY ulimit setting (or MAX for ALL settings) for the user who runs ASSP EVEN 2048 for opened files is very much too less. For example: you have 7 SMTP workers (are 10 threads in sum) and ~ 1000 files in the sl-cache and all workers request all files in the sl-cache folder at the same time - this leads in to 10.000 opened files. This will not really happen - BUT having several thousands files in all folders in a project, which uses several hundred socket connections at the same time - AND set ulimit -n to 1024. DOES this MAKE SENSE??? Did you know, that every opened diskfile, every IP socket, every DB connection, every unix socket ..... (everything that is opened by a process) is a opened file in terms of ulimit! Thomas Von: "Dirk Kulmsee" <d.kulm...@netgroup.de> An: "'ASSP development mailing list'" <assp-test@lists.sourceforge.net> Datum: 05.11.2014 07:45 Betreff: Re: [Assp-test] ASSP crashes after updates - too many open files Thanks for the hint to ulimit. It was not the solution, but helped seeing the problem. The ulimit was originally set to 1024. When I raise it (1536 or 2048) ASSP still crashes, but tells me more: ------------------------------------ ASSP 2.4.4(14307) is starting in directory /opt/assp on host mail using Perl /usr/bin/perl version 5.020001 (5.20.1) compiling code please wait ..... checking config in /opt/assp/assp.cfg - OK ASSP uses AsspSelfLoader 2.03 - check [OK] loading configuration [OK] 1146 values loaded [OK] defining environment [OK] setting up global ENV [OK] loading modules.........U [OK] loading database drivers [OK] setup regular expressions [OK] loading plugins [OK] fixing up config [OK] check process env [SKIP] check process permission [OK] setting up modules.......... [OK] checking directories [OK] check file permission [OK] loading caches and lists [OK] starting maintenance worker thread -> init all databases starting maintenance worker thread [OK] starting 5 communication worker threads ..... [OK] starting rebuild SpamDB worker thread [OK] initializing main thread and logging [OK] Warning: Failed to connect to the agentx master agent (tcp:localhost:705): *** buffer overflow detected ***: /usr/bin/perl /opt/assp/assp.pl MainLoop - next: Wed Nov 5 07:12:50 2014 terminated ======= Backtrace: ========= /lib/x86_64-linux-gnu/libc.so.6(+0x7303f)[0x7fd5403d103f] /lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x37)[0x7fd540454137] /lib/x86_64-linux-gnu/libc.so.6(+0xf4350)[0x7fd540452350] /lib/x86_64-linux-gnu/libc.so.6(+0xf60a7)[0x7fd5404540a7] /usr/lib/x86_64-linux-gnu/libnetsnmp.so.30(netsnmp_large_fd_set_resize+0x48) [0x7fd539d1a718] /usr/lib/x86_64-linux-gnu/libnetsnmp.so.30(netsnmp_large_fd_setfd+0x24)[0x7f d539d1a924] /usr/lib/x86_64-linux-gnu/libnetsnmp.so.30(snmp_sess_select_info2_flags+0xbd )[0x7fd539cfad8d] /usr/lib/x86_64-linux-gnu/libnetsnmp.so.30(snmp_sess_select_info_flags+0x70) [0x7fd539cfb4c0] /usr/lib/x86_64-linux-gnu/libnetsnmpagent.so.30(agent_check_and_process+0x76 )[0x7fd538dc3866] /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/NetSNMP/agent/agent.so(+0x576e)[0x 7fd53948d76e] /usr/lib/x86_64-linux-gnu/libperl.so.5.20(Perl_pp_entersub+0x4bb)[0x7fd540ef 55db] /usr/lib/x86_64-linux-gnu/libperl.so.5.20(Perl_runops_standard+0x16)[0x7fd54 0eede76] /usr/lib/x86_64-linux-gnu/libperl.so.5.20(perl_run+0x21d)[0x7fd540e7ed4d] /usr/bin/perl /opt/assp/assp.pl MainLoop - next: Wed Nov 5 07:12:50 2014(main+0x149)[0x400e19] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0x7fd54037fb45] /usr/bin/perl /opt/assp/assp.pl MainLoop - next: Wed Nov 5 07:12:50 2014[0x400e51] ======= Memory map: ======== [ lengthy Memory Map left out here ] ------------------------------------ I then deactivated SNMP in ASSP.cfg, because Agent X appears to be involved: SNMPLog:=0 SNMP:=0 useNetSNMPagent:=0 Now ASSP is starting and hopefully working as it always used to. Regards Dirk -----Ursprüngliche Nachricht----- Von: aquilinux [mailto:aquili...@gmail.com] Gesendet: Mittwoch, 5. November 2014 05:54 An: ASSP development mailing list Betreff: Re: [Assp-test] ASSP crashes after updates - too many open files try setting a higher open files limit. you can see actual value with *ulimit -n* and set new value with *ulimit -n value*. 2048 should be reasonably high to allow your assp to start (*ulimit -n 2048* ) regards, On Tue, Nov 4, 2014 at 10:29 PM, Dirk Kulmsee <d.kulm...@netgroup.de> wrote: > Hi everybody, > I have been running ASSP 2.4.4 (14264) on Debian jessie with perl 5.20 > for some weeks. Today I updated the whole system (i.e. Debian Updates, > cpan updates, some newer files from ASSP). Well, never change a > winning team :-). > If I try to start ASSP now it crashes in less than 30 seconds without > ever writing to log/maillog.txt. > I set AsADaemon:=0 and got this output: > > ----------------------------------------- > ASSP 2.4.4(14307) is starting in directory /opt/assp on host mail > using Perl /usr/bin/perl version 5.020001 (5.20.1) compiling code > please wait ..... checking config in /opt/assp/assp.cfg - OK > ASSP uses AsspSelfLoader 2.03 - check [OK] > loading configuration [OK] > 1146 values loaded [OK] > defining environment [OK] > setting up global ENV [OK] > loading modules.........U [OK] > loading database drivers [OK] > setup regular expressions [OK] > loading plugins [OK] > fixing up config [OK] > check process env [SKIP] > check process permission [OK] > setting up modules.......... [OK] > checking directories [OK] > check file permission [OK] > loading caches and lists [OK] > starting maintenance worker thread -> init all databases > starting maintenance worker thread [OK] > starting 5 communication worker threads ..... [OK] > starting rebuild SpamDB worker thread [FAILED] > initializing main thread and logging [OK] > error: AsspSelfLoader is unable to load code from file > /opt/assp/sl-cache/main-openLogs.sl - Zu viele offene Dateien > ----------------------------------------- > > I stopped other services on this host to reduce the number of open > files, but that didn't help. > I am stuck with this error even if I boot an older Kernel or take an > older version of assp.pl. > Maybe ASSP is right - there are 994 files in /opt/assp/sl-cache. > Any ideas how to proceed? > > Thanks for your help > Dirk > > > > > ---------------------------------------------------------------------- > -------- _______________________________________________ > Assp-test mailing list > Assp-test@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/assp-test > -- "Madness, like small fish, runs in hosts, in vast numbers of instances." Nessuno mi pettina bene come il vento. ---------------------------------------------------------------------------- -- _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test ---------------------------------------------------------------------------- -- _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ---------------------------------------------------------------------------- -- _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test ------------------------------------------------------------------------------ _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test
