Hello,
We are experiencing a new issue since we upgraded from 389-ds-base from
1.4~ish to 2.0.15 on RHEL 8. I couldnt figure how to fix it, so I
switched to RHEL9 and are on 2.4.5-9.
The issue is during a performance load test of a web application. The
app logs into a website and does some things that searches against ldap,
and does some transactions. This app has been performing fine for years,
the app has changed so it could be something there, but I am not sure
about that because of the percentage of the traffic that is successful.
The errors for the web app are "Can't contact Ldap Server" and sometimes
"Can't contact LDAP server. Start TLS request accepted.Server willing to
negotiate SSL. (0xFFFF [-1])". Out of the 128k connections below, these
errors will happen like 5 or 6 times, so its wildly inconsistent and random.
I did a logconv analysis with 6 hours of a day of testing, see below.
One thing that really stood out to me was the peak concurrent
connections = 22.. That peak is so low, I dont know how these errors are
happening.
I dont see any errors in the access log ( grepping for err=1).
I looked for cache warnings/errors in the access/errors logs, but didnt
find any. I dont see things like unavailable connections in the access logs.
Suggestions on what to change or look for in the logs ?
Thanks,
Gary
information:
Machine Size: 16G of ram, 4 core AMD (its an EC2.m5.large, gp3 disk type)
kernel:
Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC
packages:
389-ds-base-libs-2.4.5-9.el9_4.x86_64
389-ds-base-2.4.5-9.el9_4.x86_64
single instance of dirsrv running
dirsrv modifcations from default:
nsslapd-logging-backend: dirsrv-log,syslog
nsslapd-maxdescriptors: 8192
nsslapd-listen-backlog-size: 256
nsslapd-allow-hashed-passwords: on
nsslapd-idletimeout: 30
nsslapd-ioblocktimeout: 30000
nsslapd-sizelimit: -1
nsslapd-auditlog-logging-enabled: off
nsslapd-lookthroughlimit: -1
dirsrv.systemd:
limitNOFILE=8192
>Total Log Lines Analszed: 2694287
>
>
>
> ---------- Access Log Output ------------
>
> Start of Logs: 26/Sep/2024:10:07:32.089983378
> End of Logs: 26/Sep/2024:15:54:29.895403688
>
> Processed Log Time: 5 Hours, 46 Minutes, 57.805426688 Seconds
>
> Restarts: 0
> Secure Protocol Versions:
> - TLS1.2 128-bit AES-GCM (123117 connections)
>
> Peak Concurrent Connections: 22
> Total Operations: 1097043
> Total Results: 1097044
> Overall Performance: 100.0%
>
> Total Connections: 128646 (6.18/sec) (370.78/min)
> - LDAP Connections: 128646 (6.18/sec) (370.78/min)
> - LDAPI Connections: 0 (0.00/sec) (0.00/min)
> - LDAPS Connections: 0 (0.00/sec) (0.00/min)
> - StartTLS Extended Ops: 123116 (5.91/sec) (354.84/min)
>
> Searches: 845279 (40.60/sec) (2436.22/min)
> Modifications: 0 (0.00/sec) (0.00/min)
> Adds: 0 (0.00/sec) (0.00/min)
> Deletes: 0 (0.00/sec) (0.00/min)
> Mod RDNs: 0 (0.00/sec) (0.00/min)
> Compares: 0 (0.00/sec) (0.00/min)
> Binds: 128647 (6.18/sec) (370.78/min)
>
> Average wtime (wait time): 0.001560856
> Average optime (op time): 0.003310453
> Average etime (elapsed time): 0.004868040
>
> Multi-factor Authentications: 0
> Proxied Auth Operations: 0
> Persistent Searches: 0
> Internal Operations: 0
> Entry Operations: 0
> Extended Operations: 123116
> Abandoned Requests: 1
> Smart Referrals Received: 0
>
> VLV Operations: 0
> VLV Unindexed Searches: 0
> VLV Unindexed Components: 0
> SORT Operations: 0
>
> Entire Search Base Queries: 0
> Paged Searches: 0
> Unindexed Searches: 0
> Unindexed Components: 0
> Invalid Attribute Filters: 0
> FDs Taken: 128646
> FDs Returned: 129318
> Highest FD Taken: 968
>
> Broken Pipes: 0
> Connections Reset By Peer: 0
> Resource Unavailable: 0
> Max BER Size Exceeded: 0
>
> Binds: 128647
> Unbinds: 119206
> -------------------------------------
> - LDAP v2 Binds: 0
> - LDAP v3 Binds: 128647
> - AUTOBINDs(LDAPI): 0
> - SSL Client Binds: 0
> - Failed SSL Client Binds: 0
> - SASL Binds: 0
> - Dir
--
_______________________________________________
389-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedoraproject.org/archives/list/[email protected]
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue
