I just watched the top for a bit and did some testing and I see brief spikes on my system where each domain user has their own smbd process that grabs resources. This seems to happen when first opening a directory. It would seem that whatever resources Samba needs to complete this operation, my server has better access to or more of so that my server isn't hanging. Have you watched the resources on your domain controllers to see if they are seeing spikes too?

James A. Dinkel wrote:
This is running in vmware, and I noticed occasionally wmware reports
that the cpu is being maxed out by a virtual machine.  Logging into the
virtual machine and running top confirms that the smbd process is maxing
out the cpu.  If I leave it alone for a while, eventually it starts
dropping connections and not letting people into the file server.
Killing the process with kill -9 does no good, it just immediately comes
back with a  new pid.  Stopping the service also does no good.  I have
to reboot the server, and occasionally even during the shutdown it will
hang (I left it for 30 minutes) and I have to kill the power.

I tried collecting logs from the time the max out started.  The computer
will run for a while, sometimes less than an hour, sometimes all day,
just fine, and then in less than a second the cpu goes from around 10%
to 100% and stays there until I reboot.  But the default logs tell me
nothing and the level 10 logs are Greek to me.

James Dinkel

PS.  Earlier this morning I switched to level 10 logs and when the "max
out" happened I checked the time in the VMWare performance graphs.  It
looks like it happened around 9:26:40 to 9:27:20.  Here are the VERY
LONG grep results for around that time in the logs:

sudo grep "2007/01/04 09:26" /var/log/samba/*
-------------------------------------------
/var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:26:12, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:26:42, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:26:39, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.10.168.log:[2007/01/04 09:26:30, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:26:57, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:26:10, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:26:44, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:26:34, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:04, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)
/var/log/samba/smbd.log.old:[2007/01/04 09:26:39, 5]
lib/util_sock.c:print_socket_options(206)

sudo grep "2007/01/04 09:27" /var/log/samba/*
------------------------------------------------
/var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.0.202.log:[2007/01/04 09:27:12, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.0.225.log:[2007/01/04 09:27:42, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.10.166.log:[2007/01/04 09:27:39, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 6]
param/loadparm.c:lp_file_list_changed(3006)
/var/log/samba/192.168.10.185.log:[2007/01/04 09:27:57, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.2.103.log:[2007/01/04 09:27:10, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.2.111.log:[2007/01/04 09:27:44, 10]
smbd/process.c:setup_select_timeout(1284)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 3]
smbd/sec_ctx.c:set_sec_ctx(241)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
auth/auth_util.c:debug_nt_user_token(448)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
auth/auth_util.c:debug_unix_user_token(474)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 5]
smbd/uid.c:change_to_root_user(275)
/var/log/samba/192.168.9.58.log:[2007/01/04 09:27:34, 10]
smbd/process.c:setup_select_timeout(1284)


--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/listinfo/samba

Reply via email to