LOL... three times I have seen it... Hey Guido, maybe Tony
just kicked you off the list, but didn't do it the usual way, he chopped off
what you see versus what you post so you don't notice he booted you. You should
have heard Tony at the summit anyway... The whole time... "Yeah that Guido is
too good to hang out with us... Man is he stuck up... Some one give me another
Pabst Blue Ribbon, I'm thirsty." [1] Personally I think Tony didn't like your
accent Guido... what was that accent, like Egyptian or Spanish or something?
=)
I would say look at the archive but it is a ways behind
now.
[1] This is of course ficticious. Tony picked the best
wines at dinner I have had in a long time. Who knew wine could cost
more than $4.99 USD a bottle.
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Grillenmeier, Guido
Sent: Monday, May 03, 2004 8:17 AM
To: [EMAIL PROTECTED]
Subject: FW: [ActiveDir] Replication issues
reposting this again, as I still can't see it on the
list...
From: Grillenmeier, Guido
Sent: Samstag, 1. Mai 2004 10:20
To: '[EMAIL PROTECTED]'
Subject: RE: [ActiveDir] Replication issues
as Joe already wrote, there is a difference between "out of
band" and "urgent" replication.
-
any DC that you use to set a PW for a user also apply this change "out of band" to the PDCE of the domain => this is NOT urgent replication. It is referred to as immediate replication, although it should simply be called "updatePDC", since this is what it's doing. It's not relying on AD replication at all - instead a direct RPC to the PDCE is made to apply the change at this end
=> this is totally independent of your site-replication schedules
=> however, the PDCE needs to be reachable from the DC that performs the PW change -
additionally, the PW will be replicated urgently to DCs within the same site of the DC where the PW was updated - and yes, this does NOT replicate accross site-boundaries
-
however, when a user logs onto any DC in the domain that hasn't replicated the PW change (i.e. still has the old value), prior to denying logon and increasing the lockout counter, the DC will contact the PDCE and validate if the PW is not correct afterall (if it is, I believe it's updated immediately on the DC itself as well - but I'm not sure on this)
-
also, any DC where an account gets LOCKED OUT due to too many logon retries by the user and thus reaching the AccountLockout policy will behave the same way as when setting a PW
=> the PDCE will also be updated immediately out-of-band via an RPC call
So what's the problem?
-
well, when you UNLOCK an account, this WON'T be updated on the PDCE via immediate replication and neither will the local DC of the user check the PDCE if the account is locked out or not.
-
so the real problem is NOT that the PW change doesn't get back to the user's DC => the problem is that the ACCOUNT LOCKOUT status (i.e. setting the user object's lockoutTime=0) does NOT behave the same way at every change (only replicates immediately when value is not equal to 0)
-
even though the PW change on any DC would work just fine to allow a user to log back onto the domain from any other DC, when an account is LOCKED, this will prevent him from doing so successfully - so this is the reason why you'd want to perform the account UNLOCK on the DC that's "local" to the user account and most often this task is combined with resetting a user's password.
A better solution
-
you'll have a much better life, if you simply do not configure an Account Lockout policy => what does it gain you? It is actually more of a security risk than help for IT => you want to ensure that hackers can't attempt too many retries at cracking a user's password, so you set the account lockout to 5-10 retries.
-
usually you don't setup the account lockout policy to tease your own users - do you really care if they need to try 50 times until they get it right? Or before they call the helpdesk and admit they've forgotten their PW? Usually not.
-
However, setting the account lockout threshold this low is the best way for a hacker to plan a DOS attack against your domain, once he has a list of accounts => he'll just continuously try bogus logons and thus lockout all of your accounts! Believe me, you'll have a hell of a lifetime trying to unlock them in a timely manner... (yes, you can use Joe's account unlock tool - but remember you'll have to wait until all of these unlocks replicate to the DCs used by the users....)
- So you can actually INCREASE the security of your infrastructure by either disabling the Account Lockout policy or at least by setting it to a rather high value (min. 15 - 50 attempts) => a hacker will still not be able to quess the password with these few attempts, but you users will usually call the helpdesk, BEFORE they lockout their own accounts - and a PW change on ANY DC is now fully sufficient to get the user back to work.
-
using this approach (setting account lockout to a higher value), I have reduced helpdesk calls rgd. locked out accounts by 90% for many customers - and we have combined this with increased monitoring of the eventlogs to detect PW-guessing attempts from hackers, something that you should do anyways.
/Guido
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of deji Agba
Sent: Freitag, 30. April 2004 07:34
To: [EMAIL PROTECTED]
Subject: RE: [ActiveDir] Replication issues
The password will get
replicated "out of band" [1] back to the PDC on a
password change. See
http://www.microsoft.com/technet/prodtechnol/windowsserver2003/technologies/
security/bpactlck.mspx, specifically check the piece on "immediate
replication".
password change. See
http://www.microsoft.com/technet/prodtechnol/windowsserver2003/technologies/
security/bpactlck.mspx, specifically check the piece on "immediate
replication".
I missed this. Let's hope I don't get
smacked too hard for it. But, are you saying password change qualifies for
"immediate" (or urgent) replication? Not according to this:
By default, urgent replication does not occur across site
boundaries. Because of this, administrators should make manual password changes
and account resets on a domain controller that is in that user's site.
This is what acctinfo addressed. This was the problem I was facing
a year ago. My helpdesk admins in Santa Clara reset an EMEA (or
Tokyo) user's password. They call up the user and say "here's your
password", user tries it and hits the lockout threshold, BAM! user is locked
out. User gets really PO'ed because now he can't get helpdesk, because helpdesk
had left for the day shortly after calling user. I unlock user's account, which
now triggers urgent replication, tell user "wait for about 5-10 minutes and try
it". User is then able to login and make that million dollars sales
presentation. I get bonus, and I'm still employed because I'm the "Guru".
Helpdesk get the shaft and they are pissed at me for not telling them about
this "feature".
Now, I will shut up. Really :)
Sincerely,
Dèjì Akómöláfé, MCSE MCSA MCP+I
Dèjì Akómöláfé, MCSE MCSA MCP+I
Microsoft MVP
- Directory Services
www.readymaids.com - we know
IT
www.akomolafe.com
Do you now realize that Today is the Tomorrow you were worried about Yesterday? -anon
www.akomolafe.com
Do you now realize that Today is the Tomorrow you were worried about Yesterday? -anon
From: joe
Sent: Thu 4/29/2004 3:43 PM
To: [EMAIL PROTECTED]
Subject: RE: [ActiveDir] Replication issues
The password will get replicated "out of band" [1] back to the PDC on a password change. See http://www.microsoft.com/technet/prodtechnol/windowsserver2003/technologies/ security/bpactlck.mspx, specifically check the piece on "immediate replication". "Theoretically, there should be no need for these tools, but in reality, chaining did not work as designed." Yes it actually does, I see it in action every single day. We process thousands of password requests a day. It does work. Wherever the password is changed, it gets back to the PDC and then whatever DC is hit, the request is chained back to the PDC to allow the authentication. "before the locking out DC learns about the reset." Lockouts are handled differently. Dig into the documentation. An unlock has some special stuff around it in terms of how often it will go back and check. I don't recall the details, however, not every attempt is sent back to the PDC when the account is locally locked. I believe the logic was put in to protect the PDC from DOSed from things like viruses and such that pound the DCs. The "AvoidPDConWAN" will of course change the default functionality, that is what it was designed to do. If someone blindly applied it without understanding the repercussions, they deserve everything that happens to them. See http://support.microsoft.com/default.aspx?scid=kb;EN-US;232690 / http://support.microsoft.com/?kbid=225511 for more info on AvoidPDConWan setting. One other thing I want to point out that is usually documented horribly. Password changes are urgently replicated within a site, not to all domain controllers. So if you change a password, you will go through urgent notification (i.e. bypassing the holdback time) within the site and those DCs will replicate in an urgent manner [2]. Once you hit site boundaries that are living with normal site link replication periods then you wait for that replication period to come up to get that password sent across. So if you have a 4 day wait on the link, then you wait that long to get that replication through. If you don't have avoidpdconwan set though and you have good connectivity, this will not be an issue. If you do, the very fact that you set that setting means you WANT to have to go change the password on the DC the user is using. In a simple environment this is a trivial thing to work out (assuming proper configuration everywhere). In a large complex environment this can be decidely non-trivial. joe [1] A specific RPC call is made. I have seen this in action with one of my tools that watches DCs for changes and notifies on object modifications. The longest delay I have seen has been about 500ms. However if the PDC is for some reason unavailable, this call will fail and the password will get back to the PDC through the standard replication methods. [2] I don't believe however that the priority is any higher than any other domain context change, just simply the notification is urgent which means that if there is a queue on the inbound thread on what it is working on, it will get thrown at the bottom of the items with the same priority. -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Wednesday, April 28, 2004 7:30 PM To: [EMAIL PROTECTED] Subject: RE: [ActiveDir] Replication issues >>It will get that password back immediately unless the PDC is really >>busy or otherwise unavailable The way I'm reading this is that you are saying password change will trigger immediate replication to the PDCE. Iin my experience (which I don't have to describe to you :)), this is not the case. Also, I may be misreading you here, because, further now, you said: >>What SHOULD happen is that the local DC should realize, hey this >>password isn't correct and will do what is called a PDC Chaining to ask the PDC what if the password specified is in fact ok [3] This is the way it works, I agree here. Now, you also said: >>Assuming the PDC is available to that site, you should be able to >>change a password anywhere on any DC and that password will get back to the DC. This, too, is correct. However the problem is the time it takes for the password change to get back to the PDCE and then onward to the rest of the DC. Where neither the HelpDesk (wo reset the password) no the User (whose password was reset) is in the site where the PDCE is located, the length of time it takes for the password change to travel across the wire is usually unacceptble. This is the reason one wuld want to reset the password at a DC local to the User. This is also one of the reasonss for ALToos, especially the AcctInfo.dll part. Theoretically, there should be no need for these tools, but in reality, chaining did not work as designed. One DC would lock out a user's account, after the user's password had been reset on another DC, before the locking out DC learns about the reset. Lastly, I have come across canned recommendations from "security consultants" telling clients to enable AvoidPDConWAN registry key. I am sure some companies would have heeded that recommendation. Sincerely, Dèjì Akómöláfé, MCSE MCSA MCP+I Microsoft MVP - Directory Services www.readymaids.com - we know IT www.akomolafe.com Do you now realize that Today is the Tomorrow you were worried about Yesterday? -anon ________________________________ From: [EMAIL PROTECTED] on behalf of joe Sent: Wed 4/28/2004 4:47 AM To: [EMAIL PROTECTED] Subject: RE: [ActiveDir] Replication issues 1. What do you think your replication latency is supposed to be based upon your knowledge of your topology and your link configurations? This isn't something you have to guess at. Look at your DC placement and your replication topology and it will tell you the exact theoretical max replication period you have. 2. What do you want it to be? 30-60 minutes would be a time frame for replication that means you changed the default link settings. The default it 180 minutes per link (hop). This can be reduced to as low as 15 minutes without change notification and if you enable change notification it can go down to seconds (based on how busy the bridge heads between the sites are). As a rule, people don't generally set up change notification across a WAN [1]. 30-60 minutes could mean that you have 2-4 hops to get to the site with 15 minute delays or it could be you have 1-2 hops with 30 minute delays or it could be 1-2 hops with 15 minute delays with lots of DCs in each site and it taking 15 minutes to get to the proper outgoing bridgehead for each site. Lots of valid reasons for the timing, you need to understand what your theretical maxes could be and then decide if you are outside of that. If outside of that the first thing I would do is look at my DRA Pending Queue on my servers in the replication path to make sure it was zeroing out every replication period. [2] One thing I saw below I wanted to speak about... The out of band password force back to the PDC has been in W2K since RTM at least. It will get that password back immediately unless the PDC is really busy or otherwise unavailable (down, net down, PacMan on the ethernet line eating all of the packets, etc). Now after all of this I will say you should NOT have to worry about changing passwords at the specific site. Assuming the PDC is available to that site, you should be able to change a password anywhere on any DC and that password will get back to the DC. Then the client should be able to log on ANYWHERE. What SHOULD happen is that the local DC should realize, hey this password isn't correct and will do what is called a PDC Chaining to ask the PDC what if the password specified is in fact ok [3]. Assuming the password is ok, the PDC will say, that is fine and let the user log on. This functionality has been in Windows all the way back in NT. Without it, life in large companies would be miserable. Now there has been change in the functionality since 2K RTM to fix what I consider a design flaw / bug in this process. I can't recall when that exactly went in for 2K (SP3?) but was in K3 RC1; I have written previously about this fix on this list. Basically the issue was if the user needed to change the password on the next logon and the PDC chaining event occurred, the logon would succeed and client would be told to display the change password dialogue. The user would respond and use the "old password" of the password they just used to logon. Since that password wasn't yet at the local DC that was handling this change password request the local DC would say that the old password was incorrect and reject the change. I have already speculated in previous posts to this list about what was happening. Basically it was fixed by sending back key information to the remote DC during a PDC Chaining operation that brought that DC up to date for some critical authentication information so that it did indeed have the latest password information for that user. So all of that to say, that unless you have horrendous network connectivity, you should not have to set passwords on specific DCs if you are up to the current patch levels of Windows 2000 or on Windows 2003 for your domain controllers. joe [1] There are exceptions here so I am not looking for people to email say, we are and here'e why... There are a couple of special cases where I do it as well - to keep exchange in a good mood. The exceptions make the rule and show the beauty of the flexibility of the system. [2] Keep in mind there was a bug in a hotfix or two between SP2-3 that caused this queue to not have good values. It would increment sometimes and exit without remembering to decrement. Very unusual as it will look almost like you queue isn't clearing. In this case, you can pull out repadmin /queue or my adqueueloop to look at the actual queue and verify what it is doing. This is fixed in SP4 and actually one of the 4 new hotfixes that just came out also corrects it (obviously the bin with that code was replaced in one of the fixes and it has all of the previous fixes in it as well). So if you are at the minimum you should be for these last three crits, your counters should be working ok. [3] The DCs realize that they may not have the latest password and go ask the "master" for verification. This is one of the "big" functions of the PDC, being "master" of the passwords. It may not have the current right password, but it is final arbiter on whether or not a certain password can be used if another DC isn't sure. ________________________________ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Coleman, Hunter Sent: Tuesday, April 27, 2004 10:46 AM To: '[EMAIL PROTECTED]' Subject: RE: [ActiveDir] Replication issues It's strictly a judgment call. You decide how important it is to have password changes replicate *now* and then weigh that against the costs of having very low replication latency. Costs might include available bandwidth, other applications using the same network, etc... In general, I'd stay away from letting this be the driving factor in determining your replication schedule. Change the password in the user's site, and 99% of the time the user should be fine within 15 minutes (default intrasite maximum replication period if you have 5 or more DCs in the site) or less. ________________________________ From: Rimmerman, Russ [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 27, 2004 7:40 AM To: '[EMAIL PROTECTED]' Subject: RE: [ActiveDir] Replication issues What does changing the replication schedules explicitly for password resets entail, and is it recommended? ________________________________ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Coleman, Hunter Sent: Tuesday, April 27, 2004 8:25 AM To: '[EMAIL PROTECTED]' Subject: RE: [ActiveDir] Replication issues Unless you want to start changing your replication schedules explicitly for password resets, you're doing the right thing. Change the password on a DC in the user's site. If you're at SP4 (I think, could have been SP3) then the password change will also get sent on to the PDC emulator immediately. Anytime a user enters an incorrect password, the local DC will pass on the request to the PDCE in case the password had changed on a different DC. The Account Lockout Status tool is probably the best utility for checking on password replication. Among other things, it will show the timestamp for password last set on each domain controller, so you can have a good idea of the replication state on the change. http://www.microsoft.com/downloads/details.aspx?FamilyID=d1a5ed1d-cd55-4829- a 189-99515b0e90f7&DisplayLang=en (watch for URL wrap) Hunter ________________________________ From: Rimmerman, Russ [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 27, 2004 7:07 AM To: '[EMAIL PROTECTED]' Subject: [ActiveDir] Replication issues We have always been having weird issues with replication. We have about 30 AD sites all over the world. When we change or reset a password here for a user at a remote site, it takes quite a long time (30-60 minutes or more) to replicate to the users site. So, we are having to connect to their local domain contoller and reset the password there. What is the best practice for setting up and tuning replication and resetting passwords, and what tools are recommended (replmon?) for "testing" it, and how long should it take? List info : http://www.activedir.org/mail_list.htm List FAQ : http://www.activedir.org/list_faq.htm List archive: http://www.mail-archive.com/activedir%40mail.activedir.org/ List info : http://www.activedir.org/mail_list.htm List FAQ : http://www.activedir.org/list_faq.htm List archive: http://www.mail-archive.com/activedir%40mail.activedir.org/