Which branch are you using? And can you share the usersync config? On Fri, Mar 8, 2024 at 8:10 AM Loïc CHANEL <loic.cha...@telecomnancy.net> wrote:
> Hi Sailaja, > > I just updated the file and restarted the usersync process, I have the > exact same logs and the users are still not created. Is there a case in > which the file is printed but not synced ? > No error before, except the following warning that's quite usual : > 08 Mar 2024 16:48:50 WARN o.a.h.u.NativeCodeLoader [UnixUserSyncThread] - > Unable to load native-hadoop library for your platform... using > builtin-java classes where applicable > Still, it's weird that it shows with "UnixUserSyncThread" while it's > syncing users from a file, isn't it ? > I'm a bit lost on this, because it is clear that the usersync process is > able to read the user file and I see it communicating with Ranger Admin to > load all the users, but the users in the file are not created. Is there > some configuration missing from > https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process > ? > Thanks, > > > Loïc CHANEL > Technical leader Big Data > Capgemini (Lyon, France) > > > Le ven. 8 mars 2024 à 16:00, Sailaja Polavarapu <spolavar...@cloudera.com> > a écrit : > >> This is strange as I don't see any logs from updateSink() method >> <https://github.com/apache/ranger/blob/master/ugsync/src/main/java/org/apache/ranger/unixusersync/process/FileSourceUserGroupBuilder.java#L145> >> . >> Can you check the timestamp on the file and try updating the file? and also >> check if there are any errors before. Looks like this file is read once >> successfully and hence you see the logs from print() method which logs the >> data from usersync cache. >> >> On Fri, Mar 8, 2024 at 4:40 AM Loïc CHANEL <loic.cha...@telecomnancy.net> >> wrote: >> >>> Hi, >>> >>> Here are the logs on usersync side : >>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==> PolMgrBaseUrl >>> : http://hdp-rec-ranger1-r.l.infra.com:6080 KeyStore File : >>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File : >>> Authentication Type : kerberos >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >>> Initializing for ranger.usersync.mapping.username.regex >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >>> Initializing for ranger.usersync.mapping.groupname.regex >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>> initializing source: >>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >>> Initializing for ranger.usersync.mapping.username.regex >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >>> Initializing for ranger.usersync.mapping.groupname.regex >>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>> [UnixUserSyncThread] - USER:user_one >>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>> [UnixUserSyncThread] - USER:user_two >>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>> [UnixUserSyncThread] - GROUP: 900021 >>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>> [UnixUserSyncThread] - USER:other_user >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>> Begin: initial load of user/group from source==>sink >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>> End: initial load of user/group from source==>sink >>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>> Done initializing user/group source and sink >>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>> Sleeping for [300000] milliSeconds >>> >>> While on the admin side, I only see the following : >>> 10.18.1.43 - - [08/Mar/2024:12:26:52 +0000] "GET >>> /service/xusers/users/?startIndex=4000&pageSize=1000 HTTP/1.1" 200 1065581 >>> 27402 "-" "Java/1.8.0_275" >>> 10.18.1.43 - - [08/Mar/2024:12:26:54 +0000] "GET >>> /service/xusers/ugsync/groupusers?startIndex=0&pageSize=1000 HTTP/1.1" 200 >>> 4429925 2553 "-" "Java/1.8.0_275" >>> >>> Looks like usersync isn't even trying to create the users. Anything I'm >>> missing ? >>> Best regards, >>> >>> >>> Loïc CHANEL >>> Technical leader Big Data >>> Capgemini (Lyon, France) >>> >>> >>> Le ven. 8 mars 2024 à 04:44, Bhavik Patel <bhavikpatel...@gmail.com> a >>> écrit : >>> >>>> Hi, >>>> >>>> Can you kindly check Ranger admin logs and did you confirmed provided >>>> rangeruseraync user password is same at Rangeradmin end. >>>> >>>> >>>> Thanks >>>> Bhavik Patel >>>> +91-7208744109 >>>> >>>> >>>> On Thu, 7 Mar 2024, 6:39 pm Loïc CHANEL, <loic.cha...@telecomnancy.net> >>>> wrote: >>>> >>>>> Hi guys, >>>>> >>>>> I'm currently trying to create Ranger users from a text file and >>>>> followed this documentation to configure Usersync to work with a text file >>>>> as a source : >>>>> https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process >>>>> Still, even if the logs show that the CSV file containing the users is >>>>> properly read, nothing happens : I can't see the users in Ranger UI. Here >>>>> are the logs : >>>>> >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>>> [UnixUserSyncThread] - <== >>>>> PolicyMgrUserGroupBuilder.buildGroupUserLinkList() >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==> >>>>> PolMgrBaseUrl >>>>> : http://hdp-rec-ranger1-r.l.internal.com:6080 KeyStore File : >>>>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File : >>>>> Authentication Type : kerberos >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>>> - Initializing for ranger.usersync.mapping.username.regex >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>>> - Initializing for ranger.usersync.mapping.groupname.regex >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>> - initializing source: >>>>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>>> - Initializing for ranger.usersync.mapping.username.regex >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>>> - Initializing for ranger.usersync.mapping.groupname.regex >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>> [UnixUserSyncThread] - USER:user_one >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>> [UnixUserSyncThread] - USER:user_two >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>> [UnixUserSyncThread] - GROUP: 900021 >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>> [UnixUserSyncThread] - USER:other_user >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>> - Begin: initial load of user/group from source==>sink >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>> - End: initial load of user/group from source==>sink >>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>> - Done initializing user/group source and sink >>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>> - Sleeping for [300000] milliSeconds >>>>> >>>>> Am I missing something ? >>>>> Thanks for your help, >>>>> >>>>> >>>>> Loïc CHANEL >>>>> Technical leader Big Data >>>>> Capgemini (Lyon, France) >>>>> >>>>
