Hi Hanish, Plugin is still not visible on Audit screen UI
On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal <hanish.ban...@impetus.co.in> wrote: > Hi Aneela, > > > By following below conversation thread, I am getting that you ranger > admin UI is working fine but hdfs plugin is not shown in audit logs. If I > am right then please try below steps: > > > 1. Copy all the ranger libraries files from "lib" folder to > "share/hadoop/hdfs/lib/" > cp <hadoop-home>/lib/* <hadoop-home>/share/hadoop/hdfs/lib/ > > > 2. Check if you have created symbolic link for hadoop configuration > folder "etc/hadoop" as "conf". If not then create using below command: > > $ ln -s <hadoop-home>/etc/hadoop <hadoop-home>/conf > > > 3. Restart namenode service. > > > 4. Now login into some other user on machine and try listing files in > Hadoop. > > > hadoop fs -ls / > > > Note: In last step, run command using some other user who didn't start > the hadoop services. > > > Now check if plugin is visible on audit screen of UI. > > > > ------- > > *Thanks & Regards, Hanish Bansal* > Software Engineer, iLabs > Impetus Infotech Pvt. Ltd. > ------------------------------ > *From:* Aneela Saleem <ane...@platalytics.com> > *Sent:* Wednesday, July 29, 2015 7:19 PM > *To:* user@ranger.incubator.apache.org > > *Subject:* Re: Error Setting up Ranger-Admin > > When i run *./setup.sh * in ranger-admin, i get the following error: > > SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". > > On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem <ane...@platalytics.com> > wrote: > >> Yes NameNode is running. And i don't see any Ranger-related logs in >> NameNode logs >> >> On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel < >> loic.cha...@telecomnancy.net> wrote: >> >>> At least, is your NameNode running ? >>> And do you can see any Ranger-related logs in the NameNode logs ? >>> >>> Loïc CHANEL >>> Engineering student at TELECOM Nancy >>> Trainee at Worldline - Villeurbanne >>> >>> 2015-07-29 14:37 GMT+02:00 Aneela Saleem <ane...@platalytics.com>: >>> >>>> I can't figure out what is the issue? as there are no errors in log file >>>> >>>> On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel < >>>> loic.cha...@telecomnancy.net> wrote: >>>> >>>>> The logs for ranger plugins are in the NameNode logs, that's why Bosco >>>>> told you to take a look there. >>>>> >>>>> Loïc CHANEL >>>>> Engineering student at TELECOM Nancy >>>>> Trainee at Worldline - Villeurbanne >>>>> >>>>> 2015-07-29 12:43 GMT+02:00 Aneela Saleem <ane...@platalytics.com>: >>>>> >>>>>> Hi Bosco, >>>>>> >>>>>> I tried your solution but it still does not work for me >>>>>> >>>>>> On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem < >>>>>> ane...@platalytics.com> wrote: >>>>>> >>>>>>> How can i see logs for ranger-hdfs plugin ? >>>>>>> >>>>>>> Can you please have a look on install.properties file? is it >>>>>>> correct? >>>>>>> >>>>>>> >>>>>>> On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai <bo...@apache.org> >>>>>>> wrote: >>>>>>> >>>>>>>> Yes, this issues seems to be HDFS namenode was not stopped. Can >>>>>>>> you check the running process by running “ps –eafww | grep >>>>>>>> proc_namenode” >>>>>>>> and if it is running you have to stop it and start it again. >>>>>>>> >>>>>>>> Regarding the chown error, it seems the scripts assumes the user >>>>>>>> to be “hdfs”. Can you manually update enable-hdfs-plugin.sh and >>>>>>>> rerun it? >>>>>>>> >>>>>>>> Line number 89 of enable-hdfs-plugin.sh >>>>>>>> >>>>>>>> #CFG_OWNER_INF="${HCOMPONENT_NAME}:${HCOMPONENT_NAME}” >>>>>>>> >>>>>>>> CFG_OWNER_INF=hduser >>>>>>>> >>>>>>>> And run ./enable-hdfs-plugin.sh again? >>>>>>>> >>>>>>>> Thanks >>>>>>>> >>>>>>>> Bosco >>>>>>>> >>>>>>>> >>>>>>>> From: Ramesh Mani <rm...@hortonworks.com> >>>>>>>> Reply-To: "user@ranger.incubator.apache.org" < >>>>>>>> user@ranger.incubator.apache.org> >>>>>>>> Date: Tuesday, July 28, 2015 at 4:45 PM >>>>>>>> >>>>>>>> To: "user@ranger.incubator.apache.org" < >>>>>>>> user@ranger.incubator.apache.org> >>>>>>>> Subject: Re: Error Setting up Ranger-Admin >>>>>>>> >>>>>>>> By looking at this error it seems that port 50070 >>>>>>>> <http://0.0.0.0:50070> is in use. Check that namenode is already >>>>>>>> running. If so stop and start. >>>>>>>> >>>>>>>> Regards, >>>>>>>> Ramesh >>>>>>>> >>>>>>>> From: Aneela Saleem <ane...@platalytics.com> >>>>>>>> Reply-To: "user@ranger.incubator.apache.org" < >>>>>>>> user@ranger.incubator.apache.org> >>>>>>>> Date: Tuesday, July 28, 2015 at 4:37 PM >>>>>>>> To: "user@ranger.incubator.apache.org" < >>>>>>>> user@ranger.incubator.apache.org> >>>>>>>> Subject: Re: Error Setting up Ranger-Admin >>>>>>>> >>>>>>>> I'm continuously stuck at this point >>>>>>>> >>>>>>>> Regards, >>>>>>>> Aneela Saleem >>>>>>>> On Jul 29, 2015 4:37 AM, "Aneela Saleem" <ane...@platalytics.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> How can we check whether the problem is in Ranger's configuration >>>>>>>>> or Hadoop? >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> Aneela Saleem >>>>>>>>> On Jul 29, 2015 2:03 AM, "Aneela Saleem" <ane...@platalytics.com> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Following are the Logs: >>>>>>>>>> >>>>>>>>>> 2015-07-29 02:01:22,126 FATAL >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start >>>>>>>>>> namenode. >>>>>>>>>> java.net.BindException: Port in use: 0.0.0.0:50070 >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891) >>>>>>>>>> at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:762) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:746) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504) >>>>>>>>>> Caused by: java.net.BindException: Address already in use >>>>>>>>>> at sun.nio.ch.Net.bind0(Native Method) >>>>>>>>>> at sun.nio.ch.Net.bind(Net.java:463) >>>>>>>>>> at sun.nio.ch.Net.bind(Net.java:455) >>>>>>>>>> at >>>>>>>>>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) >>>>>>>>>> at >>>>>>>>>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) >>>>>>>>>> at >>>>>>>>>> org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216) >>>>>>>>>> at >>>>>>>>>> org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886) >>>>>>>>>> ... 8 more >>>>>>>>>> 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: >>>>>>>>>> Exiting with status 1 >>>>>>>>>> 2015-07-29 02:01:22,129 INFO >>>>>>>>>> org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: >>>>>>>>>> /************************************************************ >>>>>>>>>> SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/ >>>>>>>>>> 192.168.1.4 >>>>>>>>>> ************************************************************/ >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem < >>>>>>>>>> ane...@platalytics.com> wrote: >>>>>>>>>> >>>>>>>>>>> hduser >>>>>>>>>>> >>>>>>>>>>> On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai < >>>>>>>>>>> bo...@apache.org> wrote: >>>>>>>>>>> >>>>>>>>>>>> This seems to be one of the reason HDFS plugin is not >>>>>>>>>>>> enabled. As what user have you installed Hadoop? >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> >>>>>>>>>>>> Bosco >>>>>>>>>>>> >>>>>>>>>>>> From: Aneela Saleem <ane...@platalytics.com> >>>>>>>>>>>> Reply-To: "user@ranger.incubator.apache.org" < >>>>>>>>>>>> user@ranger.incubator.apache.org> >>>>>>>>>>>> Date: Tuesday, July 28, 2015 at 1:31 PM >>>>>>>>>>>> To: "user@ranger.incubator.apache.org" < >>>>>>>>>>>> user@ranger.incubator.apache.org> >>>>>>>>>>>> Subject: Re: Error Setting up Ranger-Admin >>>>>>>>>>>> >>>>>>>>>>>> Also when i run *./enable-hdfs-plugin.sh * >>>>>>>>>>>> >>>>>>>>>>>> i get the following at the end: >>>>>>>>>>>> >>>>>>>>>>>> + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file: >>>>>>>>>>>> /etc/ranger/hadoopdev/cred.jceks to >>>>>>>>>>>> /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ... >>>>>>>>>>>> *chown: invalid user: ‘hdfs:hdfs’* >>>>>>>>>>>> Ranger Plugin for hadoop has been enabled. Please restart >>>>>>>>>>>> hadoop to ensure that changes are effective. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> > > ------------------------------ > > > > > > > NOTE: This message may contain information that is confidential, > proprietary, privileged or otherwise protected by law. The message is > intended solely for the named addressee. If received in error, please > destroy and notify the sender. Any use of this email is prohibited when > received in error. Impetus does not represent, warrant and/or guarantee, > that the integrity of this communication has been maintained nor that the > communication is free of errors, virus, interception or interference. >