Thanks everyone for help. It is working now. I had to edit some memory confs and do a clean install. Also, the /tracers znode is created after the acccumulo is started (i.e. start-all.sh) and not init.
Best regards, Yamini Joshi On Fri, Oct 7, 2016 at 12:12 PM, Josh Elser <josh.el...@gmail.com> wrote: > I would verify that you set up ZooKeeper correctly. Make sure that the > my_id files are created and have the correct contents. > > Yamini Joshi wrote: > >> I can see that in my local setup in my laptop. But, I can't see it here >> somehow. Idk what exactly is wrong. >> >> Best regards, >> Yamini Joshi >> >> On Fri, Oct 7, 2016 at 11:00 AM, Josh Elser <josh.el...@gmail.com >> <mailto:josh.el...@gmail.com>> wrote: >> >> It should be generated at /tracers when the Accumulo Tracer is >> started for the first time because you are using 1.7.2. >> >> Yamini Joshi wrote: >> >> I don't understand why the tracer node is not generated at all. >> >> Best regards, >> Yamini Joshi >> >> On Fri, Oct 7, 2016 at 10:19 AM, Yamini Joshi >> <yamini.1...@gmail.com <mailto:yamini.1...@gmail.com> >> <mailto:yamini.1...@gmail.com <mailto:yamini.1...@gmail.com>>> >> >> wrote: >> >> So the file structure inside zookeeper(now after formatting >> zookeepers) is: >> Accumulo >> >> * d61d7dd5-0f11-437b-9152-d3f171f9af33 >> o users >> o monitor >> o problems >> o root_tablet >> o gc >> o hdfs_reservations >> o table_locks >> o namespaces >> o recovery >> o fate >> o tservers >> o tables >> o replication >> o next_file >> o config >> o bulk_failed_copyq >> o dead >> o masters >> * instances >> o test >> >> test is the name of my new instance. Yes I reinitialized >> accumulo >> using /bin/accumulo init >> >> >> Best regards, >> Yamini Joshi >> >> On Fri, Oct 7, 2016 at 10:12 AM, Michael Wall >> <mjw...@gmail.com <mailto:mjw...@gmail.com> >> <mailto:mjw...@gmail.com <mailto:mjw...@gmail.com>>> wrote: >> >> Yep, I was running 1.6 >> >> On Fri, Oct 7, 2016 at 11:08 AM Sean Busbey >> <bus...@cloudera.com <mailto:bus...@cloudera.com> >> <mailto:bus...@cloudera.com <mailto:bus...@cloudera.com>>> wrote: >> >> tracers used to be under the instance id in 1.6. I >> can >> confirm that in >> 1.7.2 it is definitely at /tracers. I just ran into >> this >> issue last >> week. >> >> @Yamini where do you get the Node does not exist >> error? >> Could you >> copy/paste the whole stacktrace? When I followed >> the same >> workaround >> Josh mentioned, restarting the Trace servers was >> sufficient >> to have >> the znode recreated. >> >> On Fri, Oct 7, 2016 at 10:01 AM, Josh Elser >> <josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>> >> wrote: >> > I had pulled up 1.7.2 and I thought /tracers was at the >> root of ZooKeeper >> > (not within the /accumulo/$instance.id <http://instance.id> >> <http://instance.id> znode). Maybe I looked at the wrong >> > code though? >> > >> > Michael Wall wrote: >> > > >> > > Maybe this is already known, so apologies in advance. >> But don't you >> > > need to do >> > > >> > > $ $ZOOKEEPER_HOME/bin/zkCli.sh -server >> m4:2181,m5:2181,m6:2181 >> > >> >> > >> rmr accumulo/WHATEVER-INSTANCE-ID/tracers >> > > >> > > >> > > instead of rmr /tracers >> > > >> > > If you don't know the instance id, I you can do the >> following in zookeeper >> > > >> > > get /accumulo/instances/INSTANCE_NAME >> > > >> > > >> > > >> > > On Thu, Oct 6, 2016 at 6:26 PM, Josh Elser >> <josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>>> >> wrote: >> >> >> >> Uh, I am confused now. /tracers/ is the default >> parent znode that >> >> the Accumulo Tracer process registers itself in. We >> can also see >> >> this is what was happening with your snippet. >> >> >> >> I don't understand how that would not exist. Have >> you properly >> >> configured ZooKeeper to act as a quorom? (e.g. if >> you zkCli.sh >> >> -server to your ZK servers individually, do you see >> a consistent >> >> view of ZK?) >> >> >> >> You can try to remove the directory in HDFS you >> configured Accumulo >> >> to use, and re `accumulo init` to get back to an >> initial state. I'm >> >> not sure how you got into this situation to begin with. >> >> >> >> Yamini Joshi wrote: >> >> >> >> 1.7.2 >> >> >> >> >> >> Best regards, >> >> Yamini Joshi >> >> >> >> On Thu, Oct 6, 2016 at 4:17 PM, Josh Elser >> <josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>> >> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>>>> >> >> wrote: >> >> >> >> Hrm, maybe I am looking at a newer version >> of Accumulo than >> >> what >> >> you're using. What version are you on? >> >> >> >> Yamini Joshi wrote: >> >> >> >> Thank you for replying Josh. >> >> I am getting this error: >> >> Node does not exist: /tracers >> >> >> >> I did ls and saw accumulo there. Should >> I delete that? >> >> When I try to delete accumulo, it gives >> me a >> >> Authentication is >> >> not valid >> >> error. >> >> >> >> Best regards, >> >> Yamini Joshi >> >> >> >> On Thu, Oct 6, 2016 at 2:57 PM, Josh Elser >> >> <josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>> >> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>>> >> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>> >> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com> >> <mailto:josh.el...@gmail.com <mailto:josh.el...@gmail.com>>>>>> >> >> >> wrote: >> >> >> >> Hi Yamini, >> >> >> >> The /tracers node in ZooKeeper was >> likely >> >> initialized >> >> previously >> >> using an Accumulo configuration >> that has a >> >> different value for >> >> instance.secret. You can delete >> this znode to move >> >> forward >> >> if you >> >> have no other Accumulo instance >> you intend to run >> >> on this >> >> ZK instance. >> >> >> >> $ $ZOOKEEPER_HOME/bin/zkCli.sh -server >> >> m4:2181,m5:2181,m6:2181 >> >> > rmr /tracers >> >> >> >> You can also set a different value for >> >> trace.zookeeper.path in >> >> accumulo-site.xml. After doing >> this, you can try >> >> running a >> >> start-all.sh again to start the >> tracer. >> >> >> >> You also mentioned that the >> Monitor did not start >> >> but did not >> >> include an exception for that >> service. The error you >> >> included only >> >> shows that the Accumulo >> Master/TabletServer did not >> >> correctly start >> >> and assign the system tables >> (accumulo.root and >> >> accumulo.metadata). >> >> >> >> >> >> Yamini Joshi wrote: >> >> >> >> Hello all >> >> >> >> I am trying to configure a >> multinode cluster >> >> with >> >> accumulo. I am >> >> using 3 >> >> machines with the config as >> follows: >> >> >> >> M4: Hadoop Master/Acc Slave >> >> M5: Accumulo Master/Monitor/Gc >> >> M6: Slave >> >> >> >> I have configured zookeeper >> ensemble on the >> >> cluster >> >> with all the 3 >> >> nodes. The Hadoop part seems >> to work fine, I >> >> can see >> >> the console >> >> and run >> >> MR jobs easily. I can also see >> the zookeeper >> >> cluster >> >> with M2 as the >> >> leader. My problem is with >> accumulo, after >> >> accumulo init: >> >> bin/accumulo init >> >> which seems to run without >> any error, after >> >> I isuue >> >> the command >> >> bin/start-all.sh >> >> the Monitor process can't >> start. I am >> >> getting this >> >> error in >> >> my tracer log: >> >> [start.Main] ERROR: Thread >> 'tracer' died. >> >> >> >> >> org.apache.zookeeper.KeeperEx >> ception$NoAuthException: >> >> KeeperErrorCode = >> >> NoAuth for /tracers/trace- >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.zookeeper.KeeperException.create(KeeperException. >> java:113) >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.zookeeper.KeeperException.create(KeeperException. >> java:51) >> >> at >> >> >> >> org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.accumulo.fate.zookeeper.ZooUtil.putEphemeralSeque >> ntial(ZooUtil.java:464) >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.accumulo.fate.zookeeper.ZooReaderWriter.putEpheme >> ralSequential(ZooReaderWriter.java:99) >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.accumulo.tracer.TraceServer.registerInZooKeeper(T >> raceServer.java:304) >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.accumulo.tracer.TraceServer.<init>(TraceServer. >> java:241) >> >> at >> >> >> >> >> >> org.apache.accumulo.tracer.Tr >> <http://org.apache.accumulo.tracer.Tr> >> <http://org.apache.accumulo.tracer.Tr >> >> <http://org.apache.accumulo.tracer.Tr>>aceServer.main(TraceS >> erver.java:346) >> >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.accumulo.tracer.TracerExecutable.execute(TracerEx >> ecutable.java:33) >> >> at >> >> >> org.apache.accumulo.start.Main$1.run(Main.java:120) >> >> at >> java.lang.Thread.run(Thread.java:745) >> >> >> >> And this in my monitor debug log: >> >> Failed to locate tablet for >> table : !0 row : >> >> ~err_\100 >> >> >> >> I can see that the accumulo >> dir has been >> >> created in the >> >> HDFS. >> >> Can anyone >> >> please guide me set this up? I >> am attaching my >> >> config >> >> files here >> >> (Rest >> >> all the same generated as a >> result of >> >> bin_config file). >> >> >> >> Best regards, >> >> Yamini Joshi >> >> >> >> >> >> >> >> >> > >> >> >> >> -- >> busbey >> >> >> >> >>
