Following up on my below note, here's what I see as far as the zookeeper directory in /tmp. I don't know where else to look for possible errors. Any pointers ?
akini@karadi:~$ ls -tal /tmp/giraph-SimpleShortestPathsVertex-3594578381801720832/ total 36 drwxrwxr-x 3 akini akini 4096 Mar 11 15:01 . drwxrwxr-x 3 akini akini 4096 Mar 11 15:00 _bspZooKeeper drwxrwxrwt 29 root root 24576 Mar 11 15:00 .. akini@karadi:~$ ls -tal /tmp/giraph-SimpleShortestPathsVertex-3594578381801720832/_bspZooKeeper/ total 12 drwxrwxr-x 3 akini akini 4096 Mar 11 15:01 .. drwxrwxr-x 2 akini akini 4096 Mar 11 15:00 version-2 drwxrwxr-x 3 akini akini 4096 Mar 11 15:00 . akini@karadi:~$ ls -tal /tmp/giraph-SimpleShortestPathsVertex-3594578381801720832/_bspZooKeeper/version-2/ total 20 -rw-rw-r-- 1 akini akini 67108880 Mar 11 15:00 log.1 drwxrwxr-x 2 akini akini 4096 Mar 11 15:00 . -rw-rw-r-- 1 akini akini 296 Mar 11 15:00 snapshot.0 drwxrwxr-x 3 akini akini 4096 Mar 11 15:00 .. On Sun, Mar 10, 2013 at 11:49 AM, Ameet Kini <ameetk...@gmail.com> wrote: > I'm launching the unit test from inside Eclipse. There are no other > errors on the Eclipse console, so I assumed it is the KeeperException > that is causing the test hang. But there may be errors in some log > file somewhere which I am missing?? Not sure where to look in this > case. > > I don't have the environment in front of me right now but I did verify > that zookeeper is indeed brought up, at least, attempted to be brought > up. This I verified by digging into the unit test code and getting the > path to the zookeeper's directory and verifying that it contains > non-zero sized files. They were binary files so can't get any more > info from them. > > If I should be looking at some other log file for possible errors, > would greatly appreciate a pointer. > > Thanks, > Ameet > > > On Sat, Mar 9, 2013 at 10:16 PM, Avery Ching <ach...@apache.org> wrote: >> I'm guessing there is another error. How are you launching it? >> >> >> On 3/9/13 12:42 PM, Ameet Kini wrote: >>> >>> The test hangs after those messages. I assumed it is because of the >>> KeeperException messages. >>> >>> Ameet >>> >>> On Sat, Mar 9, 2013 at 12:14 PM, Avery Ching <ach...@apache.org> wrote: >>>> >>>> I think those are info level logs rather than actual issues. If your job >>>> completes successfully, I wouldn't worry about it. >>>> >>>> >>>> On 3/8/13 12:31 PM, Ameet Kini wrote: >>>>> >>>>> Hi folks, >>>>> >>>>> I am trying to run the SimpleShortestPathsVertexTest example >>>>> introduced by the unit testing tool as part of >>>>> (https://issues.apache.org/jira/browse/GIRAPH-51) and see the below >>>>> zookeeper exception while running the testToyData method. I can run >>>>> giraph applications from the command-line and have confirmed that the >>>>> worker node can bring up zookeeper ok. Is there a configuration step I >>>>> am missing while running the unit test tool? >>>>> >>>>> Thanks, >>>>> Ameet >>>>> >>>>> >>>>> >>>>> [14:56:25] INFO: [ZooKeeperServerMain] Starting server >>>>> [14:56:25] INFO: [GiraphJob] run: Since checkpointing is disabled >>>>> (default), do not allow any task retries (setting >>>>> mapred.map.max.attempts = 0, old value = 4) >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 >>>>> GMT >>>>> [14:56:25] INFO: [ZooKeeperServer] Server environment:host.name=dodo >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:java.version=1.6.0_24 >>>>> [14:56:25] INFO: [ZooKeeperServer] Server environment:java.vendor=Sun >>>>> Microsystems Inc. >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:java.home=/usr/lib/jvm/java-6-openjdk-amd64/jre >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> >>>>> >>>>> environment:java.library.path=/usr/lib/jvm/java-6-openjdk-amd64/jre/lib/amd64/server:/usr/lib/jvm/java-6-openjdk-amd64/jre/lib/a\ >>>>> >>>>> >>>>> md64:/usr/lib/jvm/java-6-openjdk-amd64/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib\ >>>>> /jni:/lib:/usr/lib >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:java.io.tmpdir=/tmp >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:java.compiler=<NA> >>>>> [14:56:25] INFO: [ZooKeeperServer] Server environment:os.name=Linux >>>>> [14:56:25] INFO: [ZooKeeperServer] Server environment:os.arch=amd64 >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:os.version=3.2.0-29-generic >>>>> [14:56:25] INFO: [ZooKeeperServer] Server environment:user.name=akini >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:user.home=/home/akini >>>>> [14:56:25] INFO: [ZooKeeperServer] Server >>>>> environment:user.dir=/home/akini/workspace/giraph_test >>>>> [14:56:25] INFO: [ZooKeeperServer] tickTime set to 2000 >>>>> [14:56:25] INFO: [ZooKeeperServer] minSessionTimeout set to 10000 >>>>> [14:56:25] INFO: [ZooKeeperServer] maxSessionTimeout set to 100000 >>>>> [14:56:25] WARN: [JobClient] Use GenericOptionsParser for parsing the >>>>> arguments. Applications should implement Tool for the same. >>>>> [14:56:25] INFO: [NIOServerCnxn] binding to port 0.0.0.0/0.0.0.0:22182 >>>>> [14:56:25] INFO: [FileTxnSnapLog] Snapshotting: 0 >>>>> [14:56:25] INFO: [JobClient] Running job: job_201303070954_0007 >>>>> [14:56:26] INFO: [JobClient] map 0% reduce 0% >>>>> [14:56:30] INFO: [NIOServerCnxn] Accepted socket connection from >>>>> /127.0.0.1:43076 >>>>> [14:56:30] INFO: [NIOServerCnxn] Client attempting to establish new >>>>> session at /127.0.0.1:43076 >>>>> [14:56:30] INFO: [FileTxnLog] Creating new log file: log.1 >>>>> [14:56:31] INFO: [NIOServerCnxn] Established session >>>>> 0x13d4b936bc30000 with negotiated timeout 60000 for client >>>>> /127.0.0.1:43076 >>>>> [14:56:31] INFO: [NIOServerCnxn] Accepted socket connection from >>>>> /127.0.0.1:43077 >>>>> [14:56:31] INFO: [NIOServerCnxn] Client attempting to establish new >>>>> session at /127.0.0.1:43077 >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30000 >>>>> type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_masterElectionDir >>>>> Error:KeeperErrorCode = NoNode for >>>>> /_hadoopBsp/job_201303070954_0007/_masterElectionDir >>>>> [14:56:31] INFO: [NIOServerCnxn] Established session >>>>> 0x13d4b936bc30001 with negotiated timeout 60000 for client >>>>> /127.0.0.1:43077 >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30001 >>>>> type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_masterJobState >>>>> Error:KeeperErrorCode = NodeExists for >>>>> /_hadoopBsp/job_201303070954_0007/_masterJobState >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30000 >>>>> type:create cxid:0xc zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_applicationAttemptsDir/0 >>>>> Error:KeeperErrorCode = NoNode for >>>>> /_hadoopBsp/job_201303070954_0007/_applicationA\ >>>>> ttemptsDir/0 >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30001 >>>>> type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_applicationAttemptsDir >>>>> Error:KeeperErrorCode = NodeExists for >>>>> /_hadoopBsp/job_201303070954_0007/_applicatio\ >>>>> nAttemptsDir >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30000 >>>>> type:create cxid:0xd zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error Path:/_hadoopBsp Error:KeeperErrorCode = >>>>> NodeExists for /_hadoopBsp >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30000 >>>>> type:create cxid:0xe zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error Path:/_hadoopBsp/job_201303070954_0007 >>>>> Error:KeeperErrorCode = NodeExists for >>>>> /_hadoopBsp/job_201303070954_0007 >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30001 >>>>> type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_applicationAttemptsDir/0 >>>>> Error:KeeperErrorCode = NoNode for >>>>> /_hadoopBsp/job_201303070954_0007/_applicationA\ >>>>> ttemptsDir/0 >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30000 >>>>> type:create cxid:0xf zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_applicationAttemptsDir >>>>> Error:KeeperErrorCode = NodeExists for >>>>> /_hadoopBsp/job_201303070954_0007/_applicatio\ >>>>> nAttemptsDir >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30001 >>>>> type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error Path:/_hadoopBsp Error:KeeperErrorCode = >>>>> NodeExists for /_hadoopBsp >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30001 >>>>> type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error Path:/_hadoopBsp/job_201303070954_0007 >>>>> Error:KeeperErrorCode = NodeExists for >>>>> /_hadoopBsp/job_201303070954_0007 >>>>> [14:56:31] INFO: [PrepRequestProcessor] Got user-level >>>>> KeeperException when processing sessionid:0x13d4b936bc30001 >>>>> type:create cxid:0x8 zxid:0xfffffffffffffffe txntype:un\ >>>>> known reqpath:n/a Error >>>>> Path:/_hadoopBsp/job_201303070954_0007/_applicationAttemptsDir >>>>> Error:KeeperErrorCode = NodeExists for >>>>> /_hadoopBsp/job_201303070954_0007/_application >>>> >>>> >>
