[
https://issues.apache.org/jira/browse/GIRAPH-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307785#comment-14307785
]
Hudson commented on GIRAPH-992:
-------------------------------
ABORTED: Integrated in Giraph-trunk-Commit #1525 (See
[https://builds.apache.org/job/Giraph-trunk-Commit/1525/])
GIRAPH-992 Zookeeper logs have too many NodeExists (edunov:
http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=226fa4bb47a97ac825e05274cba77914f9c96252)
* giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/zk/ZooKeeperExt.java
> Zookeeper logs have too many NodeExists exceptions
> --------------------------------------------------
>
> Key: GIRAPH-992
> URL: https://issues.apache.org/jira/browse/GIRAPH-992
> Project: Giraph
> Issue Type: Bug
> Reporter: Sergey Edunov
> Assignee: Sergey Edunov
>
> There are several places in our code where we do not check properly if zk
> node already exists before attempting to create it. As a result ZK logs are
> full of these exceptions.
> Biggest offender is recursive path creation in ZooKeeperExt.createExt().
> Obviously if part of the path already exists we don't need to create it.
> Second biggest offender is writing input splits from master. Here we lunch
> multiple threads each of them attempting to create the same path.
> INFO 2015-02-04 14:32:39,730 [ProcessThread(sid:0 cport:-1):]
> org.apache.zookeeper.server.PrepRequestProcessor - Got user-level
> KeeperException when processing sessionid:0x14b56b9176f0001 type:create
> cxid:0x1 zxid:0x19 txntype:-1 reqpath:n/a Error
> Path:/_hadoopBsp/job_201411061513.83344_0001/_masterJobState
> Error:KeeperErrorCode = NodeExists for
> /_hadoopBsp/job_201411061513.83344_0001/_masterJobState
> INFO 2015-02-04 14:32:39,740 [ProcessThread(sid:0 cport:-1):]
> org.apache.zookeeper.server.PrepRequestProcessor - Got user-level
> KeeperException when processing sessionid:0x14b56b9176f0001 type:create
> cxid:0x3 zxid:0x1a txntype:-1 reqpath:n/a Error
> Path:/_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir
> Error:KeeperErrorCode = NodeExists for
> /_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir
> INFO 2015-02-04 14:32:39,742 [ProcessThread(sid:0 cport:-1):]
> org.apache.zookeeper.server.PrepRequestProcessor - Got user-level
> KeeperException when processing sessionid:0x14b56b9176f0001 type:create
> cxid:0x5 zxid:0x1b txntype:-1 reqpath:n/a Error
> Path:/_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir/0/_superstepDir
> Error:KeeperErrorCode = NodeExists for
> /_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir/0/_superstepDir
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
