Hassan Eslami created GIRAPH-1009:
-------------------------------------
Summary: Spammy 'lost reservation' messages from ZooKeeper in
workers' log at the end of the computation.
Key: GIRAPH-1009
URL: https://issues.apache.org/jira/browse/GIRAPH-1009
Project: Giraph
Issue Type: Bug
Components: bsp, zookeeper
Affects Versions: 1.2.0-SNAPSHOT
Environment: All environment, while running with more than one worker.
Reporter: Hassan Eslami
Priority: Minor
Fix For: 1.2.0-SNAPSHOT
When running Giraph with more than one worker, ZooKeeper usually throws a bunch
of 'lost reservation' info log messages for input splits at the end of the
computation in workers' log. This clutters log file of workers, specially in
cases where the job is running on a large graph with fairly large number of
input splits.
Here are examples of these log messages:
...
{{INFO 2015-05-19 14:44:58,894 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1126 lost
reservation}}
{{INFO 2015-05-19 14:44:58,894 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2585 lost
reservation}}
{{INFO 2015-05-19 14:44:58,895 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1166 lost
reservation}}
{{INFO 2015-05-19 14:44:58,895 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1212 lost
reservation}}
{{INFO 2015-05-19 14:44:58,895 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1666 lost
reservation}}
{{INFO 2015-05-19 14:44:58,896 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2282 lost
reservation}}
{{INFO 2015-05-19 14:44:58,896 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1302 lost
reservation}}
{{INFO 2015-05-19 14:44:58,896 \[main-EventThread\]
org.apache.giraph.worker.InputSplitsHandler - process: Input split
/_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2364 lost
reservation}}
...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
