It says in the logs
org.apache.hadoop.mapred.ReduceTask: java.net.ConnectException: Connection
refused
You have a network problem. Do you have firewall enabled.
Raj
and please do not spam the list with the same message.
From: hadoop hive hadooph...@gmail.com
To: u...@hive.apache.org; common-user@hadoop.apache.org
Sent: Friday, February 3, 2012 6:02 AM
Subject: Problem in reduce phase(critical)
On Fri, Feb 3, 2012 at 4:56 PM, hadoop hive hadooph...@gmail.com wrote:
hey folks,
i m getting this error while running mapreduce and these comes up in
reduce phase..
2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0 copy failed:
attempt_201201271626_5282_m_07_2 from hadoopdata3
2012-02-03 16:41:19,954 WARN org.apache.hadoop.mapred.ReduceTask:
java.net.ConnectException: Connection refused
at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1345)
at java.security.AccessController.doPrivileged(Native Method)
at
sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1339)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:993)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1447)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1349)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1261)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1195)
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:519)
at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
at sun.net.www.http.HttpClient.init(HttpClient.java:233)
at sun.net.www.http.HttpClient.New(HttpClient.java:306)
at sun.net.www.http.HttpClient.New(HttpClient.java:323)
at
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:837)
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:778)
at
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:703)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1026)
... 4 more
2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: Task
attempt_201201271626_5282_r_00_0: Failed fetch #4 from
attempt_201201271626_5282_m_07_2
2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask: Failed to
fetch map-output from attempt_201201271626_5282_m_07_2 even after
MAX_FETCH_RETRIES_PER_MAP retries... reporting to the JobTracker
2012-02-03 16:41:19,995 WARN org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0 adding host hadoopdata3 to penalty box,
next contact in 150 seconds
2012-02-03 16:41:19,995 INFO org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0: Got 1 map-outputs from previous
failures
2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0 Need another 1 map output(s) where 0 is
already in progress
2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0 Scheduled 0 outputs (1 slow hosts and0
dup hosts)
2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask:
Penalized(slow) Hosts:
2012-02-03 16:42:10,015 INFO org.apache.hadoop.mapred.ReduceTask:
hadoopdata3 Will be considered after: 99 seconds.
2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0 Need another 1 map output(s) where 0 is
already in progress
2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask:
attempt_201201271626_5282_r_00_0 Scheduled 0 outputs (1 slow hosts and0
dup hosts)
2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask:
Penalized(slow) Hosts:
2012-02-03 16:43:10,050 INFO org.apache.hadoop.mapred.ReduceTask:
hadoopdata3 Will be considered after: 39 seconds.
