[jira] [Created] (MAPREDUCE-6157) Connect failed in shuffle (due to NM down) could break current retry logic to tolerant NM restart.

2014-11-11 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6157:
-

 Summary: Connect failed in shuffle (due to NM down) could break 
current retry logic to tolerant NM restart.
 Key: MAPREDUCE-6157
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6157
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Junping Du
Assignee: Junping Du
Priority: Critical


The connection failure log during NM restart is as following:
{noformat}
014-11-12 03:31:20,728 WARN [fetcher#23] 
org.apache.hadoop.mapreduce.task.reduce.Fetcher: Failed to connect to 
ip-172-31-37-212.ec2.internal:13562 with 4 map outputs
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at 
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at 
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at 
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
at sun.net.www.http.HttpClient.(HttpClient.java:211)
at sun.net.www.http.HttpClient.New(HttpClient.java:308)
at sun.net.www.http.HttpClient.New(HttpClient.java:326)
at 
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996)
at 
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932)
at 
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850)
at 
org.apache.hadoop.mapreduce.task.reduce.Fetcher.connect(Fetcher.java:685)
at 
org.apache.hadoop.mapreduce.task.reduce.Fetcher.setupConnectionsWithRetry(Fetcher.java:386)
at 
org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyFromHost(Fetcher.java:292)
at org.apache.hadoop.mapreduce.task.reduce.Fetcher.run(Fetcher.java:193)
2014-11-12 03:31:20,743 INFO [fetcher#22] 
org.apache.hadoop.mapreduce.task.reduce.Fetcher: for 
url=13562/mapOutput?job=job_1415762969065_0001&reduce=3&map=attempt_1415762969065_0001_m_21_0,attempt_1415762969065_0001_m_04_0,attempt_1415762969065_0001_m_18_0,attempt_1415762969065_0001_m_15_0,attempt_1415762969065_0001_m_01_0,attempt_1415762969065_0001_m_09_0,attempt_1415762969065_0001_m_12_0,attempt_1415762969065_0001_m_06_0
 sent hash and received reply
{noformat}
We have some code to handle the retry logic for connection with a timeout (as 
below). But if connection get refused quickly, we only try very limited times 
and it get failed also quickly.

{code}
while (true) {
  try {
connection.connect();
break;
  } catch (IOException ioe) {
// update the total remaining connect-timeout
connectionTimeout -= unit;

// throw an exception if we have waited for timeout amount of time
// note that the updated value if timeout is used here
if (connectionTimeout == 0) {
  throw ioe;
}

// reset the connect timeout for the last try
if (connectionTimeout < unit) {
  unit = connectionTimeout;
  // reset the connect time out for the final connect
  connection.setConnectTimeout(unit);
}
  }
{code}
We should fix this to make retry can continue until timeout.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Zhijie Shen
+1 (non-binding)

* Downloaded the source tar ball, and built binaries from it successfully.
* Ran DS apps and MR jobs with emitting timeline data enabled successfully.
* Verified the generic history information, DS-specific and MR-specific
metrics were available.
* Ran the timeline server in secure mode, delegation token and domain-based
ACLs worked properly.


On Tue, Nov 11, 2014 at 4:30 PM, Wei Yan  wrote:

>
> > On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:
> >
> > Hi Arun,
> >
> > We were testing the RC and ran into a problem with the recent fixes that
> > were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
> > HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello,
> which
> > is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
> > can't connect without it.  Just to be clear, it does not mean SSLv2,
> which
> > is insecure.  This also affects the MR shuffle in HADOOP-11243.
>
> For HADOOP-11243, as the shuffle happens only between NMs, it’s ok to keep
> it only support TLS.
>
> >
> > The fix is super simple, so I think we should reopen these 3 JIRAs and
> put
> > in addendum patches and get them into 2.6.0.
> >
> > thanks
> > - Robert
> >
> > On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
> >
> >> Hi Arun!
> >> We are very close to completion on YARN-1964 (DockerContainerExecutor).
> >> I'd also like HDFS-4882 to be checked in. Do you think these issues
> merit
> >> another RC?
> >> ThanksRavi
> >>
> >>
> >> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> >> ste...@hortonworks.com> wrote:
> >>
> >>
> >> +1 binding
> >>
> >> -patched slider pom to build against 2.6.0
> >>
> >> -verified build did download, which it did at up to ~8Mbps. Faster than
> a
> >> local build.
> >>
> >> -full clean test runs on OS/X & Linux
> >>
> >>
> >> Windows 2012:
> >>
> >> Same thing. I did have to first build my own set of the windows native
> >> binaries, by checking out branch-2.6.0; doing a native build, copying
> the
> >> binaries and then purging the local m2 repository of hadoop artifacts
> to be
> >> confident I was building against. For anyone who wants those native libs
> >> they will be up on
> >> https://github.com/apache/incubator-slider/tree/develop/bin/windows/
> once
> >> it syncs with the ASF repos.
> >>
> >> afterwords: the tests worked!
> >>
> >>
> >> On 11 November 2014 02:52, Arun C Murthy  wrote:
> >>
> >>> Folks,
> >>>
> >>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would
> like
> >>> to see released.
> >>>
> >>> The RC is available at:
> >>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> >>> The RC tag in git is: release-2.6.0-rc0
> >>>
> >>> The maven artifacts are available via repository.apache.org at
> >>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> days.
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>>
> >>> --
> >>> CONFIDENTIALITY NOTICE
> >>> NOTICE: This message is intended for the use of the individual or
> entity
> >> to
> >>> which it is addressed and may contain information that is confidential,
> >>> privileged and exempt from disclosure under applicable law. If the
> reader
> >>> of this message is not the intended recipient, you are hereby notified
> >> that
> >>> any printing, copying, dissemination, distribution, disclosure or
> >>> forwarding of this communication is strictly prohibited. If you have
> >>> received this communication in error, please contact the sender
> >> immediately
> >>> and delete it from your system. Thank You.
> >>>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >>
> >>
> >>
> >>
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


[jira] [Created] (MAPREDUCE-6156) Fetcher - connect() doesn't handle connection refused correctly

2014-11-11 Thread sidharta seethana (JIRA)
sidharta seethana created MAPREDUCE-6156:


 Summary: Fetcher - connect() doesn't handle connection refused 
correctly 
 Key: MAPREDUCE-6156
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6156
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: sidharta seethana
Assignee: Junping Du
Priority: Critical


The connect() function in the fetcher assumes that whenever an IOException is 
thrown, the amount of time passed equals "connectionTimeout" ( see code snippet 
below ). This is incorrect. For example, in case the NM is down, an 
ConnectException is thrown immediately - and the catch block assumes a minute 
has passed when it is not the case.

{code}
  if (connectionTimeout < 0) {
  throw new IOException("Invalid timeout "
+ "[timeout = " + connectionTimeout + " ms]");
} else if (connectionTimeout > 0) {
  unit = Math.min(UNIT_CONNECT_TIMEOUT, connectionTimeout);
}
// set the connect timeout to the unit-connect-timeout
connection.setConnectTimeout(unit);
while (true) {
  try {
connection.connect();
break;
  } catch (IOException ioe) {
// update the total remaining connect-timeout
connectionTimeout -= unit;

// throw an exception if we have waited for timeout amount of time
// note that the updated value if timeout is used here
if (connectionTimeout == 0) {
  throw ioe;
}

// reset the connect timeout for the last try
if (connectionTimeout < unit) {
  unit = connectionTimeout;
  // reset the connect time out for the final connect
  connection.setConnectTimeout(unit);
}
  }
}
{code]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Wangda Tan
Thanks Arun for creating the RC.

Tried to build and deploy it on a local distributed cluster, can
successfully run distributed shell job with node labels.
+1 (non-binding),

Thanks,
Wangda


On Tue, Nov 11, 2014 at 2:06 PM, Robert Kanter  wrote:

> Hi Arun,
>
> We were testing the RC and ran into a problem with the recent fixes that
> were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
> HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello, which
> is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
> can't connect without it.  Just to be clear, it does not mean SSLv2, which
> is insecure.  This also affects the MR shuffle in HADOOP-11243.
>
> The fix is super simple, so I think we should reopen these 3 JIRAs and put
> in addendum patches and get them into 2.6.0.
>
> thanks
> - Robert
>
> On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
>
> > Hi Arun!
> > We are very close to completion on YARN-1964 (DockerContainerExecutor).
> > I'd also like HDFS-4882 to be checked in. Do you think these issues merit
> > another RC?
> > ThanksRavi
> >
> >
> >  On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> > ste...@hortonworks.com> wrote:
> >
> >
> >  +1 binding
> >
> > -patched slider pom to build against 2.6.0
> >
> > -verified build did download, which it did at up to ~8Mbps. Faster than a
> > local build.
> >
> > -full clean test runs on OS/X & Linux
> >
> >
> > Windows 2012:
> >
> > Same thing. I did have to first build my own set of the windows native
> > binaries, by checking out branch-2.6.0; doing a native build, copying the
> > binaries and then purging the local m2 repository of hadoop artifacts to
> be
> > confident I was building against. For anyone who wants those native libs
> > they will be up on
> > https://github.com/apache/incubator-slider/tree/develop/bin/windows/
> once
> > it syncs with the ASF repos.
> >
> > afterwords: the tests worked!
> >
> >
> > On 11 November 2014 02:52, Arun C Murthy  wrote:
> >
> > > Folks,
> > >
> > > I've created a release candidate (rc0) for hadoop-2.6.0 that I would
> like
> > > to see released.
> > >
> > > The RC is available at:
> > > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> > > The RC tag in git is: release-2.6.0-rc0
> > >
> > > The maven artifacts are available via repository.apache.org at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> > >
> > > Please try the release and vote; the vote will run for the usual 5
> days.
> > >
> > > thanks,
> > > Arun
> > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
> >
> >
> >
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Robert Kanter
Hi Arun,

We were testing the RC and ran into a problem with the recent fixes that
were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello, which
is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
can't connect without it.  Just to be clear, it does not mean SSLv2, which
is insecure.  This also affects the MR shuffle in HADOOP-11243.

The fix is super simple, so I think we should reopen these 3 JIRAs and put
in addendum patches and get them into 2.6.0.

thanks
- Robert

On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:

> Hi Arun!
> We are very close to completion on YARN-1964 (DockerContainerExecutor).
> I'd also like HDFS-4882 to be checked in. Do you think these issues merit
> another RC?
> ThanksRavi
>
>
>  On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> ste...@hortonworks.com> wrote:
>
>
>  +1 binding
>
> -patched slider pom to build against 2.6.0
>
> -verified build did download, which it did at up to ~8Mbps. Faster than a
> local build.
>
> -full clean test runs on OS/X & Linux
>
>
> Windows 2012:
>
> Same thing. I did have to first build my own set of the windows native
> binaries, by checking out branch-2.6.0; doing a native build, copying the
> binaries and then purging the local m2 repository of hadoop artifacts to be
> confident I was building against. For anyone who wants those native libs
> they will be up on
> https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
> it syncs with the ASF repos.
>
> afterwords: the tests worked!
>
>
> On 11 November 2014 02:52, Arun C Murthy  wrote:
>
> > Folks,
> >
> > I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> > to see released.
> >
> > The RC is available at:
> > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> > The RC tag in git is: release-2.6.0-rc0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> > thanks,
> > Arun
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>
>
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Ravi Prakash
Hi Arun!
We are very close to completion on YARN-1964 (DockerContainerExecutor). I'd 
also like HDFS-4882 to be checked in. Do you think these issues merit another 
RC?
ThanksRavi
 

 On Tuesday, November 11, 2014 11:57 AM, Steve Loughran 
 wrote:
   

 +1 binding

-patched slider pom to build against 2.6.0

-verified build did download, which it did at up to ~8Mbps. Faster than a
local build.

-full clean test runs on OS/X & Linux


Windows 2012:

Same thing. I did have to first build my own set of the windows native
binaries, by checking out branch-2.6.0; doing a native build, copying the
binaries and then purging the local m2 repository of hadoop artifacts to be
confident I was building against. For anyone who wants those native libs
they will be up on
https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
it syncs with the ASF repos.

afterwords: the tests worked!


On 11 November 2014 02:52, Arun C Murthy  wrote:

> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> to see released.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> The RC tag in git is: release-2.6.0-rc0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.




Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Steve Loughran
+1 binding

-patched slider pom to build against 2.6.0

-verified build did download, which it did at up to ~8Mbps. Faster than a
local build.

-full clean test runs on OS/X & Linux


Windows 2012:

Same thing. I did have to first build my own set of the windows native
binaries, by checking out branch-2.6.0; doing a native build, copying the
binaries and then purging the local m2 repository of hadoop artifacts to be
confident I was building against. For anyone who wants those native libs
they will be up on
https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
it syncs with the ASF repos.

afterwords: the tests worked!


On 11 November 2014 02:52, Arun C Murthy  wrote:

> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> to see released.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> The RC tag in git is: release-2.6.0-rc0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


[jira] [Created] (MAPREDUCE-6155) MapFiles are not always correctly detected by SequenceFileInputFormat

2014-11-11 Thread Jens Rabe (JIRA)
Jens Rabe created MAPREDUCE-6155:


 Summary: MapFiles are not always correctly detected by 
SequenceFileInputFormat
 Key: MAPREDUCE-6155
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6155
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Affects Versions: 2.5.1
Reporter: Jens Rabe


MapFiles are not correctly detected by SequenceFileInputFormat.

This is because the listStatus method only detects a MapFile correctly if the 
path it checks is a directory - it then replaces it by the path of the data 
file.

This is likely to fail if the data file does not exist, i.e., if the input path 
is a directory, but does not belong to a MapFile, or if recursion is turned on 
and the input format comes across a file (not a directory) which is indeed part 
of a MapFile.

The listStatus method should be changed to detect these cases correctly:
* if the current candidate is a file and its name is "index" or "data", check 
if its corresponding other file exists, and if the key types of both files 
match and if the value type of the index file is LongWritable
* If the current candidate is a directory, it is only a MapFile if (and only 
if) an index and a data file exist, they are both SequenceFiles and their key 
types match (and the index value type is LongWritable)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Hadoop-Mapreduce-trunk - Build # 1954 - Still Failing

2014-11-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1954/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 30587 lines...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.619 sec - in 
org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat

Results :

Tests in error: 
  TestJavaSerialization.testMapReduceJob:127 » IO Job failed!
  TestJavaSerialization.testWriteToSequencefile:179 » IO Job failed!

Tests run: 519, Failures: 0, Errors: 2, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ... SUCCESS [  2.736 s]
[INFO] hadoop-mapreduce-client-core .. SUCCESS [ 59.525 s]
[INFO] hadoop-mapreduce-client-common  SUCCESS [ 27.170 s]
[INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [  4.386 s]
[INFO] hadoop-mapreduce-client-app ... SUCCESS [08:55 min]
[INFO] hadoop-mapreduce-client-hs  SUCCESS [05:11 min]
[INFO] hadoop-mapreduce-client-jobclient . FAILURE [  01:38 h]
[INFO] hadoop-mapreduce-client-hs-plugins  SKIPPED
[INFO] hadoop-mapreduce-client-nativetask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] hadoop-mapreduce .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 01:53 h
[INFO] Finished at: 2014-11-11T15:17:26+00:00
[INFO] Final Memory: 43M/594M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Sending artifact delta relative to Hadoop-Mapreduce-trunk #1870
Archived 2 artifacts
Archive block size is 32768
Received 0 blocks and 20243176 bytes
Compression is 0.0%
Took 9.8 sec
Updating HADOOP-9576
Updating HADOOP-11289
Updating HADOOP-11296
Updating YARN-2841
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.