streaming tests fail with MR2
-----------------------------
Key: MAPREDUCE-3427
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3427
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming, mrv2
Affects Versions: 0.24.0, 0.23.1
Reporter: Alejandro Abdelnur
Priority: Blocker
Fix For: 0.24.0, 0.23.1
After Mavenizing streaming and getting its testcases to use the MiniMRCluster
wrapper (MAPREDUCE-3169), 4 testcases fail to pass.
Following is an assessment of those failures. Note that the testcases have been
tweaked only to set the streaming JAR and yarn as the framework.
(If these issues are unrelated we should create sub-tasks for each one of them).
*TestStreamingCombiner*, fails because returned counters don't match assertion.
However, counters printed in the test output indicate values that would satisfy
the assertion. As Tom has indicated it seems MR/YARN are not passing back
counter information to the client API.
*TestStreamingBadRecords*, the job is failing with the following exception
{code}
Application application_1321575850006_0001 failed 1 times due to AM Container
for
appattempt_1321575850006_0001_000001 exited with exitCode: 127 due to:
.Failing this attempt.. Failing the application.
{code}
Difficult to troubleshoot because there are not task logs from Mini MR/YARN
run.
*TestStreamingStatus* fails in validateTaskStatus() in the following assertion
{code}
expected:<[before consuming input > sort]> but was:<[SUCCEEDED]>
{code}
*TestUlimit* fails with
{code}
org.junit.ComparisonFailure: output is wrong expected:<[786432]> but
was:<[unlimited]>
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
