[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926054#action_12926054
]
Hudson commented on MAPREDUCE-1375:
---
Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See
[https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/])
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/streaming, test
>Reporter: Amar Kamat
>Assignee: Todd Lipcon
> Fix For: 0.22.0
>
> Attachments: mapreduce-1375.txt,
> TEST-org.apache.hadoop.streaming.TestFileArgs.txt
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834268#action_12834268
]
Todd Lipcon commented on MAPREDUCE-1375:
This should be good to go - it's trivial and fixes a flaky test.
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
>Assignee: Todd Lipcon
> Fix For: 0.22.0
>
> Attachments: mapreduce-1375.txt,
> TEST-org.apache.hadoop.streaming.TestFileArgs.txt
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832898#action_12832898
]
Hadoop QA commented on MAPREDUCE-1375:
--
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12435635/mapreduce-1375.txt
against trunk revision 909241.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac
compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of
release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results:
http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/447/testReport/
Findbugs warnings:
http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/447/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results:
http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/447/artifact/trunk/build/test/checkstyle-errors.html
Console output:
http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/447/console
This message is automatically generated.
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
>Assignee: Todd Lipcon
> Fix For: 0.22.0
>
> Attachments: mapreduce-1375.txt,
> TEST-org.apache.hadoop.streaming.TestFileArgs.txt
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832751#action_12832751
]
Todd Lipcon commented on MAPREDUCE-1375:
I think I got this figured out. The issue is that the test actually tries to
write some "roses are red" text to ls's stdin. Very infrequently, the ls will
actually complete before the data can be flushed, so the task gets a "Broken
pipe" exception - see MAPREDUCE-1481. I'm actually unsure whether
MAPREDUCE-1481 is a bug, but the easy fix for this test is to make the input ""
so no data gets written into ls's stdin.
I'm running the test in a loop with this fix now. If it keeps going for a
couple hours without failure I'll post a patch. (before, this loop would fail
after about 10 minutes usually)
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
>Assignee: Todd Lipcon
> Fix For: 0.22.0
>
> Attachments: TEST-org.apache.hadoop.streaming.TestFileArgs.txt
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828977#action_12828977
]
Todd Lipcon commented on MAPREDUCE-1375:
It looks like it's running two tasks. Am I interpreting the log wrong?
10/02/02 23:59:27 INFO FSNamesystem.audit: ugi=graviip=/127.0.0.1
cmd=rename
src=/home/gravi/workspace/mr1435/trunk/build/contrib/streaming/test/data/org.apache.hadoop.streaming.TestFileArgs/out/_temporary/_attempt_20100202235916710_0001_m_00_0/part-0
dst=/home/gravi/workspace/mr1435/trunk/build/contrib/streaming/test/data/org.apache.hadoop.streaming.TestFileArgs/out/part-0
perm=gravi:supergroup:rw-r--r--
10/02/02 23:59:27 INFO FSNamesystem.audit: ugi=graviip=/127.0.0.1
cmd=rename
src=/home/gravi/workspace/mr1435/trunk/build/contrib/streaming/test/data/org.apache.hadoop.streaming.TestFileArgs/out/_temporary/_attempt_20100202235916710_0001_m_01_0/part-1
dst=/home/gravi/workspace/mr1435/trunk/build/contrib/streaming/test/data/org.apache.hadoop.streaming.TestFileArgs/out/part-1
perm=gravi:supergroup:rw-r--r--
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
> Fix For: 0.22.0
>
> Attachments: TEST-org.apache.hadoop.streaming.TestFileArgs.txt
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828959#action_12828959
]
Todd Lipcon commented on MAPREDUCE-1375:
This is very strange - it indicates either that streaming didn't work at all,
or that the task wasn't run in the right working directory. If you have some
logs that would be great.
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
> Fix For: 0.22.0
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828926#action_12828926
]
Ravi Gummadi commented on MAPREDUCE-1375:
-
Got same error message that is given in the Description now for me also.
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
> Fix For: 0.22.0
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
[
https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800237#action_12800237
]
Todd Lipcon commented on MAPREDUCE-1375:
Was this local or on Hudson? Do you have the full test logs by any chance?
> TestFileArgs fails intermittently
> -
>
> Key: MAPREDUCE-1375
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amar Kamat
> Fix For: 0.22.0
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
> at
> org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
> at
> org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
