[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Foley updated MAPREDUCE-3319:
--
Resolution: Fixed
Fix Version/s: (was: 1.1.0)
1.0.0
Target Version/s: 1.0.0 (was: 1.1.0, 0.24.0)
Status: Resolved (was: Patch Available)
Okay, Subroto, thanks.
Release 1.0.0 RC had to be re-spun, so merged this fix as promised.
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Assignee: Subroto Sanyal
Priority: Blocker
Labels: bigtop
Fix For: 1.0.0
Attachments: MAPREDUCE-3319.patch
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Foley updated MAPREDUCE-3319:
--
Fix Version/s: (was: 1.0.0)
1.1.0
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Assignee: Subroto Sanyal
Priority: Blocker
Labels: bigtop
Fix For: 1.1.0
Attachments: MAPREDUCE-3319.patch
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Foley updated MAPREDUCE-3319:
--
Target Version/s: 0.24.0, 1.1.0 (was: 1.1.0)
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Assignee: Subroto Sanyal
Priority: Blocker
Labels: bigtop
Fix For: 1.1.0
Attachments: MAPREDUCE-3319.patch
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Subroto Sanyal updated MAPREDUCE-3319:
--
Attachment: MAPREDUCE-3319.patch
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Assignee: Subroto Sanyal
Priority: Blocker
Labels: bigtop
Attachments: MAPREDUCE-3319.patch
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Subroto Sanyal updated MAPREDUCE-3319:
--
Fix Version/s: 1.0.0
Status: Patch Available (was: Open)
The patch makes the code comapatible with LongWritable as final Output value
class
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Assignee: Subroto Sanyal
Priority: Blocker
Labels: bigtop
Fix For: 1.0.0
Attachments: MAPREDUCE-3319.patch
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Foley updated MAPREDUCE-3319:
--
Target Version/s: 1.1.0
Fix Version/s: (was: 1.0.0)
(was: 1.1.0)
Moved requested target versions from Fix Version to Target Version field.
Absent a viable patch in time for 1.0.0, this will have to go in 1.1.0.
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Priority: Blocker
Labels: bigtop
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Shaposhnik updated MAPREDUCE-3319:
Priority: Blocker (was: Major)
Fix Version/s: 0.20.206.0
0.20.205.1
I really think we should fix this before releasing any version that has a
potential of becoming Hadoop 1.0. I'll try to see if I can cook up a patch to
fix it. If not -- I'd say it is better to disable this example, rather than
shipping a broken one.
Agreed?
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Priority: Blocker
Labels: bigtop
Fix For: 0.20.205.1, 0.20.206.0
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3319) multifilewc from hadoop examples seems to be broken in 0.20.205.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Shaposhnik updated MAPREDUCE-3319:
Labels: bigtop (was: )
multifilewc from hadoop examples seems to be broken in 0.20.205.0
-
Key: MAPREDUCE-3319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3319
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.20.205.0
Reporter: Roman Shaposhnik
Labels: bigtop
{noformat}
/usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc examples/text
examples-output/multifilewc
11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process :
2
11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
11/10/31 16:50:27 INFO mapred.JobClient: map 0% reduce 0%
11/10/31 16:50:42 INFO mapred.JobClient: Task Id :
attempt_201110311350_0220_m_00_0, Status : FAILED
java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast
to org.apache.hadoop.io.LongWritable
at
org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
at
org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
