SimilarityMatrixEntryKeyPartitioner sometimes produces illegal partition numbers
--------------------------------------------------------------------------------
Key: MAHOUT-477
URL: https://issues.apache.org/jira/browse/MAHOUT-477
Project: Mahout
Issue Type: Bug
Components: Collaborative Filtering
Reporter: Sebastian Schelter
Priority: Minor
My job failed on EMR today with the exception below. I think this happens only
when when there are negative row/column indices in a matrix given to
RowSimilarityJob, still have to figure out the details.
java.io.IOException: Illegal partition for
org.apache.mahout.math.hadoop.similarity.similaritymatrixentry...@3532b21 (-3)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:921)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:549)
at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.hadoop.mapreduce.Mapper.map(Mapper.java:124)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:629)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:310)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
