[ https://issues.apache.org/jira/browse/SYSTEMML-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144009#comment-15144009 ]
Matthias Boehm commented on SYSTEMML-513: ----------------------------------------- ad 1: solved by explicit separation of hadoop 1/2 and MRv1/MRv2 configurations ad 2: I was not able to reproduce this issue on a hadoop 2.2 cluster w/ MRv1 support. However, we can rewrite the problematic code of MultipleOutputCommitter in a more robust way which makes it independent from the existence of JobContext.TASK_ISMAP in the job conf. > MapReduce v1 backwards compatibility support > -------------------------------------------- > > Key: SYSTEMML-513 > URL: https://issues.apache.org/jira/browse/SYSTEMML-513 > Project: SystemML > Issue Type: Bug > Reporter: Matthias Boehm > Assignee: Matthias Boehm > > We did not run SystemML on MRv1 for a while which led to various > incompatibilities (e.g., > https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00312.html). > Furthermore, there are issues with regard to hadoop2 and MRv1 deployments. > This task covers all related aspects of making SystemML work on MRv1 again. > 1) Generalization MRv1 configuration selection > 2) Version-specific handling of multiple output logic > 3) Version-specific usage of newer hdfs apis -- This message was sent by Atlassian JIRA (v6.3.4#6332)