[ https://issues.apache.org/jira/browse/MAHOUT-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150795#comment-13150795 ]
Tom White commented on MAHOUT-822: ---------------------------------- Here are the 0.23 failures (all pass against 0.20): {noformat} Failed tests: testCanopyGenManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): 1st x value expected:<1.5> but was:<4.333333333333334> testCanopyGenEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): 1st x value expected:<1.8> but was:<4.433333333333334> testUserDefinedDistanceMeasure(org.apache.mahout.clustering.canopy.TestCanopyCreation): 1st x value expected:<1.5> but was:<4.333333333333334> testKMeansWithCanopyClusterInput(org.apache.mahout.clustering.kmeans.TestKmeansClustering): num points[0] expected:<4> but was:<5> testConditionalEntropy(org.apache.mahout.math.stats.entropy.ConditionalEntropyTest): expected:<0.5> but was:<NaN> testLetters(org.apache.mahout.math.stats.entropy.EntropyTest): expected:<10> but was:<0> testYN(org.apache.mahout.math.stats.entropy.EntropyTest): expected:<8> but was:<0> testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainRatioTest): expected:<1.0> but was:<-Infinity> testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainTest): expected:<1.0> but was:<-Infinity> Tests in error: testDriverIterationsSeq(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-3133739201325104128/output/clusters-5 testDriverIterationsMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-6651551482477894656/output/clusters-5 testDriverMnRIterations(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-2712912373429271552/output/clusters-3 testDriverIterationsMahalanobisSeq(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-3517459711286009856/output/clusters-5 testDriverIterationsMahalanobisMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-544093638502266880/output/clusters-5 testCanopyEuclideanMRJob(org.apache.mahout.clustering.meanshift.TestMeanShift): File file:/tmp/mahout-TestMeanShift-7411149851609869312/output/clusters-4-final/part-r-00000 does not exist testSSVDSolverDense(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): Bt job unsuccessful. testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): Bt job unsuccessful. testSSVDSolverPowerIterations2(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): Bt job unsuccessful. testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest): Bt job unsuccessful. testSSVDSolverSparse(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest): Bt job unsuccessful. testTimesVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): File file:/tmp/mahout-TestDistributedRowMatrix-2909158509802629120/testdata/tmpOut does not exist testTimesSquaredVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): File file:/tmp/mahout-TestDistributedRowMatrix-2017354403130612736/testdata/tmpOut does not exist Tests run: 657, Failures: 9, Errors: 13, Skipped: 0 {noformat} > Mahout needs to be made compatible with Hadoop .23 releases > ----------------------------------------------------------- > > Key: MAHOUT-822 > URL: https://issues.apache.org/jira/browse/MAHOUT-822 > Project: Mahout > Issue Type: Improvement > Components: build > Affects Versions: 0.6 > Reporter: Roman Shaposhnik > Attachments: MAHOUT-822-build.patch.txt, MAHOUT-822.patch, > MAHOUT-822.patch, MAHOUT-822.patch > > > As part of the Hadoop stack integration project (Apache Bigtop) we are now > trying to compile Mahout's upcoming 0.6 release against Hadoop 0.22 and 0.23. > I'm attaching the patch to Mahout's Maven build system that made it possible. > I would also like to request help in solving the real issues that poped > up when we tried to compile Mahout: > http://bigtop01.cloudera.org:8080/job/Bigtop-hadoop22/COMPONENT=mahout,label=centos5/6/console > {noformat} > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[182,33] > org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot be > instantiated > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[218,9] > org.apache.mahout.df.mapreduce.partial.Step0JobTest.Step0Context is not > abstract and does not override abstract method getInputSplit() in > org.apache.hadoop.mapreduce.MapContext > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[229,12] > cannot find symbol > [ERROR] symbol : constructor > Context(org.apache.hadoop.conf.Configuration,org.apache.hadoop.mapreduce.TaskAttemptID,<nulltype>,<nulltype>,<nulltype>,<nulltype>,<nulltype>) > [ERROR] location: class org.apache.hadoop.mapreduce.Mapper.Context > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java:[68,18] > org.apache.hadoop.mapreduce.Mapper.Context is abstract; cannot be > instantiated > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java:[77,19] > org.apache.hadoop.mapreduce.Reducer.Context is abstract; cannot be > instantiated > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[110,30] > org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot be > instantiated > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[206,28] > org.apache.hadoop.mapreduce.JobContext is abstract; cannot be instantiated > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[227,30] > org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot be > instantiated > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/MockContext.java:[30,6] > org.apache.mahout.df.mapreduce.partial.MockContext is not abstract and does > not override abstract method getInputSplit() in > org.apache.hadoop.mapreduce.MapContext > [ERROR] > /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/MockContext.java:[38,10] > cannot find symbol > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira