date:20140513

[jira] [Comment Edited] (MAHOUT-1550) Naive Bayes training fails with Hadoop 2

2014-05-13 Thread Gokhan Capan (JIRA)


[ 
https://issues.apache.org/jira/browse/MAHOUT-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996351#comment-13996351
 ] 

Gokhan Capan edited comment on MAHOUT-1550 at 5/13/14 1:10 PM:
---

Paul,

Did you try building mahout using hadoop 2 profile first? The way to do it is:
mvn clean package -DskipTests=true -Dhadoop2.version=

Let us know if this fails


was (Author: gokhancapan):
Paul,

Did you try build mahout using hadoop 2 profile first? The way to do it is:
mvn clean package -DskipTests=true -Dhadoop2.version=

Let us know if this fails

> Naive Bayes training fails with Hadoop 2
> 
>
> Key: MAHOUT-1550
> URL: https://issues.apache.org/jira/browse/MAHOUT-1550
> Project: Mahout
>  Issue Type: Bug
>  Components: Math
>Affects Versions: 1.0
> Environment: Ubuntu - Mahout 1.0-SNAPSHOT - Hadoop 2
>Reporter: Paul Marret
>Priority: Minor
>  Labels: bayesian, training
> Attachments: mahout-snapshot.patch, stacktrace.txt
>
>   Original Estimate: 0h
>  Remaining Estimate: 0h
>
> When using the trainnb option of the program, we get the following error:
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found 
> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
> at 
> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
> at 
> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> at 
> org.apache.mahout.classifier.naivebayes.training.TrainNaiveBayesJob.run(TrainNaiveBayesJob.java:100)
> [...]
> It is possible to correct this by modifying the file 
> mrlegacy/src/main/java/org/apache/mahout/common/HadoopUtil.java and 
> converting the instance job (line 174) to a Job object (it is a JobContext in 
> the current version).



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Build failed in Jenkins: Mahout-Quality #2607

2014-05-13 Thread Apache Jenkins Server

See 

--
[...truncated 8423 lines...]
}

Q=
{
  0  => {0:0.40273861426601687,1:-0.9153150324187648}
  1  => {0:0.9153150324227656,1:0.40273861426427493}
}
[32m- C = A %*% B mapBlock {}[0m
[32m- C = A %*% B incompatible B keys[0m
32473 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are not 
identically partitioned, performing inner join.
[32m- C = At %*% B , join[0m
33882 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are not 
identically partitioned, performing inner join.
[32m- C = At %*% B , join, String-keyed[0m
35254 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are identically 
distributed, performing row-wise zip.
[32m- C = At %*% B , zippable, String-keyed[0m
{
  2  => {0:62.0,1:86.0,3:132.0,2:115.0}
  1  => {0:50.0,1:69.0,3:105.0,2:92.0}
  3  => {0:74.0,1:103.0,3:159.0,2:138.0}
  0  => {0:26.0,1:35.0,3:51.0,2:46.0}
}
[32m- C = A %*% inCoreB[0m
{
  0  => {0:26.0,1:35.0,2:46.0,3:51.0}
  1  => {0:50.0,1:69.0,2:92.0,3:105.0}
  2  => {0:62.0,1:86.0,2:115.0,3:132.0}
  3  => {0:74.0,1:103.0,2:138.0,3:159.0}
}
[32m- C = inCoreA %*%: B[0m
39247 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying slim A'A.
[32m- C = A.t %*% A[0m
40689 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying non-slim non-graph A'A.
65764 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings  - test done.
[32m- C = A.t %*% A fat non-graph[0m
67024 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying slim A'A.
[32m- C = A.t %*% A non-int key[0m
[32m- C = A + B[0m
[32m- C = A + B side test 1[0m
[32m- C = A + B side test 2[0m
[32m- C = A + B side test 3[0m
ArrayBuffer(0, 1, 2, 3, 4)
ArrayBuffer(0, 1, 2, 3, 4)
[32m- general side[0m
[32m- Ax[0m
[32m- A'x[0m
[32m- colSums, colMeans[0m
[36mRun completed in 1 minute, 26 seconds.[0m
[36mTotal number of tests run: 38[0m
[36mSuites: completed 9, aborted 0[0m
[36mTests: succeeded 38, failed 0, canceled 0, ignored 0, pending 0[0m
[32mAll tests passed.[0m
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:remove-project-artifact 
(remove-old-mahout-artifacts) @ mahout-spark ---
[INFO] /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark removed.
[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ mahout-spark ---
[INFO] Building jar: 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/mahout-spark-1.0-SNAPSHOT.jar
[INFO] 
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ mahout-spark ---
[INFO] Building jar: 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/mahout-spark-1.0-SNAPSHOT-tests.jar
[INFO] 
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ 
mahout-spark ---
[INFO] Building jar: 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/mahout-spark-1.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] --- maven-install-plugin:2.5.1:install (default-install) @ mahout-spark 
---
[INFO] Installing 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/mahout-spark-1.0-SNAPSHOT.jar
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT.jar
[INFO] Installing 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/pom.xml to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT.pom
[INFO] Installing 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/mahout-spark-1.0-SNAPSHOT-tests.jar
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT-tests.jar
[INFO] Installing 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/mahout-spark-1.0-SNAPSHOT-sources.jar
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] >>> maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark >>>
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ mahout-spark 
---
[INFO] Source directory: 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/generated-sources/mahout
 added.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ 
mahout-spark ---
[INFO] Test Source directory: 
/x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark/target/generated-test-sources/mahout
 added.
[INFO] 
[INFO] <<< maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark <<<
[INFO] 
[INFO] --- maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark ---
[INFO] 
[INFO] --- findbugs-maven-plugin:2

Re: [jira] [Created] (MAHOUT-1550) Naive Bayes training fails with Hadoop 2

2014-05-13 Thread Suneel Marthi

Did u build with Hadoop 2 profile?


Sent from my iPhone

> On May 13, 2014, at 8:56 AM, "Paul Marret (JIRA)"  wrote:
> 
> Paul Marret created MAHOUT-1550:
> ---
> 
> Summary: Naive Bayes training fails with Hadoop 2
> Key: MAHOUT-1550
> URL: https://issues.apache.org/jira/browse/MAHOUT-1550
> Project: Mahout
>  Issue Type: Bug
>  Components: Math
>Affects Versions: 1.0
> Environment: Ubuntu - Mahout 1.0-SNAPSHOT - Hadoop 2
>Reporter: Paul Marret
>Priority: Minor
> 
> 
> When using the trainnb option of the program, we get the following error:
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found 
> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>at 
> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
>at 
> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
>at 
> org.apache.mahout.classifier.naivebayes.training.TrainNaiveBayesJob.run(TrainNaiveBayesJob.java:100)
> [...]
> 
> It is possible to correct this by modifying the file 
> mrlegacy/src/main/java/org/apache/mahout/common/HadoopUtil.java and 
> converting the instance job (line 174) to a Job object (it is a JobContext in 
> the current version).
> 
> 
> 
> --
> This message was sent by Atlassian JIRA
> (v6.2#6252)

[jira] [Created] (MAHOUT-1550) Naive Bayes training fails with Hadoop 2

2014-05-13 Thread Paul Marret (JIRA)

Paul Marret created MAHOUT-1550:
---

 Summary: Naive Bayes training fails with Hadoop 2
 Key: MAHOUT-1550
 URL: https://issues.apache.org/jira/browse/MAHOUT-1550
 Project: Mahout
  Issue Type: Bug
  Components: Math
Affects Versions: 1.0
 Environment: Ubuntu - Mahout 1.0-SNAPSHOT - Hadoop 2
Reporter: Paul Marret
Priority: Minor


When using the trainnb option of the program, we get the following error:
Exception in thread "main" java.lang.IncompatibleClassChangeError: Found 
interface org.apache.hadoop.mapreduce.JobContext, but class was expected
at 
org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
at org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
at 
org.apache.mahout.classifier.naivebayes.training.TrainNaiveBayesJob.run(TrainNaiveBayesJob.java:100)
[...]

It is possible to correct this by modifying the file 
mrlegacy/src/main/java/org/apache/mahout/common/HadoopUtil.java and converting 
the instance job (line 174) to a Job object (it is a JobContext in the current 
version).



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Comment Edited] (MAHOUT-1550) Naive Bayes training fails with Hadoop 2

Build failed in Jenkins: Mahout-Quality #2607

Re: [jira] [Created] (MAHOUT-1550) Naive Bayes training fails with Hadoop 2

[jira] [Created] (MAHOUT-1550) Naive Bayes training fails with Hadoop 2

4 matches

Site Navigation

Mail list logo

Footer information