Build failed in Jenkins: Mahout-Quality #2614

2014-05-22 Thread Apache Jenkins Server 
See 

--
[...truncated 7508 lines...]
}

Q=
{
  0  => {0:0.40273861426601687,1:-0.9153150324187648}
  1  => {0:0.9153150324227656,1:0.40273861426427493}
}
- C = A %*% B mapBlock {}
- C = A %*% B incompatible B keys
35578 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are not 
identically partitioned, performing inner join.
- C = At %*% B , join
37019 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are not 
identically partitioned, performing inner join.
- C = At %*% B , join, String-keyed
38443 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are identically 
distributed, performing row-wise zip.
- C = At %*% B , zippable, String-keyed
{
  2  => {0:62.0,1:86.0,3:132.0,2:115.0}
  1  => {0:50.0,1:69.0,3:105.0,2:92.0}
  3  => {0:74.0,1:103.0,3:159.0,2:138.0}
  0  => {0:26.0,1:35.0,3:51.0,2:46.0}
}
- C = A %*% inCoreB
{
  0  => {0:26.0,1:35.0,2:46.0,3:51.0}
  1  => {0:50.0,1:69.0,2:92.0,3:105.0}
  2  => {0:62.0,1:86.0,2:115.0,3:132.0}
  3  => {0:74.0,1:103.0,2:138.0,3:159.0}
}
- C = inCoreA %*%: B
42519 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying slim A'A.
- C = A.t %*% A
44000 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying non-slim non-graph A'A.
75471 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings  - test done.
- C = A.t %*% A fat non-graph
76723 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying slim A'A.
- C = A.t %*% A non-int key
- C = A + B
- C = A + B side test 1
- C = A + B side test 2
- C = A + B side test 3
ArrayBuffer(0, 1, 2, 3, 4)
ArrayBuffer(0, 1, 2, 3, 4)
- general side
- Ax
- A'x
- colSums, colMeans
Run completed in 1 minute, 35 seconds.
Total number of tests run: 38
Suites: completed 9, aborted 0
Tests: succeeded 38, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:remove-project-artifact 
(remove-old-mahout-artifacts) @ mahout-spark ---
[INFO] /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark removed.
[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ mahout-spark ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ mahout-spark ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ 
mahout-spark ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-install-plugin:2.5.1:install (default-install) @ mahout-spark 
---
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT.jar
[INFO] Installing 
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT.pom
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT-tests.jar
[INFO] Installing 

 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] >>> maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark >>>
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ mahout-spark 
---
[INFO] Source directory: 

 added.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ 
mahout-spark ---
[INFO] Test Source directory: 

 added.
[INFO] 
[INFO] <<< maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark <<<
[INFO] 
[INFO] --- maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark ---
[INFO] 
[INFO] --- findbugs-maven-plugi

[jira] [Resolved] (MAHOUT-1556) Mahout for Hadoop2 - HDP2.1.1

2014-05-22 Thread Suneel Marthi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved MAHOUT-1556.
---

Resolution: Not a Problem

> Mahout for Hadoop2 - HDP2.1.1
> -
>
> Key: MAHOUT-1556
> URL: https://issues.apache.org/jira/browse/MAHOUT-1556
> Project: Mahout
>  Issue Type: Dependency upgrade
>  Components: Integration
>Affects Versions: 0.9
> Environment: Ubuntu 12.04, Centos6, Java Oracle 1.7
>Reporter: Prabhat K Singh
>  Labels: hadoop2
> Fix For: 0.9
>
>
> Hi, 
> I tried build and install of Mahout0.9 for hadoop HDP2.1.1 as per given 
> methods in https://issues.apache.org/jira/browse/MAHOUT-1329, but I get 
> errors as mentioned below.
> Method:
> mvn clean package  -Dhadoop.profile=200  -Dhadoop2.version=2.2.0 
> -Dhbase.version=0.98
> mvn clean install -Dhadoop2 -Dhadoop.2.version=2.2.0
> mvn clean package -Dhadoop2 -Dhadoop.profile=200  -Dhadoop2.version=2.4.0 
> -Dhbase.version=0.98
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) 
> on project mahout-integration: Compilation failure: Compilation failure:
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[30,31]
>  cannot find symbol
> [ERROR] symbol:   class HBaseConfiguration
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[33,31]
>  cannot find symbol
> [ERROR] symbol:   class KeyValue
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[47,36]
>  cannot find symbol
> [ERROR] symbol:   class Bytes
> [ERROR] location: package org.apache.hadoop.hbase.util
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[91,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[92,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[107,26]
>  cannot find symbol
> [ERROR] symbol:   variable HBaseConfiguration
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[138,51]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[206,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[207,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[233,15]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[265,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[266,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[278,31]
>  cannot find symbol
> [ERROR] symb

[jira] [Commented] (MAHOUT-1556) Mahout for Hadoop2 - HDP2.1.1

2014-05-22 Thread Suneel Marthi (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006563#comment-14006563
 ] 

Suneel Marthi commented on MAHOUT-1556:
---

Snapshot's presently H1 by default, there is another JIRA open about H2 
compatibility and will be setting the default to H2 as part of that. This jira 
can be resolved. 

> Mahout for Hadoop2 - HDP2.1.1
> -
>
> Key: MAHOUT-1556
> URL: https://issues.apache.org/jira/browse/MAHOUT-1556
> Project: Mahout
>  Issue Type: Dependency upgrade
>  Components: Integration
>Affects Versions: 0.9
> Environment: Ubuntu 12.04, Centos6, Java Oracle 1.7
>Reporter: Prabhat K Singh
>  Labels: hadoop2
> Fix For: 0.9
>
>
> Hi, 
> I tried build and install of Mahout0.9 for hadoop HDP2.1.1 as per given 
> methods in https://issues.apache.org/jira/browse/MAHOUT-1329, but I get 
> errors as mentioned below.
> Method:
> mvn clean package  -Dhadoop.profile=200  -Dhadoop2.version=2.2.0 
> -Dhbase.version=0.98
> mvn clean install -Dhadoop2 -Dhadoop.2.version=2.2.0
> mvn clean package -Dhadoop2 -Dhadoop.profile=200  -Dhadoop2.version=2.4.0 
> -Dhbase.version=0.98
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) 
> on project mahout-integration: Compilation failure: Compilation failure:
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[30,31]
>  cannot find symbol
> [ERROR] symbol:   class HBaseConfiguration
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[33,31]
>  cannot find symbol
> [ERROR] symbol:   class KeyValue
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[47,36]
>  cannot find symbol
> [ERROR] symbol:   class Bytes
> [ERROR] location: package org.apache.hadoop.hbase.util
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[91,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[92,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[107,26]
>  cannot find symbol
> [ERROR] symbol:   variable HBaseConfiguration
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[138,51]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[206,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[207,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[233,15]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[265,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[266,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDa

Re: Git Migration

2014-05-22 Thread Ted Dunning 

I will check as soon as I can.  That won't be soon since I am currently on a 
plane stuck by weather in the wrong place. No idea when I will able to touch 
the internet again. 

Sent from my iPhone

> On May 22, 2014, at 13:55, Dmitriy Lyubimov  wrote:
> 
> At this point I simply would like everyone to verify they can push commits
> to master branch of git-wp-us.a.o per instructions in INFRA- and report
> back there (I can push).

Re: Git Migration

2014-05-22 Thread Ted Dunning 

Wow.  Quick 

We also need web site updates quickly. 

Sent from my iPhone

> On May 22, 2014, at 13:14, Dmitriy Lyubimov  wrote:
> 
> Hi,
> 
> (1) git migration of the project is now complete. Any volunteers to verify
> per INFRA-? If you do, please report back to the issue.
> 
> (2) Anybody knows what to do with jenkins now? i still don't have proper
> privileges on it. thanks.
> 
> 
> 
> [1] https://issues.apache.org/jira/browse/INFRA-

Build failed in Jenkins: Mahout-Quality #2613

2014-05-22 Thread Apache Jenkins Server 
See 

--
[...truncated 6520 lines...]

Q=
{
  0  => {0:0.40273861426601687,1:-0.9153150324187648}
  1  => {0:0.9153150324227656,1:0.40273861426427493}
}
- C = A %*% B mapBlock {}
- C = A %*% B incompatible B keys
35396 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are not 
identically partitioned, performing inner join.
- C = At %*% B , join
36836 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are not 
identically partitioned, performing inner join.
- C = At %*% B , join, String-keyed
38442 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtB$  - A and B for A'B are identically 
distributed, performing row-wise zip.
- C = At %*% B , zippable, String-keyed
{
  2  => {0:62.0,1:86.0,3:132.0,2:115.0}
  1  => {0:50.0,1:69.0,3:105.0,2:92.0}
  3  => {0:74.0,1:103.0,3:159.0,2:138.0}
  0  => {0:26.0,1:35.0,3:51.0,2:46.0}
}
- C = A %*% inCoreB
{
  0  => {0:26.0,1:35.0,2:46.0,3:51.0}
  1  => {0:50.0,1:69.0,2:92.0,3:105.0}
  2  => {0:62.0,1:86.0,2:115.0,3:132.0}
  3  => {0:74.0,1:103.0,2:138.0,3:159.0}
}
- C = inCoreA %*%: B
42507 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying slim A'A.
- C = A.t %*% A
43987 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying non-slim non-graph A'A.
76582 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings  - test done.
- C = A.t %*% A fat non-graph
77834 [ScalaTest-main-running-RLikeDrmOpsSuite] DEBUG 
org.apache.mahout.sparkbindings.blas.AtA$  - Applying slim A'A.
- C = A.t %*% A non-int key
- C = A + B
- C = A + B side test 1
- C = A + B side test 2
- C = A + B side test 3
ArrayBuffer(0, 1, 2, 3, 4)
ArrayBuffer(0, 1, 2, 3, 4)
- general side
- Ax
- A'x
- colSums, colMeans
Run completed in 1 minute, 36 seconds.
Total number of tests run: 38
Suites: completed 9, aborted 0
Tests: succeeded 38, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:remove-project-artifact 
(remove-old-mahout-artifacts) @ mahout-spark ---
[INFO] /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark removed.
[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ mahout-spark ---
[INFO] Building jar: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/mahout-spark-1.0-SNAPSHOT.jar
[INFO] 
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ mahout-spark ---
[INFO] Building jar: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/mahout-spark-1.0-SNAPSHOT-tests.jar
[INFO] 
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ 
mahout-spark ---
[INFO] Building jar: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/mahout-spark-1.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] --- maven-install-plugin:2.5.1:install (default-install) @ mahout-spark 
---
[INFO] Installing 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/mahout-spark-1.0-SNAPSHOT.jar
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT.jar
[INFO] Installing 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/pom.xml to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT.pom
[INFO] Installing 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/mahout-spark-1.0-SNAPSHOT-tests.jar
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT-tests.jar
[INFO] Installing 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/mahout-spark-1.0-SNAPSHOT-sources.jar
 to 
/home/jenkins/.m2/repository/org/apache/mahout/mahout-spark/1.0-SNAPSHOT/mahout-spark-1.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] >>> maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark >>>
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ mahout-spark 
---
[INFO] Source directory: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/generated-sources/mahout
 added.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ 
mahout-spark ---
[INFO] Test Source directory: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark/target/generated-test-sources/mahout
 added.
[INFO] 
[INFO] <<< maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark <<<
[INFO] 
[INFO] --- maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark ---
[INFO] 
[INFO] --- findbugs-maven-plugin:2.5.2:findbugs (default-cli) @ mahout-spark ---

Re: Git Migration

2014-05-22 Thread Shannon Quinn 

Works for me.

Shannon

On 5/22/14, 3:45 PM, Gokhan Capan wrote:

Works for me as well

Gokhan


On Thu, May 22, 2014 at 9:23 PM, Andrew Musselman <
andrew.mussel...@gmail.com> wrote:


Thanks; I just pushed successfully.


On Thu, May 22, 2014 at 10:55 AM, Dmitriy Lyubimov 
wrote:
did you read Jake's email earlier at dev/infra discussion? he describes

and

makes references here.

It is two-fold: first  we can push whatever commits to master of
https://git-wip-us.apache.org/repos/asf?p=mahout.git

However the other side of the coin is that significant commits should go
thru pull requests directly to (if i understand it correctly)

apache/mahout

mirror on github. Such pull requests are managed thru commits to git-wp

as

well by specific messages (again, see references in Jake's email). My
understanding is that github integration features are not yet enabled,

only

commits to master of git-wp-us.a.o are at this point.

At this point I simply would like everyone to verify they can push

commits

to master branch of git-wp-us.a.o per instructions in INFRA- and

report

back there (I can push).

I guess someone (perhaps me) will have to write the manual for working

with

github pull requests (mainly, merging them to git-wp-us.o.a and closing
them).


On Thu, May 22, 2014 at 10:47 AM, Andrew Musselman <
andrew.mussel...@gmail.com> wrote:


What's the workflow to commit a change?  I'm totally in the dark about
that.


On Thu, May 22, 2014 at 10:14 AM, Dmitriy Lyubimov 
wrote:
Hi,

(1) git migration of the project is now complete. Any volunteers to

verify

per INFRA-? If you do, please report back to the issue.

(2) Anybody knows what to do with jenkins now? i still don't have

proper

privileges on it. thanks.



[1] https://issues.apache.org/jira/browse/INFRA-

Re: Git Migration

2014-05-22 Thread Dmitriy Lyubimov 
working on Quality build, it is still failing for the moment.


On Thu, May 22, 2014 at 1:15 PM, Dmitriy Lyubimov  wrote:

> updated Jenkins nightly build. build succeeded.
>

Build failed in Jenkins: Mahout-Quality #2612

2014-05-22 Thread Apache Jenkins Server 
See 

--
[...truncated 10939 lines...]
6858/7312 KB   
6862/7312 KB   
6866/7312 KB   
6870/7312 KB   
6874/7312 KB   
6878/7312 KB   
6882/7312 KB   
6886/7312 KB   
6890/7312 KB   
6894/7312 KB   
6898/7312 KB   
6902/7312 KB   
6906/7312 KB   
6910/7312 KB   
6914/7312 KB   
6918/7312 KB   
6922/7312 KB   
6926/7312 KB   
6930/7312 KB   
6934/7312 KB   
6938/7312 KB   
6942/7312 KB   
6946/7312 KB   
6950/7312 KB   
6954/7312 KB   
6958/7312 KB   
6962/7312 KB   
6966/7312 KB   
6970/7312 KB   
6974/7312 KB   
6978/7312 KB   
6982/7312 KB   
6986/7312 KB   
6990/7312 KB   
6994/7312 KB   
6998/7312 KB   
7002/7312 KB   
7006/7312 KB   
7010/7312 KB   
7014/7312 KB   
7018/7312 KB   
7022/7312 KB   
7026/7312 KB   
7030/7312 KB   
7034/7312 KB   
7038/7312 KB   
7042/7312 KB   
7046/7312 KB   
7050/7312 KB   
7054/7312 KB   
7058/7312 KB   
7062/7312 KB   
7066/7312 KB   
7070/7312 KB   
7074/7312 KB   
7078/7312 KB   
7082/7312 KB   
7086/7312 KB   
7090/7312 KB   
7094/7312 KB   
7098/7312 KB   
7102/7312 KB   
7106/7312 KB   
7110/7312 KB   
7114/7312 KB   
7118/7312 KB   
7122/7312 KB   
7126/7312 KB   
7130/7312 KB   
7134/7312 KB   
7138/7312 KB   
7142/7312 KB   
7146/7312 KB   
7150/7312 KB   
7154/7312 KB   
7158/7312 KB   
7162/7312 KB   
7166/7312 KB   
7170/7312 KB   
7174/7312 KB   
7178/7312 KB   
7182/7312 KB   
7186/7312 KB   
7190/7312 KB   
7194/7312 KB   
7198/7312 KB   
7202/7312 KB   
7206/7312 KB   
7210/7312 KB   
7214/7312 KB   
7218/7312 KB   
7222/7312 KB   
7226/7312 KB   
7230/7312 KB   
7234/7312 KB   
7238/7312 KB   
7242/7312 KB   
7246/7312 KB   
7250/7312 KB   
7254/7312 KB   
7258/7312 KB   
7262/7312 KB   
7266/7312 KB   
7270/7312 KB   
7274/7312 KB   
7278/7312 KB   
7282/7312 KB   
7286/7312 KB   
7290/7312 KB   
7294/7312 KB   
7298/7312 KB   
7302/7312 KB   
7306/7312 KB   
7310/7312 KB   
7312/7312 KB   
   
Downloaded: 
http://repo.maven.apache.org/maven2/org/jblas/jblas/1.2.3/jblas-1.2.3.jar (7312 
KB at 19241.4 KB/sec)
[INFO] 
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ mahout-spark-shell 
---
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ 
mahout-spark-shell ---
[INFO] Source directory: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark-shell/target/generated-sources/mahout
 added.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ 
mahout-spark-shell ---
[INFO] Test Source directory: 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark-shell/target/generated-test-sources/mahout
 added.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
mahout-spark-shell ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark-shell/src/main/resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ 
mahout-spark-shell ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-scala-plugin:2.15.2:compile (default) @ mahout-spark-shell ---
[INFO] Checking for multiple versions of scala
[WARNING]  Expected all dependencies to require Scala version: 2.10.3
[WARNING]  com.twitter:chill_2.10:0.3.1 requires scala version: 2.10.0
[WARNING] Multiple versions of scala libraries detected!
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[INFO] 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark-shell/src/main/scala:-1:
 info: compiling
[INFO] Compiling 2 source files to 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark-shell/target/classes 
at 1400790854734
[INFO] prepare-compile in 0 s
[INFO] compile in 6 s
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
mahout-spark-shell ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/home/hudson/jenkins-slave/workspace/Mahout-Quality/spark-shell/src/test/resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
mahout-spark-shell ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-scala-plugin:2.15.2:testCompile (default) @ mahout-spark-shell 
---
[INFO] Checking for multiple versions of scala
[WARNING]  Expected all dependencies to require Scala version: 2.10.3
[WARNING]  com.twitter:chill_2.10:0.3.1 requires scala version: 2.10.0
[WARNING] Multiple versions of scala libraries detected!
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[WARNING] No source files found.
[INFO] 
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ mahout-spark-shell 
---
[INFO] 
[INFO] --- scalatest-maven-plugin:1.0-M2:test (test) @ mahout-spark-shell ---
WARNING: -p has been deprecated and will be reused for a different (but still 
very cool) purpose in ScalaTest 2.0. Please change all uses of -p to -R.
Discovery starting.
[

Re: Git Migration

2014-05-22 Thread Dmitriy Lyubimov 
updated Jenkins nightly build. build succeeded.

Re: Git Migration

2014-05-22 Thread Gokhan Capan 
Works for me as well

Gokhan


On Thu, May 22, 2014 at 9:23 PM, Andrew Musselman <
andrew.mussel...@gmail.com> wrote:

> Thanks; I just pushed successfully.
>
>
> On Thu, May 22, 2014 at 10:55 AM, Dmitriy Lyubimov  >wrote:
>
> > did you read Jake's email earlier at dev/infra discussion? he describes
> and
> > makes references here.
> >
> > It is two-fold: first  we can push whatever commits to master of
> > https://git-wip-us.apache.org/repos/asf?p=mahout.git
> >
> > However the other side of the coin is that significant commits should go
> > thru pull requests directly to (if i understand it correctly)
> apache/mahout
> > mirror on github. Such pull requests are managed thru commits to git-wp
> as
> > well by specific messages (again, see references in Jake's email). My
> > understanding is that github integration features are not yet enabled,
> only
> > commits to master of git-wp-us.a.o are at this point.
> >
> > At this point I simply would like everyone to verify they can push
> commits
> > to master branch of git-wp-us.a.o per instructions in INFRA- and
> report
> > back there (I can push).
> >
> > I guess someone (perhaps me) will have to write the manual for working
> with
> > github pull requests (mainly, merging them to git-wp-us.o.a and closing
> > them).
> >
> >
> > On Thu, May 22, 2014 at 10:47 AM, Andrew Musselman <
> > andrew.mussel...@gmail.com> wrote:
> >
> > > What's the workflow to commit a change?  I'm totally in the dark about
> > > that.
> > >
> > >
> > > On Thu, May 22, 2014 at 10:14 AM, Dmitriy Lyubimov  > > >wrote:
> > >
> > > > Hi,
> > > >
> > > > (1) git migration of the project is now complete. Any volunteers to
> > > verify
> > > > per INFRA-? If you do, please report back to the issue.
> > > >
> > > > (2) Anybody knows what to do with jenkins now? i still don't have
> > proper
> > > > privileges on it. thanks.
> > > >
> > > >
> > > >
> > > > [1] https://issues.apache.org/jira/browse/INFRA-
> > > >
> > >
> >
>

Re: Git Migration

2014-05-22 Thread Andrew Musselman 
Thanks; I just pushed successfully.


On Thu, May 22, 2014 at 10:55 AM, Dmitriy Lyubimov wrote:

> did you read Jake's email earlier at dev/infra discussion? he describes and
> makes references here.
>
> It is two-fold: first  we can push whatever commits to master of
> https://git-wip-us.apache.org/repos/asf?p=mahout.git
>
> However the other side of the coin is that significant commits should go
> thru pull requests directly to (if i understand it correctly) apache/mahout
> mirror on github. Such pull requests are managed thru commits to git-wp as
> well by specific messages (again, see references in Jake's email). My
> understanding is that github integration features are not yet enabled, only
> commits to master of git-wp-us.a.o are at this point.
>
> At this point I simply would like everyone to verify they can push commits
> to master branch of git-wp-us.a.o per instructions in INFRA- and report
> back there (I can push).
>
> I guess someone (perhaps me) will have to write the manual for working with
> github pull requests (mainly, merging them to git-wp-us.o.a and closing
> them).
>
>
> On Thu, May 22, 2014 at 10:47 AM, Andrew Musselman <
> andrew.mussel...@gmail.com> wrote:
>
> > What's the workflow to commit a change?  I'm totally in the dark about
> > that.
> >
> >
> > On Thu, May 22, 2014 at 10:14 AM, Dmitriy Lyubimov  > >wrote:
> >
> > > Hi,
> > >
> > > (1) git migration of the project is now complete. Any volunteers to
> > verify
> > > per INFRA-? If you do, please report back to the issue.
> > >
> > > (2) Anybody knows what to do with jenkins now? i still don't have
> proper
> > > privileges on it. thanks.
> > >
> > >
> > >
> > > [1] https://issues.apache.org/jira/browse/INFRA-
> > >
> >
>

Re: Git Migration

2014-05-22 Thread Dmitriy Lyubimov 
did you read Jake's email earlier at dev/infra discussion? he describes and
makes references here.

It is two-fold: first  we can push whatever commits to master of
https://git-wip-us.apache.org/repos/asf?p=mahout.git

However the other side of the coin is that significant commits should go
thru pull requests directly to (if i understand it correctly) apache/mahout
mirror on github. Such pull requests are managed thru commits to git-wp as
well by specific messages (again, see references in Jake's email). My
understanding is that github integration features are not yet enabled, only
commits to master of git-wp-us.a.o are at this point.

At this point I simply would like everyone to verify they can push commits
to master branch of git-wp-us.a.o per instructions in INFRA- and report
back there (I can push).

I guess someone (perhaps me) will have to write the manual for working with
github pull requests (mainly, merging them to git-wp-us.o.a and closing
them).


On Thu, May 22, 2014 at 10:47 AM, Andrew Musselman <
andrew.mussel...@gmail.com> wrote:

> What's the workflow to commit a change?  I'm totally in the dark about
> that.
>
>
> On Thu, May 22, 2014 at 10:14 AM, Dmitriy Lyubimov  >wrote:
>
> > Hi,
> >
> > (1) git migration of the project is now complete. Any volunteers to
> verify
> > per INFRA-? If you do, please report back to the issue.
> >
> > (2) Anybody knows what to do with jenkins now? i still don't have proper
> > privileges on it. thanks.
> >
> >
> >
> > [1] https://issues.apache.org/jira/browse/INFRA-
> >
>

Re: Git Migration

2014-05-22 Thread Andrew Musselman 
What's the workflow to commit a change?  I'm totally in the dark about that.


On Thu, May 22, 2014 at 10:14 AM, Dmitriy Lyubimov wrote:

> Hi,
>
> (1) git migration of the project is now complete. Any volunteers to verify
> per INFRA-? If you do, please report back to the issue.
>
> (2) Anybody knows what to do with jenkins now? i still don't have proper
> privileges on it. thanks.
>
>
>
> [1] https://issues.apache.org/jira/browse/INFRA-
>

Git Migration

2014-05-22 Thread Dmitriy Lyubimov 
Hi,

(1) git migration of the project is now complete. Any volunteers to verify
per INFRA-? If you do, please report back to the issue.

(2) Anybody knows what to do with jenkins now? i still don't have proper
privileges on it. thanks.



[1] https://issues.apache.org/jira/browse/INFRA-

[jira] [Reopened] (MAHOUT-1556) Mahout for Hadoop2 - HDP2.1.1

2014-05-22 Thread Pat Ferrel (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pat Ferrel reopened MAHOUT-1556:



Shouldn't snapshot be H2 by default?

> Mahout for Hadoop2 - HDP2.1.1
> -
>
> Key: MAHOUT-1556
> URL: https://issues.apache.org/jira/browse/MAHOUT-1556
> Project: Mahout
>  Issue Type: Dependency upgrade
>  Components: Integration
>Affects Versions: 0.9
> Environment: Ubuntu 12.04, Centos6, Java Oracle 1.7
>Reporter: Prabhat K Singh
>  Labels: hadoop2
> Fix For: 0.9
>
>
> Hi, 
> I tried build and install of Mahout0.9 for hadoop HDP2.1.1 as per given 
> methods in https://issues.apache.org/jira/browse/MAHOUT-1329, but I get 
> errors as mentioned below.
> Method:
> mvn clean package  -Dhadoop.profile=200  -Dhadoop2.version=2.2.0 
> -Dhbase.version=0.98
> mvn clean install -Dhadoop2 -Dhadoop.2.version=2.2.0
> mvn clean package -Dhadoop2 -Dhadoop.profile=200  -Dhadoop2.version=2.4.0 
> -Dhbase.version=0.98
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) 
> on project mahout-integration: Compilation failure: Compilation failure:
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[30,31]
>  cannot find symbol
> [ERROR] symbol:   class HBaseConfiguration
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[33,31]
>  cannot find symbol
> [ERROR] symbol:   class KeyValue
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[47,36]
>  cannot find symbol
> [ERROR] symbol:   class Bytes
> [ERROR] location: package org.apache.hadoop.hbase.util
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[91,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[92,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[107,26]
>  cannot find symbol
> [ERROR] symbol:   variable HBaseConfiguration
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[138,51]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[206,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[207,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[233,15]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[265,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[266,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[278,31]
>  cannot find symbol
> [ERROR] sy

[jira] [Commented] (MAHOUT-1541) Create CLI Driver for Spark Cooccurrence Analysis

2014-05-22 Thread Pat Ferrel (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006042#comment-14006042
 ] 

Pat Ferrel commented on MAHOUT-1541:


Current design ends up with some sorta ugly code but I think the file schema 
can be factored out to simplify things. Hold off on comments until I have a 
chance to do this.

> Create CLI Driver for Spark Cooccurrence Analysis
> -
>
> Key: MAHOUT-1541
> URL: https://issues.apache.org/jira/browse/MAHOUT-1541
> Project: Mahout
>  Issue Type: Bug
>  Components: CLI
>Reporter: Pat Ferrel
>Assignee: Pat Ferrel
>
> Create a CLI driver to import data in a flexible manner, create an 
> IndexedDataset with BiMap ID translation dictionaries, call the Spark 
> CooccurrenceAnalysis with the appropriate params, then write output with 
> external IDs optionally reattached.
> Ultimately it should be able to read input as the legacy mr does but will 
> support reading externally defined IDs and flexible formats. Output will be 
> of the legacy format or text files of the user's specification with 
> reattached Item IDs. 
> Support for legacy formats is a question, users can always use the legacy 
> code if they want this. Internal to the IndexedDataset is a Spark DRM so 
> pipelining can be accomplished without any writing to an actual file so the 
> legacy sequence file output may not be needed.
> Opinions?



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Commented] (MAHOUT-1464) Cooccurrence Analysis on Spark

2014-05-22 Thread Pat Ferrel (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006038#comment-14006038
 ] 

Pat Ferrel commented on MAHOUT-1464:


Agreed about LLR. Never saw it underperform the other measures for CF.

I'm using a very small dataset with minSplits = 2 so I can check the actual 
values. Then running the epinions, which I can't really check for value. 
Testing is going through the ItemSimilarityDriver from MAHOUT-1541 so the write 
is not using your patch. 

Unfortunately I lied. Works with HDFS in and out but on a multi-threaded 
local[4] standalone Spark. Setting to my cluster master still fails. The error 
message is about connection refused so there is something is still not 
configured correctly on my cluster. I had to use fully qualified URIs to the 
data because Spark was defaulting to the wrong locations. All pointing to a bad 
Spark build or conf. Spark-shell seems to work fine on the cluster. Anyway, 
I'll reinstall Spark and try again. Sorry for the false alarm.

> Cooccurrence Analysis on Spark
> --
>
> Key: MAHOUT-1464
> URL: https://issues.apache.org/jira/browse/MAHOUT-1464
> Project: Mahout
>  Issue Type: Improvement
>  Components: Collaborative Filtering
> Environment: hadoop, spark
>Reporter: Pat Ferrel
>Assignee: Sebastian Schelter
> Fix For: 1.0
>
> Attachments: MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, 
> MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, run-spark-xrsj.sh
>
>
> Create a version of Cooccurrence Analysis (RowSimilarityJob with LLR) that 
> runs on Spark. This should be compatible with Mahout Spark DRM DSL so a DRM 
> can be used as input. 
> Ideally this would extend to cover MAHOUT-1422. This cross-cooccurrence has 
> several applications including cross-action recommendations. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Resolved] (MAHOUT-1556) Mahout for Hadoop2 - HDP2.1.1

2014-05-22 Thread Prabhat K Singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhat K Singh resolved MAHOUT-1556.
-

Resolution: Done

This works for HDP 2.1.1 on Ubuntu 12.04 and CentOS6

mvn clean package -Dhadoop2  -Dhadoop2.version=2.2.0  
-Dhbase.version=0.98.0-hadoop2

Thanks

> Mahout for Hadoop2 - HDP2.1.1
> -
>
> Key: MAHOUT-1556
> URL: https://issues.apache.org/jira/browse/MAHOUT-1556
> Project: Mahout
>  Issue Type: Dependency upgrade
>  Components: Integration
>Affects Versions: 0.9
> Environment: Ubuntu 12.04, Centos6, Java Oracle 1.7
>Reporter: Prabhat K Singh
>  Labels: hadoop2
> Fix For: 0.9
>
>
> Hi, 
> I tried build and install of Mahout0.9 for hadoop HDP2.1.1 as per given 
> methods in https://issues.apache.org/jira/browse/MAHOUT-1329, but I get 
> errors as mentioned below.
> Method:
> mvn clean package  -Dhadoop.profile=200  -Dhadoop2.version=2.2.0 
> -Dhbase.version=0.98
> mvn clean install -Dhadoop2 -Dhadoop.2.version=2.2.0
> mvn clean package -Dhadoop2 -Dhadoop.profile=200  -Dhadoop2.version=2.4.0 
> -Dhbase.version=0.98
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) 
> on project mahout-integration: Compilation failure: Compilation failure:
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[30,31]
>  cannot find symbol
> [ERROR] symbol:   class HBaseConfiguration
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[33,31]
>  cannot find symbol
> [ERROR] symbol:   class KeyValue
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[47,36]
>  cannot find symbol
> [ERROR] symbol:   class Bytes
> [ERROR] location: package org.apache.hadoop.hbase.util
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[91,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[92,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[107,26]
>  cannot find symbol
> [ERROR] symbol:   variable HBaseConfiguration
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[138,51]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[206,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[207,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[233,15]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[265,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[266,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribu

[jira] [Commented] (MAHOUT-1329) Mahout for hadoop 2

2014-05-22 Thread Gokhan Capan (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005719#comment-14005719
 ] 

Gokhan Capan commented on MAHOUT-1329:
--

Please check http://mahout.apache.org/developers/buildingmahout.html for 
instructions to build mahout against to hadoop-2

> Mahout for hadoop 2
> ---
>
> Key: MAHOUT-1329
> URL: https://issues.apache.org/jira/browse/MAHOUT-1329
> Project: Mahout
>  Issue Type: Task
>  Components: build
>Affects Versions: 0.9
>Reporter: Sergey Svinarchuk
>Assignee: Gokhan Capan
>  Labels: patch
> Fix For: 1.0
>
> Attachments: 1329-2.patch, 1329-3-additional.patch, 1329-3.patch, 
> 1329.patch
>
>
> Update mahout for work with hadoop 2.X, targeting this for Mahout 1.0.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Commented] (MAHOUT-1556) Mahout for Hadoop2 - HDP2.1.1

2014-05-22 Thread Sebastian Schelter (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005720#comment-14005720
 ] 

Sebastian Schelter commented on MAHOUT-1556:


You have to use the trunk version, 0.9 does not have the support for Hadoop 2 
yet.

This page has infos on how to build mahout for Hadoop 2: 
https://mahout.apache.org/developers/buildingmahout.html

Let us know if that doesn't work for you.

> Mahout for Hadoop2 - HDP2.1.1
> -
>
> Key: MAHOUT-1556
> URL: https://issues.apache.org/jira/browse/MAHOUT-1556
> Project: Mahout
>  Issue Type: Dependency upgrade
>  Components: Integration
>Affects Versions: 0.9
> Environment: Ubuntu 12.04, Centos6, Java Oracle 1.7
>Reporter: Prabhat K Singh
>  Labels: hadoop2
> Fix For: 0.9
>
>
> Hi, 
> I tried build and install of Mahout0.9 for hadoop HDP2.1.1 as per given 
> methods in https://issues.apache.org/jira/browse/MAHOUT-1329, but I get 
> errors as mentioned below.
> Method:
> mvn clean package  -Dhadoop.profile=200  -Dhadoop2.version=2.2.0 
> -Dhbase.version=0.98
> mvn clean install -Dhadoop2 -Dhadoop.2.version=2.2.0
> mvn clean package -Dhadoop2 -Dhadoop.profile=200  -Dhadoop2.version=2.4.0 
> -Dhbase.version=0.98
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) 
> on project mahout-integration: Compilation failure: Compilation failure:
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[30,31]
>  cannot find symbol
> [ERROR] symbol:   class HBaseConfiguration
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[33,31]
>  cannot find symbol
> [ERROR] symbol:   class KeyValue
> [ERROR] location: package org.apache.hadoop.hbase
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[47,36]
>  cannot find symbol
> [ERROR] symbol:   class Bytes
> [ERROR] location: package org.apache.hadoop.hbase.util
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[91,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[92,42]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[107,26]
>  cannot find symbol
> [ERROR] symbol:   variable HBaseConfiguration
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[138,51]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[206,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[207,25]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[233,15]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[265,26]
>  cannot find symbol
> [ERROR] symbol:   variable Bytes
> [ERROR] location: class 
> org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
> [ERROR] 
> /home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[266,25]
>  cannot find symbol
> [ERROR] symbol:   variable Byte

[jira] [Created] (MAHOUT-1556) Mahout for Hadoop2 - HDP2.1.1

2014-05-22 Thread Prabhat K Singh (JIRA) 
Prabhat K Singh created MAHOUT-1556:
---

 Summary: Mahout for Hadoop2 - HDP2.1.1
 Key: MAHOUT-1556
 URL: https://issues.apache.org/jira/browse/MAHOUT-1556
 Project: Mahout
  Issue Type: Dependency upgrade
  Components: Integration
Affects Versions: 0.9
 Environment: Ubuntu 12.04, Centos6, Java Oracle 1.7
Reporter: Prabhat K Singh
 Fix For: 0.9


Hi, 

I tried build and install of Mahout0.9 for hadoop HDP2.1.1 as per given methods 
in https://issues.apache.org/jira/browse/MAHOUT-1329, but I get errors as 
mentioned below.
Method:
mvn clean package  -Dhadoop.profile=200  -Dhadoop2.version=2.2.0 
-Dhbase.version=0.98
mvn clean install -Dhadoop2 -Dhadoop.2.version=2.2.0
mvn clean package -Dhadoop2 -Dhadoop.profile=200  -Dhadoop2.version=2.4.0 
-Dhbase.version=0.98


[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on 
project mahout-integration: Compilation failure: Compilation failure:
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[30,31]
 cannot find symbol
[ERROR] symbol:   class HBaseConfiguration
[ERROR] location: package org.apache.hadoop.hbase
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[33,31]
 cannot find symbol
[ERROR] symbol:   class KeyValue
[ERROR] location: package org.apache.hadoop.hbase
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[47,36]
 cannot find symbol
[ERROR] symbol:   class Bytes
[ERROR] location: package org.apache.hadoop.hbase.util
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[91,42]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[92,42]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[107,26]
 cannot find symbol
[ERROR] symbol:   variable HBaseConfiguration
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[138,51]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[206,26]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[207,25]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[233,15]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[265,26]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[266,25]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[278,31]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBaseDataModel
[ERROR] 
/home/user1/aws/mahout-distribution-0.9/integration/src/main/java/org/apache/mahout/cf/taste/impl/model/hbase/HBaseDataModel.java:[289,41]
 cannot find symbol
[ERROR] symbol:   variable Bytes
[ERROR] location: class 
org.apache.mahout.cf.taste.impl.model.hbase.HBase

[jira] [Commented] (MAHOUT-1534) Add documentation for using Mahout with Hadoop2 to the website

2014-05-22 Thread Sebastian Schelter (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005681#comment-14005681
 ] 

Sebastian Schelter commented on MAHOUT-1534:


Looks good, I think we should also mention the skipTests option for packaging 
and add a news entry for that.

> Add documentation for using Mahout with Hadoop2 to the website
> --
>
> Key: MAHOUT-1534
> URL: https://issues.apache.org/jira/browse/MAHOUT-1534
> Project: Mahout
>  Issue Type: Task
>  Components: Documentation
>Reporter: Sebastian Schelter
>Assignee: Gokhan Capan
> Fix For: 1.0
>
>
> MAHOUT-1329 describes how to build the current trunk for usage with Hadoop 2. 
> We should have a page on the website describing this for our users.



--
This message was sent by Atlassian JIRA
(v6.2#6252)