RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-10 Thread fx MA XIAOJUN 
Hello, every one.

In fact, I installed mahout 0.9 on pseudo mode of cdh5.0.0-beta-2.
Note that mahout 0.9 may be not able to function on YARN.
So I chose MRv1 when installing cdh5.
Installation of mahout 0.9 was easy.
What I had done is to unzip mahout0.9 distribution and add path to /etc/profile.
With mahout 0.9+cdh5 beta2, I tried mahout kmeans. It seems function normally.




Sylvia




-Original Message-
From: Phan, Truong Q [mailto:troung.p...@team.telstra.com]
Sent: Monday, April 07, 2014 2:14 PM
To: Gokhan Capan; user@mahout.apache.org
Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Hi Gokhan,

I still could not build the Mahout out from the trunk.
Please see below for the error.


svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk cd 
mahout-trunk mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0 -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective 
model for org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for 
org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they 
threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer 
support building such malformed projects.
[WARNING]
[INFO] 

[INFO] Reactor Build Order:
[INFO]
[INFO] Mahout Build Tools
[INFO] Apache Mahout
[INFO] Mahout Math
[INFO] Mahout Core
[INFO] Mahout Integration
[INFO] Mahout Examples
[INFO] Mahout Release Package
[INFO] Mahout Math/Scala wrappers
[INFO] Mahout Spark bindings

. CUT OFF LINES

[INFO] 

[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools  SUCCESS [  
7.381 s]
[INFO] Apache Mahout . SUCCESS [  
0.896 s]
[INFO] Mahout Math ... SUCCESS 
[15:38 min]
[INFO] Mahout Core ... FAILURE [  
2.135 s]
[INFO] Mahout Integration  SKIPPED
[INFO] Mahout Examples ... SKIPPED
[INFO] Mahout Release Package  SKIPPED
[INFO] Mahout Math/Scala wrappers  SKIPPED
[INFO] Mahout Spark bindings . SKIPPED
[INFO] 

[INFO] BUILD FAILURE
[INFO] 

[INFO] Total time: 15:50 min
[INFO] Finished at: 2014-04-07T13:35:29+10:00
[INFO] Final Memory: 29M/241M
[INFO] 

[ERROR] Failed to execute goal on project mahout-core: Could not 
resolve dependencies for project 
org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: The following artifacts could 
not be resolved: org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0, 
org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0-cdh5.0.0, 
org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0-cdh5.0.0: Could not 
find artifact org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0 in central 
(http://repo.maven.apache.org/maven2) - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with 
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, 
please read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with 
the command
[ERROR]   mvn goals -rf :mahout-core

Thanks and Regards,
Truong Phan


P+ 61 2 8576 5771
M   + 61 4 1463 7424
Etroung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-06 Thread Phan, Truong Q 
Hi Gokhan,

I still could not build the Mahout out from the trunk.
Please see below for the error.


svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk
cd mahout-trunk
mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0 -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective 
model for org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for 
org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use 
${project.version} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they 
threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer 
support building such malformed projects.
[WARNING]
[INFO] 

[INFO] Reactor Build Order:
[INFO]
[INFO] Mahout Build Tools
[INFO] Apache Mahout
[INFO] Mahout Math
[INFO] Mahout Core
[INFO] Mahout Integration
[INFO] Mahout Examples
[INFO] Mahout Release Package
[INFO] Mahout Math/Scala wrappers
[INFO] Mahout Spark bindings

. CUT OFF LINES

[INFO] 

[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools  SUCCESS [  
7.381 s]
[INFO] Apache Mahout . SUCCESS [  
0.896 s]
[INFO] Mahout Math ... SUCCESS 
[15:38 min]
[INFO] Mahout Core ... FAILURE [  
2.135 s]
[INFO] Mahout Integration  SKIPPED
[INFO] Mahout Examples ... SKIPPED
[INFO] Mahout Release Package  SKIPPED
[INFO] Mahout Math/Scala wrappers  SKIPPED
[INFO] Mahout Spark bindings . SKIPPED
[INFO] 

[INFO] BUILD FAILURE
[INFO] 

[INFO] Total time: 15:50 min
[INFO] Finished at: 2014-04-07T13:35:29+10:00
[INFO] Final Memory: 29M/241M
[INFO] 

[ERROR] Failed to execute goal on project mahout-core: Could not 
resolve dependencies for project 
org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: The following artifacts could 
not be resolved: org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0, 
org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0-cdh5.0.0, 
org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0-cdh5.0.0: Could not 
find artifact org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0 in central 
(http://repo.maven.apache.org/maven2) - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with 
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, 
please read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with 
the command
[ERROR]   mvn goals -rf :mahout-core

Thanks and Regards,
Truong Phan


P+ 61 2 8576 5771
M   + 61 4 1463 7424
Etroung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Gokhan Capan [mailto:gkhn...@gmail.com]
Sent: Saturday, 5 April 2014 1:14 AM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Hi,

Could you try that:
$ svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk $ cd 
mahout-trunk $ mvn package -DskipTests=true -Dhadoop2.version=YOUR_VERSION

Best

Gokhan


On Fri, Apr 4, 2014 at 6:20 AM, Phan, Truong Q troung.p...@team.telstra.com
 wrote:

 Hi

 I have managed to pull down the latest trunk from (
 https://github.com/apache/mahout) but I now having another problem
 with the build from this latest branch (trunk).
 Please

Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-04 Thread Gokhan Capan 

 

 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com



 -Original Message-
 From: Phan, Truong Q [mailto:troung.p...@team.telstra.com]
 Sent: Friday, 4 April 2014 11:03 AM
 To: user@mahout.apache.org
 Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Hi Gokhan,

 I having difficult to checkout the latest trunk using MVN.
 Here is my checkout issue.
 
 $ sudo git config --global http.proxy http://58.162.7.28:3128 $ sudo git
 config --global http.sslVerify false $ sudo git clone
 https://github.com/apache/mahout Cloning into 'mahout'...
 remote: Reusing existing pack: 76730, done.
 remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects: 100%
 (76730/76730), 49.16 MiB | 191 KiB/s, done.
 Resolving deltas: 100% (34682/34682), done.
 warning: remote HEAD refers to nonexistent ref, unable to checkout.
 
 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com



 -Original Message-
 From: Gokhan Capan [mailto:gkhn...@gmail.com]
 Sent: Friday, 4 April 2014 5:50 AM
 To: user@mahout.apache.org
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Could you checkout the latest trunk and build the project again?

 Sent from my iPhone

  On Apr 2, 2014, at 9:50, Sean Owen sro...@gmail.com wrote:
 
  Not sure what's going on there. Your build is somehow internally
  inconsistent at runtime since it fails on the client side due to
  mismatching Hadoop versions. I can start making up increasingly
  unlikely causes, like you are building against local copies of the
  artifacts that are old? Running clean and install should help if so.
 
  You might debug the script to print exactly what it is running.
  On Apr 2, 2014 7:59 AM, Phan, Truong Q
  troung.p...@team.telstra.com
  wrote:
 
  The build was successful with those warning.
 
  I could not run a test case from this website:
  http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.ht
  ml
 
  Here are my run with the error:
 
 
 
 +
  $ pwd
 
  /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
  bution-0.9
 
  $ echo $CLASSPATH
 
  $ echo $PATH
 
  /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
  bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/lo
  cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
 
  $ echo $JAVA_HOME
  /usr/java/jdk1.6.0_32
 
  $ env | grep HAD
  HADOOP_CMD=/usr/bin/hadoop
  HADOOP_HOME=/usr/lib/hadoop
 
  HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh
  5.0.0-beta-1.jar
 
  $ mahout recommenditembased --input mydata.dat --usersFile user.dat
  --numRecommendations 2 --output output/ --similarityClassname
  SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
  /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
  MAHOUT-JOB:
  /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
  bution-0.9/examples/target/mahout-examples-0.9-job.jar
  14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
  {--booleanData=[false], --endPhase=[2147483647],
  --input=[mydata.dat], --maxPrefsInItemSimilarity=[500],
  --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
  --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/],
  --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
  --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
  14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
  {--booleanData=[false], --endPhase=[2147483647],
  --input=[mydata.dat], --minPrefsPerUser=[1],
  --output=[temp/preparePreferenceMatrix],
  --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
  14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is
  deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
  14/04/02 16:52:49 INFO Configuration.deprecation:
  mapred.compress.map.output is deprecated. Instead, use
  mapreduce.map.output.compress
  14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir
  is deprecated. Instead, use
  mapreduce.output.fileoutputformat.outputdir
  Exception in thread main java.lang.IncompatibleClassChangeError:
  Found interface org.apache.hadoop.mapreduce.JobContext, but class was
 expected
 at
 
 org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
 at
  org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
 at
 
 org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70

Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-03 Thread Gokhan Capan 
  www.telstra.com



 -Original Message-
 From: Sean Owen [mailto:sro...@gmail.com]
 Sent: Wednesday, 2 April 2014 4:05 PM
 To: Mahout User List
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Hm, OK something sounds wrong with your directory structure, given the
 warnings. I assumed this was changed. It could be that the .tar.gz
 distribution isn't quite correctly set up for building from source.

 The compilation here is nothing to do with Hadoop. You show a successful
 build; what's the part that fails?

 On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
 Where did I modifying the build?
 Here are my steps of the build.
 I got the source from one of the official mirror website and build it.
 The only one exception here is that I am using the Cloudera CDH 5.0.
 This latest CDHv5.0 might not work with Mahout v0.9.

 ++
 Install Mahout

 $  javac -version
 javac 1.6.0_32

 $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout

 $ wget
 http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution
 -0.9-src.tar.gz

 $ mv mahout-distribution-0.9 mahout-distribution-0.9.old

 $ tar xvf mahout-distribution-0.9-src.tar.gz

 $ cd mahout-distribution-0.9

 $ ls
 bin  buildtools  core  distribution  examples  integration
 LICENSE.txt  math  math-scala  NOTICE.txt  pom.xml  README.txt  src

 $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
 -DskipTests=true [INFO] Scanning for projects...
 

 [INFO]
 --
 --
 [INFO] Reactor Summary:
 [INFO]
 [INFO] Mahout Build Tools  SUCCESS [
 7.235 s] [INFO] Apache Mahout .
 SUCCESS [  1.017 s] [INFO] Mahout Math
 ... SUCCESS [15:46 min] [INFO]
 Mahout Core ... SUCCESS [24:29
 min] [INFO] Mahout Integration 
 SUCCESS [03:38 min] [INFO] Mahout Examples
 ... SUCCESS [02:40 min] [INFO] Mahout
 Release Package  SUCCESS [  0.075 s]
 [INFO] Mahout Math/Scala wrappers  SUCCESS
 [01:12 min] [INFO]
 --
 --
 [INFO] BUILD SUCCESS
 [INFO]
 --
 --
 [INFO] Total time: 47:57 min
 [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
 49M/288M [INFO]
 --
 --


 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com



 -Original Message-
 From: Sean Owen [mailto:sro...@gmail.com]
 Sent: Wednesday, 2 April 2014 3:33 PM
 To: Mahout User List
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 This may be getting to you're-on-your-own-territory since you're
 modifying the build. This error means your directory structure doesn't
 match up with declarations. You said somewhere that the parent of module X
 was Y, but the location given points to the pom of a module that isn't Y.

 On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
 Hi Sean,

 I am trying to build the Mahout again and got some WARNINGs so far.
 Can you give me some hints what I have done wrong here?

 Thanks for your help so far.

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-03 Thread Phan, Truong Q 
Hi Gokhan,

I having difficult to checkout the latest trunk using MVN.
Here is my checkout issue.

$ sudo git config --global http.proxy http://58.162.7.28:3128
$ sudo git config --global http.sslVerify false
$ sudo git clone https://github.com/apache/mahout
Cloning into 'mahout'...
remote: Reusing existing pack: 76730, done.
remote: Total 76730 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (76730/76730), 49.16 MiB | 191 KiB/s, done.
Resolving deltas: 100% (34682/34682), done.
warning: remote HEAD refers to nonexistent ref, unable to checkout.

Thanks and Regards,
Truong Phan


P    + 61 2 8576 5771
M   + 61 4 1463 7424
E    troung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Gokhan Capan [mailto:gkhn...@gmail.com] 
Sent: Friday, 4 April 2014 5:50 AM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Could you checkout the latest trunk and build the project again?

Sent from my iPhone

 On Apr 2, 2014, at 9:50, Sean Owen sro...@gmail.com wrote:

 Not sure what's going on there. Your build is somehow internally 
 inconsistent at runtime since it fails on the client side due to 
 mismatching Hadoop versions. I can start making up increasingly 
 unlikely causes, like you are building against local copies of the 
 artifacts that are old? Running clean and install should help if so.

 You might debug the script to print exactly what it is running.
 On Apr 2, 2014 7:59 AM, Phan, Truong Q 
 troung.p...@team.telstra.com
 wrote:

 The build was successful with those warning.

 I could not run a test case from this website:
 http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.ht
 ml

 Here are my run with the error:


 +
 $ pwd

 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
 bution-0.9

 $ echo $CLASSPATH

 $ echo $PATH

 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
 bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/lo
 cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin

 $ echo $JAVA_HOME
 /usr/java/jdk1.6.0_32

 $ env | grep HAD
 HADOOP_CMD=/usr/bin/hadoop
 HADOOP_HOME=/usr/lib/hadoop

 HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh
 5.0.0-beta-1.jar

 $ mahout recommenditembased --input mydata.dat --usersFile user.dat 
 --numRecommendations 2 --output output/ --similarityClassname 
 SIMILARITY_PEARSON_CORRELATION Running on hadoop, using 
 /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
 MAHOUT-JOB:
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
 bution-0.9/examples/target/mahout-examples-0.9-job.jar
 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
 {--booleanData=[false], --endPhase=[2147483647], 
 --input=[mydata.dat], --maxPrefsInItemSimilarity=[500], 
 --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100], 
 --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/], 
 --similarityClassname=[SIMILARITY_PEARSON_CORRELATION], 
 --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
 {--booleanData=[false], --endPhase=[2147483647], 
 --input=[mydata.dat], --minPrefsPerUser=[1], 
 --output=[temp/preparePreferenceMatrix],
 --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is 
 deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
 14/04/02 16:52:49 INFO Configuration.deprecation:
 mapred.compress.map.output is deprecated. Instead, use 
 mapreduce.map.output.compress
 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir 
 is deprecated. Instead, use 
 mapreduce.output.fileoutputformat.outputdir
 Exception in thread main java.lang.IncompatibleClassChangeError: 
 Found interface org.apache.hadoop.mapreduce.JobContext, but class was 
 expected
at
 org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
at
 org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
at
 org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
 org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
 org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-03 Thread Phan, Truong Q 
 ... SKIPPED
[INFO] Mahout Integration  SKIPPED
[INFO] Mahout Examples ... SKIPPED
[INFO] Mahout Release Package  SKIPPED
[INFO] Mahout Math/Scala wrappers  SKIPPED
[INFO] Mahout Spark bindings . SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 2.495 s
[INFO] Finished at: 2014-04-04T14:04:56+10:00
[INFO] Final Memory: 9M/245M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process (default) on 
project mahout-buildtools: Error finding remote resources manifests: 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
 (No such file or directory) - [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process (default) on 
project mahout-buildtools: Error finding remote resources manifests
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Error finding remote 
resources manifests
at 
org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1185)
at 
org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.execute(ProcessRemoteResourcesMojo.java:500)
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: java.io.FileNotFoundException: 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
 (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.init(FileOutputStream.java:194)
at java.io.FileOutputStream.init(FileOutputStream.java:145)
at java.io.FileWriter.init(FileWriter.java:73)
at 
org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1093)
... 22 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException


Thanks and Regards,
Truong Phan


P+ 61 2 8576 5771
M   + 61 4 1463 7424
Etroung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Phan, Truong Q [mailto:troung.p...@team.telstra.com]
Sent: Friday, 4 April 2014 11:03 AM
To: user@mahout.apache.org
Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Hi Gokhan,

I having difficult to checkout the latest trunk

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-02 Thread Phan, Truong Q 
The build was successful with those warning.

I could not run a test case from this website: 
http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html

Here are my run with the error:

+
$ pwd
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9

$ echo $CLASSPATH

$ echo $PATH
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin

$ echo $JAVA_HOME
/usr/java/jdk1.6.0_32

$ env | grep HAD
HADOOP_CMD=/usr/bin/hadoop
HADOOP_HOME=/usr/lib/hadoop
HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar

$ mahout recommenditembased --input mydata.dat --usersFile user.dat 
--numRecommendations 2 --output output/ --similarityClassname 
SIMILARITY_PEARSON_CORRELATION
Running on hadoop, using /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
MAHOUT-JOB: 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments: 
{--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], 
--maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10], 
--maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1], 
--numRecommendations=[2], --output=[output/], 
--similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0], 
--tempDir=[temp], --usersFile=[user.dat]}
14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments: 
{--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], 
--minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix], 
--ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is 
deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
14/04/02 16:52:49 INFO Configuration.deprecation: mapred.compress.map.output is 
deprecated. Instead, use mapreduce.map.output.compress
14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir is 
deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
Exception in thread main java.lang.IncompatibleClassChangeError: Found 
interface org.apache.hadoop.mapreduce.JobContext, but class was expected
at 
org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
at org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
at 
org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at 
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at 
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
oracle@bpdevdmsdbs01:  
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9 
-


Thanks and Regards,
Truong Phan


P    + 61 2 8576 5771
M   + 61 4 1463 7424
E    troung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Sean Owen [mailto:sro...@gmail.com] 
Sent: Wednesday, 2 April 2014 4:05 PM
To: Mahout User List
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Hm, OK something sounds wrong with your directory structure, given the 
warnings. I assumed this was changed. It could be that the .tar.gz distribution 
isn't quite correctly set up for building from source.

The compilation here is nothing to do with Hadoop. You show a successful build; 
what's the part that fails?

On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q troung.p...@team.telstra.com 
wrote:
 Where did I modifying the build?
 Here are my

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-02 Thread Sean Owen 
 To: Mahout User List
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Hm, OK something sounds wrong with your directory structure, given the
 warnings. I assumed this was changed. It could be that the .tar.gz
 distribution isn't quite correctly set up for building from source.

 The compilation here is nothing to do with Hadoop. You show a successful
 build; what's the part that fails?

 On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
  Where did I modifying the build?
  Here are my steps of the build.
  I got the source from one of the official mirror website and build it.
  The only one exception here is that I am using the Cloudera CDH 5.0.
  This latest CDHv5.0 might not work with Mahout v0.9.
 
  ++
  Install Mahout
 
  $  javac -version
  javac 1.6.0_32
 
  $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
 
  $ wget
  http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution
  -0.9-src.tar.gz
 
  $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
 
  $ tar xvf mahout-distribution-0.9-src.tar.gz
 
  $ cd mahout-distribution-0.9
 
  $ ls
  bin  buildtools  core  distribution  examples  integration
  LICENSE.txt  math  math-scala  NOTICE.txt  pom.xml  README.txt  src
 
  $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
 -DskipTests=true [INFO] Scanning for projects...
  
 
  [INFO]
  --
  --
  [INFO] Reactor Summary:
  [INFO]
  [INFO] Mahout Build Tools  SUCCESS [
  7.235 s] [INFO] Apache Mahout .
  SUCCESS [  1.017 s] [INFO] Mahout Math
  ... SUCCESS [15:46 min] [INFO]
  Mahout Core ... SUCCESS [24:29
  min] [INFO] Mahout Integration 
  SUCCESS [03:38 min] [INFO] Mahout Examples
  ... SUCCESS [02:40 min] [INFO] Mahout
  Release Package  SUCCESS [  0.075 s]
  [INFO] Mahout Math/Scala wrappers  SUCCESS
  [01:12 min] [INFO]
  --
  --
  [INFO] BUILD SUCCESS
  [INFO]
  --
  --
  [INFO] Total time: 47:57 min
  [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
  49M/288M [INFO]
  --
  --
 
 
  Thanks and Regards,
  Truong Phan
 
 
  P+ 61 2 8576 5771
  M   + 61 4 1463 7424
  Etroung.p...@team.telstra.com
  W  www.telstra.com
 
 
 
  -Original Message-
  From: Sean Owen [mailto:sro...@gmail.com]
  Sent: Wednesday, 2 April 2014 3:33 PM
  To: Mahout User List
  Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
 
  This may be getting to you're-on-your-own-territory since you're
 modifying the build. This error means your directory structure doesn't
 match up with declarations. You said somewhere that the parent of module X
 was Y, but the location given points to the pom of a module that isn't Y.
 
  On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
  Hi Sean,
 
  I am trying to build the Mahout again and got some WARNINGs so far.
  Can you give me some hints what I have done wrong here?
 
  Thanks for your help so far.

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-01 Thread Phan, Truong Q 
-beta-1-tests.jar
lrwxrwxrwx  1 root root  59 Feb  5 07:05 
hadoop-mapreduce-client-jobclient.jar - 
hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r--  1 root root   21566 Oct 28 11:30 
hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx  1 root root  57 Feb  5 07:05 
hadoop-mapreduce-client-shuffle.jar - 
hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r--  1 root root  270285 Oct 28 11:30 
hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx  1 root root  51 Feb  5 07:05 hadoop-mapreduce-examples.jar - 
hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r--  1 root root  277597 Oct 28 11:30 
hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx  1 root root  38 Feb  5 07:05 hadoop-rumen.jar - 
hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r--  1 root root  102813 Oct 28 11:30 
hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx  1 root root  42 Feb  5 07:05 hadoop-streaming.jar - 
hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
drwxr-xr-x  2 root root4096 Feb  5 07:05 lib
drwxr-xr-x  2 root root4096 Feb  5 07:05 sbin

+


Thanks and Regards,
Truong Phan


P+ 61 2 8576 5771
M   + 61 4 1463 7424
Etroung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Sean Owen [mailto:sro...@gmail.com]
Sent: Monday, 31 March 2014 7:05 PM
To: Mahout User List
Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a 
problem. Those should not be there.
On Mar 31, 2014 7:09 AM, Phan, Truong Q troung.p...@team.telstra.com
wrote:

 Yes, I did rebuild it.

 oracle@bpdevdmsdbs01: 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
 ution-0.9
 -
 $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
 -DskipTests=true
 [INFO] Scanning for projects...
 
 [INFO]
 --
 --
 [INFO] Reactor Summary:
 [INFO]
 [INFO] Mahout Build Tools  SUCCESS [
  8.215 s]
 [INFO] Apache Mahout . SUCCESS [
  1.158 s]
 [INFO] Mahout Math ... SUCCESS
 [16:21 min] [INFO] Mahout Core ...
 SUCCESS [26:21 min] [INFO] Mahout Integration
  SUCCESS [03:55 min] [INFO] Mahout
 Examples ... SUCCESS [02:54 min]
 [INFO] Mahout Release Package  SUCCESS [
  0.084 s]
 [INFO] Mahout Math/Scala wrappers  SUCCESS
 [01:16 min] [INFO]
 --
 --
 [INFO] BUILD SUCCESS
 [INFO]
 --
 --
 [INFO] Total time: 50:59 min
 [INFO] Finished at: 2014-03-31T14:25:27+10:00 [INFO] Final Memory:
 47M/250M [INFO]
 --
 --


 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com


 -Original Message-
 From: Andrew Musselman [mailto:andrew.mussel...@gmail.com]
 Sent: Monday, 31 March 2014 2:44 PM
 To: user@mahout.apache.org
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Have you rebuilt Mahout for your version?  We're not supporting Hadoop
 version two yet.

 See here for some direction:
 http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3
 CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=pkuimxmcktw...@mail.gmail.com%3E

  On Mar 30, 2014, at 7:28 PM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
 
  Hi
 
  Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
  I have managed to installed and run all test cases under the Mahout
  v0.9
 without any issue.
  Please see below for the evident of the test cases.
  However I have no success to run the example from
 http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland 
 got the following errors.
  Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
 
  snip
  $ env | grep CLASS
  CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-m
  ap
  reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/m
  ah
  out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg0
  01
  /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/
  ta
  rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dm
  s/
  devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-s
  ou
  rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
  ou
  t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/
  st
  g001/BDMSL1D

Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-01 Thread Sean Owen 
-client-hs-2.2.0-cdh5.0.0-beta-1.jar
 lrwxrwxrwx  1 root root  52 Feb  5 07:05 hadoop-mapreduce-client-hs.jar 
 - hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root4086 Oct 28 11:30 
 hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
 lrwxrwxrwx  1 root root  60 Feb  5 07:05 
 hadoop-mapreduce-client-hs-plugins.jar - 
 hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root   35237 Oct 28 11:30 
 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root 1434812 Oct 28 11:30 
 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1-tests.jar
 lrwxrwxrwx  1 root root  59 Feb  5 07:05 
 hadoop-mapreduce-client-jobclient.jar - 
 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root   21566 Oct 28 11:30 
 hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
 lrwxrwxrwx  1 root root  57 Feb  5 07:05 
 hadoop-mapreduce-client-shuffle.jar - 
 hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root  270285 Oct 28 11:30 
 hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
 lrwxrwxrwx  1 root root  51 Feb  5 07:05 hadoop-mapreduce-examples.jar - 
 hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root  277597 Oct 28 11:30 
 hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
 lrwxrwxrwx  1 root root  38 Feb  5 07:05 hadoop-rumen.jar - 
 hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
 -rw-r--r--  1 root root  102813 Oct 28 11:30 
 hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
 lrwxrwxrwx  1 root root  42 Feb  5 07:05 hadoop-streaming.jar - 
 hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
 drwxr-xr-x  2 root root4096 Feb  5 07:05 lib
 drwxr-xr-x  2 root root4096 Feb  5 07:05 sbin

 +


 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com



 -Original Message-
 From: Sean Owen [mailto:sro...@gmail.com]
 Sent: Monday, 31 March 2014 7:05 PM
 To: Mahout User List
 Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a 
 problem. Those should not be there.
 On Mar 31, 2014 7:09 AM, Phan, Truong Q troung.p...@team.telstra.com
 wrote:

 Yes, I did rebuild it.

 oracle@bpdevdmsdbs01: 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
 ution-0.9
 -
 $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
 -DskipTests=true
 [INFO] Scanning for projects...
 
 [INFO]
 --
 --
 [INFO] Reactor Summary:
 [INFO]
 [INFO] Mahout Build Tools  SUCCESS [
  8.215 s]
 [INFO] Apache Mahout . SUCCESS [
  1.158 s]
 [INFO] Mahout Math ... SUCCESS
 [16:21 min] [INFO] Mahout Core ...
 SUCCESS [26:21 min] [INFO] Mahout Integration
  SUCCESS [03:55 min] [INFO] Mahout
 Examples ... SUCCESS [02:54 min]
 [INFO] Mahout Release Package  SUCCESS [
  0.084 s]
 [INFO] Mahout Math/Scala wrappers  SUCCESS
 [01:16 min] [INFO]
 --
 --
 [INFO] BUILD SUCCESS
 [INFO]
 --
 --
 [INFO] Total time: 50:59 min
 [INFO] Finished at: 2014-03-31T14:25:27+10:00 [INFO] Final Memory:
 47M/250M [INFO]
 --
 --


 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com


 -Original Message-
 From: Andrew Musselman [mailto:andrew.mussel...@gmail.com]
 Sent: Monday, 31 March 2014 2:44 PM
 To: user@mahout.apache.org
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Have you rebuilt Mahout for your version?  We're not supporting Hadoop
 version two yet.

 See here for some direction:
 http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3
 CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=pkuimxmcktw...@mail.gmail.com%3E

  On Mar 30, 2014, at 7:28 PM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
 
  Hi
 
  Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
  I have managed to installed and run all test cases under the Mahout
  v0.9
 without any issue.
  Please see below for the evident of the test cases.
  However I have no success to run the example from
 http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland 
 got the following errors.
  Note: I have set the CLASSPATH to point to all

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-01 Thread Phan, Truong Q 
Hi Sean,

I am trying to build the Mahout again and got some WARNINGs so far.
Can you give me some hints what I have done wrong here?

Thanks for your help so far.

++
$ mv mahout-distribution-0.9 mahout-distribution-0.9.old

$ tar xvf mahout-distribution-0.9-src.tar.gz

$ cd mahout-distribution-0.9

$ ls
bin  buildtools  core  distribution  examples  integration  LICENSE.txt  math  
math-scala  NOTICE.txt  pom.xml  README.txt  src

$ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-math:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 
(/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml)
 points at org.apache.mahout:mahout-distribution instead of org.apache:apache, 
please verify your project structure @ org.apache.mahout:mahout:0.9, 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml,
 line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-core:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 
(/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml)
 points at org.apache.mahout:mahout-distribution instead of org.apache:apache, 
please verify your project structure @ org.apache.mahout:mahout:0.9, 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml,
 line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-integration:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 
(/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml)
 points at org.apache.mahout:mahout-distribution instead of org.apache:apache, 
please verify your project structure @ org.apache.mahout:mahout:0.9, 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml,
 line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-examples:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 
(/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml)
 points at org.apache.mahout:mahout-distribution instead of org.apache:apache, 
please verify your project structure @ org.apache.mahout:mahout:0.9, 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml,
 line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-distribution:pom:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 
(/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml)
 points at org.apache.mahout:mahout-distribution instead of org.apache:apache, 
please verify your project structure @ org.apache.mahout:mahout:0.9, 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml,
 line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-math-scala:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 
(/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml)
 points at org.apache.mahout:mahout-distribution instead of org.apache:apache, 
please verify your project structure @ org.apache.mahout:mahout:0.9, 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml,
 line 25, column 11
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin 
is missing. @ line 108, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout:pom:0.9
[WARNING] 'parent.relativePath' points at org.apache.mahout:mahout-distribution 
instead of org.apache:apache, please verify your project structure @ line 25, 
column 11
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten 
the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support 
building such malformed projects.
[WARNING]

Thanks and Regards,
Truong Phan


P+ 61 2 8576 5771
M   + 61 4 1463 7424
Etroung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Sean Owen [mailto:sro...@gmail.com]
Sent: Wednesday, 2 April 2014 9:53 AM
To: Phan, Truong Q
Cc: Mahout User List
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

This still means Hadoop version mismatch.

You shouldn't have to use

Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-01 Thread Sean Owen 
This may be getting to you're-on-your-own-territory since you're
modifying the build. This error means your directory structure doesn't
match up with declarations. You said somewhere that the parent of
module X was Y, but the location given points to the pom of a module
that isn't Y.

On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q
troung.p...@team.telstra.com wrote:
 Hi Sean,

 I am trying to build the Mahout again and got some WARNINGs so far.
 Can you give me some hints what I have done wrong here?

 Thanks for your help so far.

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-01 Thread Phan, Truong Q 
Where did I modifying the build?
Here are my steps of the build.
I got the source from one of the official mirror website and build it.
The only one exception here is that I am using the Cloudera CDH 5.0.
This latest CDHv5.0 might not work with Mahout v0.9.

++
Install Mahout

$  javac -version
javac 1.6.0_32

$ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout

$ wget 
http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution-0.9-src.tar.gz

$ mv mahout-distribution-0.9 mahout-distribution-0.9.old

$ tar xvf mahout-distribution-0.9-src.tar.gz

$ cd mahout-distribution-0.9

$ ls
bin  buildtools  core  distribution  examples  integration  LICENSE.txt  math  
math-scala  NOTICE.txt  pom.xml  README.txt  src

$ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true 
[INFO] Scanning for projects...


[INFO] 
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools  SUCCESS [  7.235 s]
[INFO] Apache Mahout . SUCCESS [  1.017 s]
[INFO] Mahout Math ... SUCCESS [15:46 min]
[INFO] Mahout Core ... SUCCESS [24:29 min]
[INFO] Mahout Integration  SUCCESS [03:38 min]
[INFO] Mahout Examples ... SUCCESS [02:40 min]
[INFO] Mahout Release Package  SUCCESS [  0.075 s]
[INFO] Mahout Math/Scala wrappers  SUCCESS [01:12 min]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 47:57 min
[INFO] Finished at: 2014-04-02T15:07:50+10:00
[INFO] Final Memory: 49M/288M
[INFO] 


Thanks and Regards,
Truong Phan


P    + 61 2 8576 5771
M   + 61 4 1463 7424
E    troung.p...@team.telstra.com
W  www.telstra.com



-Original Message-
From: Sean Owen [mailto:sro...@gmail.com] 
Sent: Wednesday, 2 April 2014 3:33 PM
To: Mahout User List
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

This may be getting to you're-on-your-own-territory since you're modifying the 
build. This error means your directory structure doesn't match up with 
declarations. You said somewhere that the parent of module X was Y, but the 
location given points to the pom of a module that isn't Y.

On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q troung.p...@team.telstra.com 
wrote:
 Hi Sean,

 I am trying to build the Mahout again and got some WARNINGs so far.
 Can you give me some hints what I have done wrong here?

 Thanks for your help so far.

Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-04-01 Thread Sean Owen 
Hm, OK something sounds wrong with your directory structure, given the
warnings. I assumed this was changed. It could be that the .tar.gz
distribution isn't quite correctly set up for building from source.

The compilation here is nothing to do with Hadoop. You show a
successful build; what's the part that fails?

On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q
troung.p...@team.telstra.com wrote:
 Where did I modifying the build?
 Here are my steps of the build.
 I got the source from one of the official mirror website and build it.
 The only one exception here is that I am using the Cloudera CDH 5.0.
 This latest CDHv5.0 might not work with Mahout v0.9.

 ++
 Install Mahout

 $  javac -version
 javac 1.6.0_32

 $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout

 $ wget 
 http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution-0.9-src.tar.gz

 $ mv mahout-distribution-0.9 mahout-distribution-0.9.old

 $ tar xvf mahout-distribution-0.9-src.tar.gz

 $ cd mahout-distribution-0.9

 $ ls
 bin  buildtools  core  distribution  examples  integration  LICENSE.txt  math 
  math-scala  NOTICE.txt  pom.xml  README.txt  src

 $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true 
 [INFO] Scanning for projects...
 

 [INFO] 
 
 [INFO] Reactor Summary:
 [INFO]
 [INFO] Mahout Build Tools  SUCCESS [  7.235 s]
 [INFO] Apache Mahout . SUCCESS [  1.017 s]
 [INFO] Mahout Math ... SUCCESS [15:46 min]
 [INFO] Mahout Core ... SUCCESS [24:29 min]
 [INFO] Mahout Integration  SUCCESS [03:38 min]
 [INFO] Mahout Examples ... SUCCESS [02:40 min]
 [INFO] Mahout Release Package  SUCCESS [  0.075 s]
 [INFO] Mahout Math/Scala wrappers  SUCCESS [01:12 min]
 [INFO] 
 
 [INFO] BUILD SUCCESS
 [INFO] 
 
 [INFO] Total time: 47:57 min
 [INFO] Finished at: 2014-04-02T15:07:50+10:00
 [INFO] Final Memory: 49M/288M
 [INFO] 
 


 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com



 -Original Message-
 From: Sean Owen [mailto:sro...@gmail.com]
 Sent: Wednesday, 2 April 2014 3:33 PM
 To: Mahout User List
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 This may be getting to you're-on-your-own-territory since you're modifying 
 the build. This error means your directory structure doesn't match up with 
 declarations. You said somewhere that the parent of module X was Y, but the 
 location given points to the pom of a module that isn't Y.

 On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q troung.p...@team.telstra.com 
 wrote:
 Hi Sean,

 I am trying to build the Mahout again and got some WARNINGs so far.
 Can you give me some hints what I have done wrong here?

 Thanks for your help so far.

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-03-31 Thread Phan, Truong Q 
Yes, I did rebuild it.

oracle@bpdevdmsdbs01:  
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9 
-
$ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true
[INFO] Scanning for projects...

[INFO] 
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools  SUCCESS [  8.215 s]
[INFO] Apache Mahout . SUCCESS [  1.158 s]
[INFO] Mahout Math ... SUCCESS [16:21 min]
[INFO] Mahout Core ... SUCCESS [26:21 min]
[INFO] Mahout Integration  SUCCESS [03:55 min]
[INFO] Mahout Examples ... SUCCESS [02:54 min]
[INFO] Mahout Release Package  SUCCESS [  0.084 s]
[INFO] Mahout Math/Scala wrappers  SUCCESS [01:16 min]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 50:59 min
[INFO] Finished at: 2014-03-31T14:25:27+10:00
[INFO] Final Memory: 47M/250M
[INFO] 


Thanks and Regards,
Truong Phan


P    + 61 2 8576 5771
M   + 61 4 1463 7424
E    troung.p...@team.telstra.com
W  www.telstra.com


-Original Message-
From: Andrew Musselman [mailto:andrew.mussel...@gmail.com] 
Sent: Monday, 31 March 2014 2:44 PM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Have you rebuilt Mahout for your version?  We're not supporting Hadoop version 
two yet.

See here for some direction:  
http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=pkuimxmcktw...@mail.gmail.com%3E

 On Mar 30, 2014, at 7:28 PM, Phan, Truong Q troung.p...@team.telstra.com 
 wrote:
 
 Hi
  
 Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
 I have managed to installed and run all test cases under the Mahout v0.9 
 without any issue.
 Please see below for the evident of the test cases.
 However I have no success to run the example from 
 http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html and 
 got the following errors.
 Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
  
 snip
 $ env | grep CLASS
 CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-map
 reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
 out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001
 /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/ta
 rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
 devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sou
 rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
 t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/st
 g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/mat
 h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
 devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sou
 rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
 t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/st
 g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/int
 egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/h
 adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/targe
 t/mahout-integration-0.9-sources.jar
  
 $ export 
 MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma
 hout-distribution-0.9
 $ export PATH=$MAHOUT_HOME/bin:$PATH
  
 oracle@bpdevdmsdbs01:BDMSSI1D1  
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
 ution-0.9/nem-dms - $ mahout recommenditembased --input mydata.dat 
 --usersFile user.dat --numRecommendations 2 --output output/ 
 --similarityClassname SIMILARITY_PEARSON_CORRELATION Running on 
 hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and 
 HADOOP_CONF_DIR=
 MAHOUT-JOB: 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
 ution-0.9/examples/target/mahout-examples-0.9-job.jar
 Exception in thread main java.lang.NoClassDefFoundError: 
 org/apache/hadoop/util/PlatformName
 Caused by: java.lang.ClassNotFoundException: 
 org.apache.hadoop.util.PlatformName
 at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
 at java.lang.ClassLoader.loadClass

RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-03-31 Thread Sean Owen 
But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a
problem. Those should not be there.
On Mar 31, 2014 7:09 AM, Phan, Truong Q troung.p...@team.telstra.com
wrote:

 Yes, I did rebuild it.

 oracle@bpdevdmsdbs01: 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
 -
 $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
 -DskipTests=true
 [INFO] Scanning for projects...
 
 [INFO]
 
 [INFO] Reactor Summary:
 [INFO]
 [INFO] Mahout Build Tools  SUCCESS [
  8.215 s]
 [INFO] Apache Mahout . SUCCESS [
  1.158 s]
 [INFO] Mahout Math ... SUCCESS [16:21
 min]
 [INFO] Mahout Core ... SUCCESS [26:21
 min]
 [INFO] Mahout Integration  SUCCESS [03:55
 min]
 [INFO] Mahout Examples ... SUCCESS [02:54
 min]
 [INFO] Mahout Release Package  SUCCESS [
  0.084 s]
 [INFO] Mahout Math/Scala wrappers  SUCCESS [01:16
 min]
 [INFO]
 
 [INFO] BUILD SUCCESS
 [INFO]
 
 [INFO] Total time: 50:59 min
 [INFO] Finished at: 2014-03-31T14:25:27+10:00
 [INFO] Final Memory: 47M/250M
 [INFO]
 


 Thanks and Regards,
 Truong Phan


 P+ 61 2 8576 5771
 M   + 61 4 1463 7424
 Etroung.p...@team.telstra.com
 W  www.telstra.com


 -Original Message-
 From: Andrew Musselman [mailto:andrew.mussel...@gmail.com]
 Sent: Monday, 31 March 2014 2:44 PM
 To: user@mahout.apache.org
 Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

 Have you rebuilt Mahout for your version?  We're not supporting Hadoop
 version two yet.

 See here for some direction:
 http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=pkuimxmcktw...@mail.gmail.com%3E

  On Mar 30, 2014, at 7:28 PM, Phan, Truong Q 
 troung.p...@team.telstra.com wrote:
 
  Hi
 
  Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
  I have managed to installed and run all test cases under the Mahout v0.9
 without any issue.
  Please see below for the evident of the test cases.
  However I have no success to run the example from
 http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland 
 got the following errors.
  Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
 
  snip
  $ env | grep CLASS
  CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-map
  reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
  out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001
  /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/ta
  rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
  devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sou
  rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
  t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/st
  g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/mat
  h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
  devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sou
  rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
  t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/st
  g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/int
  egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/h
  adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/targe
  t/mahout-integration-0.9-sources.jar
 
  $ export
  MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma
  hout-distribution-0.9
  $ export PATH=$MAHOUT_HOME/bin:$PATH
 
  oracle@bpdevdmsdbs01:BDMSSI1D1 
  /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
  ution-0.9/nem-dms - $ mahout recommenditembased --input mydata.dat
  --usersFile user.dat --numRecommendations 2 --output output/
  --similarityClassname SIMILARITY_PEARSON_CORRELATION Running on
  hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and
  HADOOP_CONF_DIR=
  MAHOUT-JOB:
  /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
  ution-0.9/examples/target/mahout-examples-0.9-job.jar
  Exception in thread main java.lang.NoClassDefFoundError:
  org/apache/hadoop/util/PlatformName
  Caused by: java.lang.ClassNotFoundException:
 org.apache.hadoop.util.PlatformName
  at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
  at java.security.AccessController.doPrivileged(Native Method

Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-03-30 Thread Phan, Truong Q 
Hi

Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
I have managed to installed and run all test cases under the Mahout v0.9 
without any issue.
Please see below for the evident of the test cases.
However I have no success to run the example from 
http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html and got 
the following errors.
Note: I have set the CLASSPATH to point to all of Mahout's jar files.

snip
$ env | grep CLASS
CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-mapreduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9-sources.jar

$ export 
MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
$ export PATH=$MAHOUT_HOME/bin:$PATH

oracle@bpdevdmsdbs01:BDMSSI1D1  
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/nem-dms
 -
$ mahout recommenditembased --input mydata.dat --usersFile user.dat 
--numRecommendations 2 --output output/ --similarityClassname 
SIMILARITY_PEARSON_CORRELATION
Running on hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and 
HADOOP_CONF_DIR=
MAHOUT-JOB: 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
Exception in thread main java.lang.NoClassDefFoundError: 
org/apache/hadoop/util/PlatformName
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.util.PlatformName.  Program 
will exit.
Exception in thread main java.lang.NoClassDefFoundError: 
org/apache/hadoop/util/RunJar
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.util.RunJar.  Program will 
exit.
/snip

snip
[INFO] --- maven-install-plugin:2.5.1:install (default-install) @ 
mahout-math-scala ---
[INFO] Installing 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/target/mahout-math-scala-0.9.jar
 to 
/home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9.jar
[INFO] Installing 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/pom.xml
 to 
/home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9.pom
[INFO] Installing 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar
 to 
/home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9-tests.jar
[INFO] Installing 
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar
 to 
/home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9-sources.jar
[INFO] 
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools  SUCCESS [01:21 min]
[INFO] Apache Mahout . SUCCESS [  6.898 s]
[INFO] Mahout Math

Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

2014-03-30 Thread Andrew Musselman 
Have you rebuilt Mahout for your version?  We're not supporting Hadoop version 
two yet.

See here for some direction:  
http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=pkuimxmcktw...@mail.gmail.com%3E

 On Mar 30, 2014, at 7:28 PM, Phan, Truong Q troung.p...@team.telstra.com 
 wrote:
 
 Hi
  
 Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
 I have managed to installed and run all test cases under the Mahout v0.9 
 without any issue.
 Please see below for the evident of the test cases.
 However I have no success to run the example from 
 http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html and 
 got the following errors.
 Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
  
 snip
 $ env | grep CLASS
 CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-mapreduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9-sources.jar
  
 $ export 
 MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
 $ export PATH=$MAHOUT_HOME/bin:$PATH
  
 oracle@bpdevdmsdbs01:BDMSSI1D1  
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/nem-dms
  -
 $ mahout recommenditembased --input mydata.dat --usersFile user.dat 
 --numRecommendations 2 --output output/ --similarityClassname 
 SIMILARITY_PEARSON_CORRELATION
 Running on hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and 
 HADOOP_CONF_DIR=
 MAHOUT-JOB: 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
 Exception in thread main java.lang.NoClassDefFoundError: 
 org/apache/hadoop/util/PlatformName
 Caused by: java.lang.ClassNotFoundException: 
 org.apache.hadoop.util.PlatformName
 at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
 Could not find the main class: org.apache.hadoop.util.PlatformName.  Program 
 will exit.
 Exception in thread main java.lang.NoClassDefFoundError: 
 org/apache/hadoop/util/RunJar
 Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
 at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
 Could not find the main class: org.apache.hadoop.util.RunJar.  Program will 
 exit.
 /snip
  
 snip
 [INFO] --- maven-install-plugin:2.5.1:install (default-install) @ 
 mahout-math-scala ---
 [INFO] Installing 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/target/mahout-math-scala-0.9.jar
  to 
 /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9.jar
 [INFO] Installing 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/pom.xml
  to 
 /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9.pom
 [INFO] Installing 
 /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar
  to 
 /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/mahout-math-scala-0.9-tests.jar
 [INFO] Installing