The reason the tests failed previously on my windows box is because it wasn't able to locate winutils.exe in HADOOP_HOME.
Now, to test that I am building winutils.exe from source using the following resource: http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html On Thu, Aug 4, 2016 at 9:53 PM, Raviteja Lokineni < raviteja.lokin...@gmail.com> wrote: > I'm up for the challenge but looks like nothing failed this time too. > > Repo: https://github.com/bond-/mahout > Branch: mahout-1876 > > See the full output in the gist: https://gist.github.com/bond-/ > 33c349136b6914db4892233b8876b9d7 > > If someone wants to re-verify running the tests, please go ahead and let > me know. > > On Thu, Aug 4, 2016 at 6:16 PM, Andrew Palumbo <ap....@outlook.com> wrote: > >> Maven >= 3.3.3, >> java >= 1.7, >> MAHOUT_HOME=/path/to/install, >> >> also MAHOUT_LOCAL=true >> >> If ur not running against a hadoop cluster. (Looks like ur not) >> >> Upgrading this dep is not a trivial task. >> >> >> -------- Original message -------- >> From: Raviteja Lokineni <raviteja.lokin...@gmail.com> >> Date: 08/04/2016 6:09 PM (GMT-05:00) >> To: mahout <dev@mahout.apache.org> >> Subject: Re: MAHOUT-1876 - Lucene compatibility >> >> Are there any pre-requisites to run tests on local machines? >> >> Most of the MR module tests failed with: >> >> java.lang.NullPointerException: null >> at __randomizedtesting.SeedInfo.seed([C8C254E3D9D80CC9:845EFDB0 >> 7D41873E]:0) >> at java.lang.ProcessBuilder.start(ProcessBuilder.java:1012) >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:445) >> at org.apache.hadoop.util.Shell.run(Shell.java:418) >> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Sh >> ell.java:650) >> at org.apache.hadoop.util.Shell.execCommand(Shell.java:739) >> at org.apache.hadoop.util.Shell.execCommand(Shell.java:722) >> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission( >> RawLocalFileSystem.java:633) >> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs( >> RawLocalFileSystem.java:421) >> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSyste >> m.java:281) >> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir( >> JobSubmissionFiles.java:125) >> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal( >> JobSubmitter.java:348) >> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) >> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:422) >> at org.apache.hadoop.security.UserGroupInformation.doAs( >> UserGroupInformation.java:1556) >> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) >> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303) >> at org.apache.mahout.cf.taste.hadoop.preparation.PreparePrefere >> nceMatrixJob. >> run(PreparePreferenceMatrixJob.java:77) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob. >> run(RecommenderJob.java:168) >> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest. >> testCompleteJobWithFiltering(RecommenderJobTest.java:881) >> >> On Thu, Aug 4, 2016 at 6:03 PM, Andrew Palumbo <ap....@outlook.com> >> wrote: >> >> > Actually, Travis CI is not set up to test all mahout modules. Could you >> > please test again on your local machine, and report any errors. >> > >> > Andy >> > >> > >> > -------- Original message -------- >> > From: Raviteja Lokineni <raviteja.lokin...@gmail.com> >> > Date: 08/04/2016 4:01 PM (GMT-05:00) >> > To: mahout <dev@mahout.apache.org> >> > Subject: Re: MAHOUT-1876 - Lucene compatibility >> > >> > All the tests are successful even with my code change and upgrade to >> > Lucene. (The test failure that I reported above was on my local >> machine, I >> > guess you can ignore that.) >> > >> > So is this pull request good to merge? >> > >> > https://github.com/apache/mahout/pull/247 >> > >> > https://travis-ci.org/apache/mahout/builds/149840408 >> > >> > On Thu, Aug 4, 2016 at 2:05 PM, Raviteja Lokineni < >> > raviteja.lokin...@gmail.com> wrote: >> > >> > > Most of the MR tests are failing with: >> > > >> > > java.lang.NullPointerException: null >> > > at __randomizedtesting.SeedInfo.seed([C8C254E3D9D80CC9: >> > > 845EFDB07D41873E]:0) >> > > at java.lang.ProcessBuilder.start(ProcessBuilder.java:1012) >> > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:445) >> > > at org.apache.hadoop.util.Shell.run(Shell.java:418) >> > > at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute( >> > > Shell.java:650) >> > > at org.apache.hadoop.util.Shell.execCommand(Shell.java:739) >> > > at org.apache.hadoop.util.Shell.execCommand(Shell.java:722) >> > > at org.apache.hadoop.fs.RawLocalFileSystem.setPermission( >> > > RawLocalFileSystem.java:633) >> > > at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs( >> > > RawLocalFileSystem.java:421) >> > > at org.apache.hadoop.fs.FilterFileSystem.mkdirs( >> > FilterFileSystem.java:281) >> > > at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir( >> > > JobSubmissionFiles.java:125) >> > > at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal( >> > > JobSubmitter.java:348) >> > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) >> > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) >> > > at java.security.AccessController.doPrivileged(Native Method) >> > > at javax.security.auth.Subject.doAs(Subject.java:422) >> > > at org.apache.hadoop.security.UserGroupInformation.doAs( >> > > UserGroupInformation.java:1556) >> > > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) >> > > at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303) >> > > at org.apache.mahout.cf.taste.hadoop.preparation. >> > > PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:77) >> > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >> > > at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob. >> > > run(RecommenderJob.java:168) >> > > at org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest. >> > > testCompleteJobWithFiltering(RecommenderJobTest.java:881) >> > > >> > > Do I need to have hadoop installed on my local machine? >> > > >> > > On Thu, Aug 4, 2016 at 1:53 PM, Raviteja Lokineni < >> > > raviteja.lokin...@gmail.com> wrote: >> > > >> > >> Hi Devs, >> > >> >> > >> Issue link: https://issues.apache.org/jira/browse/MAHOUT-1876 >> > >> >> > >> Problem statement: Mahout should be compatible with the latest lucene >> > >> version. I was trying to solve a text clustering problem and I >> stumbled >> > >> upon the error that the lucene version in use is not supported. >> That's >> > when >> > >> I raised this issue and one of the guys suggested me to try fixing it >> > and I >> > >> started doing so. >> > >> >> > >> Proposed solution: >> > >> >> > >> 1. Change lucene version in the POM file and fix all the >> compilation >> > >> failures >> > >> 2. Fix any failing tests due to this change >> > >> >> > >> Current progress: >> > >> >> > >> 1. Fixed all the compilation issues >> > >> 2. Comparing the test failures of before-fix v/s after-fix >> > >> >> > >> I might need some help in test failures, I happen to see that the >> same >> > >> tests are failing in both before-fix and after-fix. >> > >> >> > >> Let me know if any comments. >> > >> >> > >> Thanks, >> > >> -- >> > >> *Raviteja Lokineni* | Business Intelligence Developer >> > >> TD Ameritrade >> > >> >> > >> E: raviteja.lokin...@gmail.com >> > >> >> > >> [image: View Raviteja Lokineni's profile on LinkedIn] >> > >> <http://in.linkedin.com/in/ravitejalokineni> >> > >> >> > >> >> > > >> > > >> > > -- >> > > *Raviteja Lokineni* | Business Intelligence Developer >> > > TD Ameritrade >> > > >> > > E: raviteja.lokin...@gmail.com >> > > >> > > [image: View Raviteja Lokineni's profile on LinkedIn] >> > > <http://in.linkedin.com/in/ravitejalokineni> >> > > >> > > >> > >> > >> > -- >> > *Raviteja Lokineni* | Business Intelligence Developer >> > TD Ameritrade >> > >> > E: raviteja.lokin...@gmail.com >> > >> > [image: View Raviteja Lokineni's profile on LinkedIn] >> > <http://in.linkedin.com/in/ravitejalokineni> >> > >> >> >> >> -- >> *Raviteja Lokineni* | Business Intelligence Developer >> TD Ameritrade >> >> E: raviteja.lokin...@gmail.com >> >> [image: View Raviteja Lokineni's profile on LinkedIn] >> <http://in.linkedin.com/in/ravitejalokineni> >> > > > > -- > *Raviteja Lokineni* | Business Intelligence Developer > TD Ameritrade > > E: raviteja.lokin...@gmail.com > > [image: View Raviteja Lokineni's profile on LinkedIn] > <http://in.linkedin.com/in/ravitejalokineni> > > -- *Raviteja Lokineni* | Business Intelligence Developer TD Ameritrade E: raviteja.lokin...@gmail.com [image: View Raviteja Lokineni's profile on LinkedIn] <http://in.linkedin.com/in/ravitejalokineni>
