Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
Guys, found an issue lucene 6.x is compatible only with Java 8. What's the plan for mahout compatibility? Do you guys want to call in a vote for Java compatibility? On Aug 5, 2016 4:58 PM, "Andrew Palumbo" wrote: > Hi Raviteja, > > > Since this upgrade affects the entire

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Andrew Palumbo
Hi Raviteja, Since this upgrade affects the entire Mahout MapReduce text processing pipeline it is important to make sure that it is working in the end to end examples. Could you please set up a Hadoop 2.4.1 pseudo cluster and run through the previously mentioned examples? The instructions

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Andrew Palumbo
Ahh- yes I think we started removing MAHOUT_LOCAL capability I see the check for MAHOUT_LOCAL was removed in this commit: https://github.com/apache/mahout/commit/daad3a4ce618cbd05be468c4ce6e451618f3a028 So it would make sense that you are seeing that Error in local mode.

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
Nope in a Linux environment. On Aug 5, 2016 2:21 PM, "Suneel Marthi" wrote: > r u running this on windows prompt or in Cygwin. > > Suggest use Cygwin. > > On Fri, Aug 5, 2016 at 2:15 PM, Raviteja Lokineni < > raviteja.lokin...@gmail.com> wrote: > > > This is what I get. > >

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Suneel Marthi
r u running this on windows prompt or in Cygwin. Suggest use Cygwin. On Fri, Aug 5, 2016 at 2:15 PM, Raviteja Lokineni < raviteja.lokin...@gmail.com> wrote: > This is what I get. > > $ ./classify-20newsgroups.sh > /home/lok268/projects/mahout/examples/bin/set-dfs-commands.sh: line > 36:

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
This is what I get. $ ./classify-20newsgroups.sh /home/lok268/projects/mahout/examples/bin/set-dfs-commands.sh: line 36: /bin/hadoop: No such file or directory /home/lok268/projects/mahout/examples/bin/set-dfs-commands.sh: line 38: [: too many arguments

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Suneel Marthi
u don't need a hadoop cluster for that, set MAHOUT_LOCAL=true and u shuld be able to run locally On Fri, Aug 5, 2016 at 1:57 PM, Raviteja Lokineni < raviteja.lokin...@gmail.com> wrote: > Hi Andrew, > > Looks like the examples don't seem to work unless on a hadoop cluster. If I > get some time I

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
Hi Andrew, Looks like the examples don't seem to work unless on a hadoop cluster. If I get some time I will download a cloudera quickstart vm and test it out. Thanks, Raviteja On Fri, Aug 5, 2016 at 12:53 PM, Andrew Palumbo wrote: > Thanks again Raviteja, > Tests pass in

RE: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Andrew Palumbo
Thanks again Raviteja, Tests pass in my Linux env as well. FYI, if the windows script has not yet been officially deprecated it should be soon. As Suneel said, someone will merge it over the weekend. In the meantime it would good to ensure that some of the examples are working in the

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
Just a FYI, all the tests are successful on windows too ;) On Fri, Aug 5, 2016 at 12:18 PM, Andrew Palumbo wrote: > +1 > > > From: Raviteja Lokineni > Sent: Friday, August 5, 2016 12:14:24 PM > To: mahout >

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Andrew Palumbo
+1 From: Raviteja Lokineni Sent: Friday, August 5, 2016 12:14:24 PM To: mahout Subject: Re: MAHOUT-1876 - Lucene compatibility Yay! for the heads up on merging. FYI, I take back my word on failure on windows though. I had to include

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
Yay! for the heads up on merging. FYI, I take back my word on failure on windows though. I had to include the hadoop.dll file on PATH. Tests are running (I am running it just to satisfy myself ;) ). On Fri, Aug 5, 2016 at 12:11 PM, Suneel Marthi wrote: > Most of us r

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Suneel Marthi
Most of us r Linux or MacOS users, so we never hit any of the build issues u have encountered. I must say that we never test for Windows :), but its expected that u would run into issues on Windows. The patch looks good and we shuld be able to merge this over the weekend, thanks again for the

Re: [Discuss--A proposal for building an application in mahout to measure runtime performance of algorithms in mahout]

2016-08-05 Thread Saikat Kanjilal
AndrewM/AndrewP and others that may be interested, I am going to move ahead with the next additions to the runtime performane measurement framework as I have not heard back from either of you on my previous requests, this includes: 1) Organizing the code a bit more so that the driver collects

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
I have built winutils.exe but nevertheless the test fails to run on windows due to linker errors. So, for now linux builds are successful on my end. Let me know what is your plan with the pull request to upgrade. On Fri, Aug 5, 2016 at 11:12 AM, Raviteja Lokineni < raviteja.lokin...@gmail.com>

[jira] [Commented] (MAHOUT-1853) Improvements to CCO (Correlated Cross-Occurrence)

2016-08-05 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409595#comment-15409595 ] Pat Ferrel commented on MAHOUT-1853: Great, that's what I wanted to hear. Normal in principal but

Re: MAHOUT-1876 - Lucene compatibility

2016-08-05 Thread Raviteja Lokineni
The reason the tests failed previously on my windows box is because it wasn't able to locate winutils.exe in HADOOP_HOME. Now, to test that I am building winutils.exe from source using the following resource: http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html On Thu,