Re: [VOTE] Add Travis-CI for Mahout
3gigs of memory and 50mins runtime is the upper bound for Travis. We explored Travis for Drill but could not continue with it because few of our testcases were resource hungry. If Mahout fits in these Travis is a great tool. -Via mobile. Excuse brevity. On 17 Apr 2015 10:03 pm, Pat Ferrel p...@occamsmachete.com wrote: Good question. It can replace Jenkins, integrates automatically (only I think) with Github, and is orders of magnitude easier to use than Jenkins. A lot of other projects use it but I was surprised to hear Apache favored it. Doesn’t Apache have some draconian requirement to control all bits of the project pipeline and workflow? In our case would it be able to replace Jenkins or is it extra work? BTW slightly off topic... the Slack thing is set up for Apache.org. It requires you to have an @apache.org email. That means other projects can create their own channel. It is also gratis and so will eventually be overwhelmed if lots of other projects start using it. On Apr 17, 2015, at 12:31 AM, Stevo Slavić ssla...@gmail.com wrote: Before I cast my vote can somebody please explain which problem are we trying to or expect from this to be solved? Kind regards, Stevo Slavic. On Apr 17, 2015 9:22 AM, Ted Dunning ted.dunn...@gmail.com wrote: Totally simple if the project has a standard build/test structure. For t-digest it took about 4 lines of yaml checked into the root directory. The documentation on travis is excellent and the process of setup is easy. On Fri, Apr 17, 2015 at 3:27 AM, Andrew Musselman andrew.mussel...@gmail.com wrote: Worth trying out though I've never used Travis; what work effort is required, any idea? On Thursday, April 16, 2015, Suneel Marthi suneel.mar...@gmail.com wrote: Would this be an additional CI we would like to add to Mahout ? https://blogs.apache.org/infra/entry/apache_gains_additional_travis_ci I am up for it. +1
Re: Why is mahout moving to spark?
Hi Thejas, Can definitely help you out with the later querstion. You can use it for any of your fav projects. https://mail-archives.apache.org/mod_mbox/ https://mail-archives.apache.org/mod_mbox/mahout-dev/ Peace, Yash On Thu, Oct 16, 2014 at 1:14 AM, thejas prasad thejch...@gmail.com wrote: Hey all, I am curious why mahout is moving away from spark? I mean it is here The Mahout community decided to move its codebase onto modern data processing systems that offer a richer programming model and more efficient execution than Hadoop MapReduce. But why did this happen? And also is there a place I see all the previous emails, in the user/dev list ? Thanks, Thejas
Re: Jenkins build failing recently
With respect to: https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters-II/882/ https://builds.apache.org/job/mahout-nightly/1619/ On Sun, Jul 13, 2014 at 11:24 PM, Yash Sharma yash...@gmail.com wrote: Hi All, We found that Apache Drill's Jenkins build were failing recently due to maven 3.0.4. And I see the same build errors in Mahout Jenkins build logs. I guess we are hitting the same issues here too. We are probably hitting: https://issues.apache.org/jira/browse/INFRA-7211 https://issues.apache.org/jira/browse/INFRA-7536 Switching to maven installation 3.0.5 can be an immediate fix for now. Peace, Yash FATAL: Failed to install http://archive.apache.org/dist/maven/binaries/apache-maven-3.0.4-bin.zip to /home/hudson/tools/maven/apache-maven-3.0.4 java.io.IOException http://stacktrace.jenkins-ci.org/search?query=java.io.IOException: Failed to install http://archive.apache.org/dist/maven/binaries/apache-maven-3.0.4-bin.zip to /home/hudson/tools/maven/apache-maven-3.0.4 at hudson.FilePath.installIfNecessaryFrom(FilePath.java:766) http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.installIfNecessaryFromentity=method at hudson.tools.DownloadFromUrlInstaller.performInstallation(DownloadFromUrlInstaller.java:70) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.DownloadFromUrlInstaller.performInstallationentity=method at hudson.tools.InstallerTranslator.getToolHome(InstallerTranslator.java:61) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.InstallerTranslator.getToolHomeentity=method at hudson.tools.ToolLocationNodeProperty.getToolHome(ToolLocationNodeProperty.java:107) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.ToolLocationNodeProperty.getToolHomeentity=method at hudson.tools.ToolInstallation.translateFor(ToolInstallation.java:204) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.ToolInstallation.translateForentity=method at hudson.tasks.Maven$MavenInstallation.forNode(Maven.java:610) http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.Maven$MavenInstallation.forNodeentity=method at hudson.tasks.Maven.perform(Maven.java:289) http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.Maven.performentity=method at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.performentity=method at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performentity=method at hudson.model.Build$BuildExecution.build(Build.java:199) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.buildentity=method at hudson.model.Build$BuildExecution.doRun(Build.java:160) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.doRunentity=method at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:585) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.runentity=method at hudson.model.Run.execute(Run.java:1676) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.executeentity=method at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.runentity=method at hudson.model.ResourceController.execute(ResourceController.java:88) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.executeentity=method at hudson.model.Executor.run(Executor.java:231) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.runentity=methodCaused by: java.io.IOException http://stacktrace.jenkins-ci.org/search?query=java.io.IOException: Failed to mkdirs: /home/hudson/tools/maven/apache-maven-3.0.4 at hudson.FilePath.mkdirs(FilePath.java:1069) http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.mkdirsentity=method at hudson.FilePath.installIfNecessaryFrom(FilePath.java:732) http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.installIfNecessaryFromentity=method ... 15 more
Re: Jenkins build failing recently
Looks like the latest build for Mahout-Examples-Cluster-Reuters-II( #883) passed all green without changes. Peace, Yash On Sun, Jul 13, 2014 at 11:25 PM, Yash Sharma yash...@gmail.com wrote: With respect to: https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters-II/882/ https://builds.apache.org/job/mahout-nightly/1619/ On Sun, Jul 13, 2014 at 11:24 PM, Yash Sharma yash...@gmail.com wrote: Hi All, We found that Apache Drill's Jenkins build were failing recently due to maven 3.0.4. And I see the same build errors in Mahout Jenkins build logs. I guess we are hitting the same issues here too. We are probably hitting: https://issues.apache.org/jira/browse/INFRA-7211 https://issues.apache.org/jira/browse/INFRA-7536 Switching to maven installation 3.0.5 can be an immediate fix for now. Peace, Yash FATAL: Failed to install http://archive.apache.org/dist/maven/binaries/apache-maven-3.0.4-bin.zip to /home/hudson/tools/maven/apache-maven-3.0.4 java.io.IOException http://stacktrace.jenkins-ci.org/search?query=java.io.IOException: Failed to install http://archive.apache.org/dist/maven/binaries/apache-maven-3.0.4-bin.zip to /home/hudson/tools/maven/apache-maven-3.0.4 at hudson.FilePath.installIfNecessaryFrom(FilePath.java:766) http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.installIfNecessaryFromentity=method at hudson.tools.DownloadFromUrlInstaller.performInstallation(DownloadFromUrlInstaller.java:70) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.DownloadFromUrlInstaller.performInstallationentity=method at hudson.tools.InstallerTranslator.getToolHome(InstallerTranslator.java:61) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.InstallerTranslator.getToolHomeentity=method at hudson.tools.ToolLocationNodeProperty.getToolHome(ToolLocationNodeProperty.java:107) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.ToolLocationNodeProperty.getToolHomeentity=method at hudson.tools.ToolInstallation.translateFor(ToolInstallation.java:204) http://stacktrace.jenkins-ci.org/search/?query=hudson.tools.ToolInstallation.translateForentity=method at hudson.tasks.Maven$MavenInstallation.forNode(Maven.java:610) http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.Maven$MavenInstallation.forNodeentity=method at hudson.tasks.Maven.perform(Maven.java:289) http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.Maven.performentity=method at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.performentity=method at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performentity=method at hudson.model.Build$BuildExecution.build(Build.java:199) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.buildentity=method at hudson.model.Build$BuildExecution.doRun(Build.java:160) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.doRunentity=method at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:585) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.runentity=method at hudson.model.Run.execute(Run.java:1676) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.executeentity=method at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.runentity=method at hudson.model.ResourceController.execute(ResourceController.java:88) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.executeentity=method at hudson.model.Executor.run(Executor.java:231) http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.runentity=methodCaused by: java.io.IOException http://stacktrace.jenkins-ci.org/search?query=java.io.IOException: Failed to mkdirs: /home/hudson/tools/maven/apache-maven-3.0.4 at hudson.FilePath.mkdirs(FilePath.java:1069) http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.mkdirsentity=method at hudson.FilePath.installIfNecessaryFrom(FilePath.java:732) http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.installIfNecessaryFromentity=method ... 15 more
Re: H2O integration - intermediate progress update
Hi All, Sorry to hijack the thread. I am a newbie in mahout community - please pardon my words if anyone finds them unsuitable. Its really strange to see such heated discussions between the Big Shots on the mailing lists. I am absolute beginner in this space and it does not leave a very good impression about the open source community itself. What I believe is - Open Source is about love of code and all awesome coders coming together - designing some of the coolest code projects on the planet as one *strong team*. Lets not break this belief of newbies. We are learning from you guys. The avengers should not fight. Best Regards, Yash On Thu, Jun 19, 2014 at 10:06 PM, Dmitriy Lyubimov dlie...@gmail.com wrote: Well, let me tell my impression. Remember, we started talking impressions here all over the place, not facts. So *don't ask me to prove anything.* i have an impression that mr. Dunning has masterfully concealed a very targeted insult in his carefully worded statement with the sole purpose of forcing certain participants to go into defensive and to turn a technical discussion into trading insults, in which he has obviously partially succeeded. I have an impression this has not been an isolated incident on mr. Dunning's part in the past, and i have strong suspicion that it was the wrong balance of technical merit and posturing in the project that drove more than one accomplished committer or candidate out in the past. I also have been receiving an impression that I am next such target on mr. Dunnings part just because my arguments are not technically favorable where he needs them to be favorable for whatever other-than-technical reason. I love the code in the project, that's in part why i am candid in its discussions, but it is repeated agrumentum ad hominem from mr. Dunning that is very close to driving me out. And I don't think beers can smooth that. As for welcoming, well, h2o is not exactly new topic here. I also think we need to have some bar for proposals to meet regardless of being welcoming. Finally, I have an impression everybody has areas where they possess less than brilliant expertise; i actually like to say about myself that it pains me how little i know. I have no problem identifying areas of weaknesses in myself publicly and don't consider this to be offensive, since i know that the only way to improve knowledge is to first know where it is lacking. I am very perceptive to strong logical argument regardless if it fits my current world view or not. But I am particularly not fond of rhetorical fallacies, informal ones in particular. I am not very fond of marketing bluff or empty PR. It is a personal choice whether you accept that mindset or not, but grading areas of weakness is not an insult. That's what they do in universities all the time, after all.
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020134#comment-14020134 ] Yash Sharma commented on MAHOUT-1485: - I have added the markup version of the doc at this location. I was unable to find markup for table and images so have left them unchanged. https://docs.google.com/document/d/1AZayXY4Di_8CBf0VRUTsFuldBm_HdI5UVmqX07Wg12Q/edit?usp=sharing Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001542#comment-14001542 ] Yash Sharma commented on MAHOUT-1485: - Roger that. Would update the doc soon. Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993029#comment-13993029 ] Yash Sharma commented on MAHOUT-1485: - Have updated the google document at the same location. Let me know if it looks good or I have to add/modify any part. Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986423#comment-13986423 ] Yash Sharma commented on MAHOUT-1485: - Yes I would love to. Let me send updated draft this weekend. Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980045#comment-13980045 ] Yash Sharma commented on MAHOUT-1485: - Have been reading about solr based recommenders. Should the new overview page be based on the code here by Pat : https://github.com/pferrel/solr-recommender/. Also are there any plans of merging this code in mahout as well? Am creating a sample document here and would keep on documenting my findings here: https://docs.google.com/document/d/1iwzcvIbXudSCEZ6n5J5lAhoGGf78Qo9LQsaAvChzMV4/edit I also agree that we should retain the current overview page as well because its a popular implementation and lot of people are using this approach. We can have a new page talking about online recommenders powered with search engines. Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976697#comment-13976697 ] Yash Sharma commented on MAHOUT-1485: - Thanks for reviewing Ted. I can compute the item similarities offline and store them somewhere. Could you give some more pointers on how text search engine can be used for calculating recommendations for the pre-computed similarities. I can try some code over it and create documentation over it. Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
New Contributor to Mahout
Hey All, I am Yash, a bigdata engineer and an opensource fan. I have been a Mahout user for sometime now and am interested in giving back to the community. I am digging mahout source currently and am interested in contributing towards the Collaborative Filtering part. I am interested in contributing both in terms of code and documents/wiki posts etc. I am browsing through the JIRA currently to see active sections of CF. Is there any specific part of CF that I must have a look into and start exploring. What are the areas that might be a good place to start contributing? Suggestions? Peace, Yash
[jira] [Commented] (MAHOUT-1485) Clean up Recommender Overview page
[ https://issues.apache.org/jira/browse/MAHOUT-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975211#comment-13975211 ] Yash Sharma commented on MAHOUT-1485: - I have started working on this.. Could anyone tell me what sort of cleaning are we expecting.. Is it about simplifying the content for new users. I have created a new minimal architecture diagram, and have put together the code examples mentioned on the page. https://docs.google.com/document/d/1skpBE0KFEPTi_pr615Dnn7bCtbzK-fMvpbzGxkLTTXU/edit?usp=sharing Let me know your thoughts on this. I would move ahead towards completing the document if these look good. Clean up Recommender Overview page -- Key: MAHOUT-1485 URL: https://issues.apache.org/jira/browse/MAHOUT-1485 Project: Mahout Issue Type: Improvement Components: Documentation Reporter: Sebastian Schelter Assignee: Sebastian Schelter Fix For: 1.0 Clean up the recommender overview page, remove outdated content and make sure the examples work. https://mahout.apache.org/users/recommender/recommender-documentation.html -- This message was sent by Atlassian JIRA (v6.2#6252)
