Logistic regression with L1 regularization is generally at least as good as SVM. The problem with SVM is that it uses radially symmetric regularization which doesn't learn sparse solutions very well. L1 regularization is much better for that.
On Tue, Dec 24, 2013 at 10:06 AM, Steven Bourke <sbou...@gmail.com> wrote: > Just test out libsvm against log regression on a sample of your data to > get an understanding of upside downside for your particular problem > > Sent from my iPhone > > > On 24 Dec 2013, at 15:55, Tharindu Rusira <tharindurus...@gmail.com> > wrote: > > > > Thanks all for the words of wisdom :) , > > > > @Ted, I'm coming from a text mining background. Many text books recommend > > SVM because of its impressive performance with vectors having a larger > > cardinality which is the usual case when dealing with text documents. Do > > you think logistic regression would perform as good as SVM for text > mining > > applications? > > > > Thanks > > > > > > On Tue, Dec 24, 2013 at 3:47 PM, unmesha sreeveni <unmeshab...@gmail.com > >wrote: > > > >> You can paralize svm using same equations (which has slight difference) > >> explained in > >> > >> > http://books.google.co.in/books/about/DATA_MINING.html?id=IYc2muhCbmEC&redir_esc=y > >> > >> But i dont gaurentee about the performance. for some 100 MB data it > takes > >> 10 min to train the data. > >> > >> > >>> On Tue, Dec 24, 2013 at 3:30 PM, tuku <utku.ya...@gmail.com> wrote: > >>> > >>> someone tried to implement SVM in a summer google code but it turns out > >> map > >>> reduced version of svm is too difficult to implement and they dropped > the > >>> project. > >>> I bet you can train via libsvm and use just classification part with > map > >>> reduce but if I have a choice I prefer logistic regression too > >> > ~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~--~ > >>> If you don't know where you're going, any road will get you there > >>> "Not all those who wander are lost." - J.R.R. Tolkien > >>> "Fish don't know they're in water." > >>> "Smile, breathe and go slowly." - Thich Nhat Hanh, Zen Buddhist monk > >>> "Zamanlarını para kazanmak ve saklamakla geçirenler, sonunda, en çok > >>> istediklerinin satın alınamayacak şeyler olduğunu anlarlar." > >>> "And in the end, it's not the years in your life that count. It's the > >> life > >>> in your years." > >>> "in 20 years, you will be more dissapointed by what you didn't do than > >> what > >>> you did." > >>> "If you want to go fast, go alone. If you want to go far, go with > >> others." > >>> "Remember, happiness is a way of travel not a destination" > >>> "A good traveller has no fixed plans, and is not intent on arriving." > >>> > >>> > >>>> On 24 December 2013 11:11, Ted Dunning <ted.dunn...@gmail.com> wrote: > >>>> > >>>> You might try logistic regression with regularization for a very > >> similar > >>>> result. > >>>> > >>>> > >>>> On Mon, Dec 23, 2013 at 11:57 PM, Sebastian Schelter < > >>>> ssc.o...@googlemail.com> wrote: > >>>> > >>>>> Hi Tharindu, > >>>>> > >>>>> There is no SVM implementation in an official release. > >>>>> > >>>>> --sebastian > >>>>> > >>>>>> On 24.12.2013 08:02, Tharindu Rusira wrote: > >>>>>> Hi all, > >>>>>> Do we have a SVM implementation in Mahout(either sequential or > >>>>> mapreduce)? > >>>>>> I was searching in JIRA and MAHOUT-14[1] proposes a SVM > >>> implementation > >>>>> and > >>>>>> also MAHOUT-334, MAHOUT-232 have patches available for SVM. > >>>>>> Are these codes available in any Mahout release? Because the > >> comments > >>>> in > >>>>>> these issues suggest otherwise. > >>>>>> > >>>>>> [1] > >> > https://issues.apache.org/jira/browse/MAHOUT-14?jql=project%20%3D%20MAHOUT%20AND%20text%20~%20%22svm%22 > >>>>>> [2] > >> > https://issues.apache.org/jira/browse/MAHOUT-334?jql=project%20%3D%20MAHOUT%20AND%20text%20~%20%22svm%22 > >>>>>> [3] > >> > https://issues.apache.org/jira/browse/MAHOUT-232?jql=project%20%3D%20MAHOUT%20AND%20text%20~%20%22svm%22 > >>>>>> > >>>>>> Thanks, > >> > >> > >> > >> -- > >> *Thanks & Regards* > >> > >> Unmesha Sreeveni U.B > >> > >> *Junior Developer* > >> http://www.unmeshasreeveni.blogspot.in/ > > > > > > > > -- > > M.P. Tharindu Rusira Kumara > > > > Department of Computer Science and Engineering, > > University of Moratuwa, > > Sri Lanka. > > +94757033733 > > www.tharindu-rusira.blogspot.com >
