Re: Should we consider a Spark 2.1.1 release?

2017-03-19 Thread Holden Karau
This discussions seems like it might benefit from its own thread as we've previously decided to lengthen release cycles but if their are different opinions about this it seems unrelated to the specific 2.1.1 release. On Sun, Mar 19, 2017 at 2:57 PM Jacek Laskowski wrote: > Hi

Re: Should we consider a Spark 2.1.1 release?

2017-03-19 Thread Jacek Laskowski
Hi Mark, I appreciate your comment. My thinking is that the more frequent minor and patch releases the more often end users can give them a shot and be part of the bigger release cycle for major releases. Spark's an OSS project and we all can make mistakes and my thinking is is that the more

Re: Should we consider a Spark 2.1.1 release?

2017-03-19 Thread Mark Hamstra
That doesn't necessarily follow, Jacek. There is a point where too frequent releases decrease quality. That is because releases don't come for free -- each one demands a considerable amount of time from release managers, testers, etc. -- time that would otherwise typically be devoted to improving

Re: Should we consider a Spark 2.1.1 release?

2017-03-19 Thread Jacek Laskowski
+1 More smaller and more frequent releases (so major releases get even more quality). Jacek On 13 Mar 2017 8:07 p.m., "Holden Karau" wrote: > Hi Spark Devs, > > Spark 2.1 has been out since end of December >

Re: how to retain part of the features in LogisticRegressionModel (spark2.0)

2017-03-19 Thread Dhanesh Padmanabhan
It shouldn't be difficult to convert the coefficients to a sparse vector. Not sure if that is what you are looking for -Dhanesh On Sun, Mar 19, 2017 at 5:02 PM jinhong lu wrote: Thanks Dhanesh, and how about the features question? 在 2017年3月19日,19:08,Dhanesh Padmanabhan

Re: how to retain part of the features in LogisticRegressionModel (spark2.0)

2017-03-19 Thread jinhong lu
Thanks Dhanesh, and how about the features question? > 在 2017年3月19日,19:08,Dhanesh Padmanabhan 写道: > > Dhanesh Thanks, lujinhong

Re: how to retain part of the features in LogisticRegressionModel (spark2.0)

2017-03-19 Thread Dhanesh Padmanabhan
binomial. Please use in combination with onevsrest for multi-class problems in spark 2.0.2 Dhanesh +91-9741125245 On Sun, Mar 19, 2017 at 4:29 PM, jinhong lu wrote: > By the way, I found in spark 2.1 I can use setFamily() to decide binomial > or multinomial, but how can

Re: how to retain part of the features in LogisticRegressionModel (spark2.0)

2017-03-19 Thread jinhong lu
By the way, I found in spark 2.1 I can use setFamily() to decide binomial or multinomial, but how can I do the same thing in spark 2.0.2? If not support , which one is used in spark 2.0.2? binomial or multinomial? > 在 2017年3月19日,18:12,jinhong lu 写道: > > > I train my