Re: Making more features in Logistic Regression

[miro]

Yes, I was thinking going down this road:

http://scikit-learn.org/stable/modules/linear_model.html#polynomial-regression-extending-linear-models-with-basis-functions
 

http://stats.stackexchange.com/questions/58739/polynomial-regression-using-scikit-learn
 



But I’m not sure if spark actually has polynomial regression implemented (I 
couldn’t find it) - maybe SparkML gurus can help here? 

You could take a look also at scikit integration package with Spark 
(https://github.com/databricks/spark-sklearn 
).

Hope it helped :)

All the best,
m.



> On 18 Oct 2016, at 20:36, aditya1702  wrote:
> 
>  
>  
> 
> 
> 
> --
> View this message in context: 
> http://apache-spark-user-list.1001560.n3.nabble.com/Making-more-features-in-Logistic-Regression-tp27915p27918.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
> 
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
> 

Re: Making more features in Logistic Regression

[miro]

Hi, 

I think it depends on how non-linear data you have. You could add polynomial to 
your model,..but everything depends on your data. If you could share more 
details maybe a scatter plot, would help to investigate the problem further.

All the best,
Miro


> On 18 Oct 2016, at 19:09, aditya1702  wrote:
> 
> Hello,
> I am trying to solve a problem of Logistic Regression using Spark. I am
> still a newbie to machine learning. I wanted to ask that if I have 2
> features for logistic regression and if the features are non-linear
> (regularized logistic regression) do we have to make more features by
> considering the higher powers of the features?
> 
> 
> 
> --
> View this message in context: 
> http://apache-spark-user-list.1001560.n3.nabble.com/Making-more-features-in-Logistic-Regression-tp27915.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
> 
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
> 


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

java: see logging output in in UI

[Miro Karpis]

Hi,
please, I would like to see my debug/error info logged in the spark web ui.

Problem is that in my current setup running master locally (and connecting
my pc as a worker node) I can see output in my console (my debug info) but
not in the stderr.

I have tried different setups, Logger, RootLogger,..different setups of
log4j.properties,...but no luck.

Please, do you have some quick example that how do you handle logging? I'm
running on Spark 2.0.

Thank you very much for any kind of information :)

All the best,
Miro