Re: Spark 2.0.0 : GLM problem

2016-06-22 Thread april_ZMQ
The picture below shows the reply from the creator for this package, Yanbo Liang( https://github.com/yanboliang ) -- View this message in context:

Re: Spark 2.0.0 : GLM problem

2016-06-14 Thread april_ZMQ
To update the post: • First problem: This problem can be solved by adding a epsilon(very small value to 0 value). Because in poisson model, it doesn't allow the y value to be zero. But in general, it doesn't have this requirement. But now I encounter another problem that in every GLM

Spark 2.0.0 : GLM problem

2016-06-13 Thread april_ZMQ
Hi ALL, I’ve tried the GLM (General Linear Model) of Spark 2.0.0-preview. And I’ve countered some unexpected problems. • First problem: I test the “poisson” family type GLM with a very small dataset using SparkR 2.0.0 This dataset can run “poisson” family type GLM in general R successfully.

SparkR : glm model

2016-06-09 Thread april_ZMQ
Hi all, I'm a student who are working on a data analysis project with sparkR. I found out that GLM (generalized linear model) only supports two types of distribution, "gaussian" and "binomial". However, our project is requiring the "poisson" distribution. Meanwhile, I found out that sparkR