Re: [VOTE] SPIP ML Pipelines in R

2018-06-14 Thread Hossein
The vote passed with following +1. - Felix - Joseph - Xiangrui - Reynold Joseph has kindly volunteered to shepherd this. Thanks, --Hossein On Thu, Jun 14, 2018 at 1:32 PM Reynold Xin wrote: > +1 on the proposal. > > > On Fri, Jun 1, 2018 at 8:17 PM Hossein wrote: > >>

Re: [VOTE] SPIP ML Pipelines in R

2018-06-01 Thread Hossein
Hi Shivaram, We converged on a CRAN release process that seems identical to current SparkR. --Hossein On Thu, May 31, 2018 at 9:10 AM, Shivaram Venkataraman < shiva...@eecs.berkeley.edu> wrote: > Hossein -- Can you clarify what the resolution on the repository / > release iss

[VOTE] SPIP ML Pipelines in R

2018-05-30 Thread Hossein
pache.org/jira/browse/SPARK-24359> for a vote. +1: Let's go ahead and implement the SPIP. +0: Don't really care. -1: I do not think this is a good idea for the following reasons. Thanks, --Hossein

Re: SparkR was removed from CRAN on 2018-05-01

2018-05-29 Thread Hossein
I guess this relates to our conversation on the SPIP <https://issues.apache.org/jira/browse/SPARK-24359>. When this happens, do we wait for a new minor release to submit it to CRAN again? --Hossein On Fri, May 25, 2018 at 5:11 PM, Felix Cheung wrote: > This is the fix > https:

SparkR was removed from CRAN on 2018-05-01

2018-05-25 Thread Hossein
Would you please forward the email from CRAN? Is there a JIRA? Thanks, --Hossein

Re: ML Pipelines in R

2018-05-22 Thread Hossein
Correction: the SPIP is https://issues.apache.org/jira/browse/SPARK-24359 --Hossein On Tue, May 22, 2018 at 6:23 PM, Hossein <fal...@gmail.com> wrote: > Hi all, > > SparkR supports calling MLlib functionality with an R-friendly API. Since > Spark 1.5 the (new) SparkML

ML Pipelines in R

2018-05-22 Thread Hossein
; comments. Thanks, --Hossein

Re: SparkR dataframe UDF

2015-10-06 Thread Hossein
User defined functions written in R are not supposed yet. You can implement your UDF in Scala, register it in sqlContext and use it in SparkR, provided that you share your context between R and Scala. --Hossein On Friday, October 2, 2015, Renyi Xiong <renyixio...@gmail.com> wrote: >

Re: SparkR package path

2015-09-24 Thread Hossein
run SparkR. --Hossein On Wed, Sep 23, 2015 at 7:28 PM, Sun, Rui <rui@intel.com> wrote: > SparkR package is not a standalone R package, as it is actually R API of > Spark and needs to co-operate with a matching version of Spark, so exposing > it in CRAN does not ease use of R users

Re: SparkR package path

2015-09-24 Thread Hossein
al machine. I have got this request from some R users. Their company has a Spark cluster (usually managed by another team), and they want to connect to it from their workstation (e.g., from within RStudio, etc). --Hossein On Thu, Sep 24, 2015 at 12:25 PM, Shivaram Venkataraman < shiva...@eecs

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Hossein
+1 tested SparkR on Mac and Linux. --Hossein On Thu, Sep 24, 2015 at 3:10 PM, Xiangrui Meng <men...@gmail.com> wrote: > +1. Checked user guide and API doc, and ran some MLlib and SparkR > examples. -Xiangrui > > On Thu, Sep 24, 2015 at 2:54 PM, Reynold Xin <r...@databrick

Re: SparkR package path

2015-09-23 Thread Hossein
RStudio. While that is a bigger task, for now, first step could be not requiring them to download Spark source and run a script that is named install-dev.sh. I filed SPARK-10776 to track this. --Hossein On Tue, Sep 22, 2015 at 7:21 PM, Shivaram Venkataraman < shiva...@eecs.berkeley.edu>

SparkR package path

2015-09-21 Thread Hossein
ntime. Do you think this change is feasible? Thanks, --Hossein