SparkR and RDDs

2015-05-25 Thread Andrew Psaltis
Hi, I understand from SPARK-6799[1] and the respective merge commit [2] that the RDD class is private in Spark 1.4 . If I wanted to modify the old Kmeans and/or LR examples so that the computation happened in Spark what is the best direction to go? Sorry if I am missing something obvious, but base

Re: SparkR and RDDs

2015-05-26 Thread Eskilson,Aleksander
Date: Monday, May 25, 2015 at 6:25 PM To: "dev@spark.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>> Subject: SparkR and RDDs Hi, I understand from SPARK-6799[1] and the respective merge commit [2] that the RDD class is private in Spark 1.4 . If I wa

Re: SparkR and RDDs

2015-05-26 Thread Andrew Psaltis
skilson > > From: Andrew Psaltis > Date: Monday, May 25, 2015 at 6:25 PM > To: "dev@spark.apache.org" > Subject: SparkR and RDDs > > Hi, > I understand from SPARK-6799[1] and the respective merge commit [2] that > the RDD class is private in Spark 1.4 . If

Re: SparkR and RDDs

2015-05-26 Thread Reynold Xin
they have the namespace identifier tacked on the front. I >> hope that helps. >> >> Regards, >> Alek Eskilson >> >> From: Andrew Psaltis >> Date: Monday, May 25, 2015 at 6:25 PM >> To: "dev@spark.apache.org" >> Subject: SparkR and RDDs >

Re: SparkR and RDDs

2015-05-27 Thread Shivaram Venkataraman
ace identifier tacked on the front. I >>> hope that helps. >>> >>> Regards, >>> Alek Eskilson >>> >>> From: Andrew Psaltis >>> Date: Monday, May 25, 2015 at 6:25 PM >>> To: "dev@spark.apache.org" >>> Subject:

Re: SparkR and RDDs

2015-05-27 Thread Andrew Psaltis
ns that >>>> you may still access them by using the namespace prefix SparkR with three >>>> colons, e.g. SparkR:::func(foo, bar). >>>> >>>> So a starting place for porting old SparkR scripts from before the >>>> merge could be to identif