Re: [SparkR] Missing Spark APIs in R

2015-06-30 Thread Pradeep Bashyal
Thanks Shivaram. I watched your talk and the plan to use ML APIs with R flavor looks exciting. Is there a different venue where I would be able to follow the SparkR API progress? Thanks Pradeep On Mon, Jun 29, 2015 at 1:12 PM, Shivaram Venkataraman shiva...@eecs.berkeley.edu wrote: The RDD

Re: [SparkR] Missing Spark APIs in R

2015-06-30 Thread Shivaram Venkataraman
The Spark JIRA and the user, dev mailing lists are the best place to follow the progress. Shivaram On Tue, Jun 30, 2015 at 9:52 AM, Pradeep Bashyal prad...@bashyal.com wrote: Thanks Shivaram. I watched your talk and the plan to use ML APIs with R flavor looks exciting. Is there a different

[SparkR] Missing Spark APIs in R

2015-06-29 Thread Pradeep Bashyal
Hello, I noticed that some of the spark-core APIs are not available with version 1.4.0 release of SparkR. For example textFile(), flatMap() etc. The code seems to be there but is not exported in NAMESPACE. They were all available as part of the AmpLab Extras previously. I wasn't able to find any

Re: [SparkR] Missing Spark APIs in R

2015-06-29 Thread Shivaram Venkataraman
The RDD API is pretty complex and we are not yet sure we want to export all those methods in the SparkR API. We are working towards exposing a more limited API in upcoming versions. You can find some more details in the recent Spark Summit talk at