Re: sparkR could not find function textFile

2015-07-01 Thread Sourav Mazumder
...@eecs.berkeley.edu shiva...@eecs.berkeley.edu Cc: Aleksander Eskilson alek.eskil...@cerner.com, user@spark.apache.org user@spark.apache.org Subject: Re: sparkR could not find function textFile Thanks to both Shivaram and Alek. Then if I want to create DataFrame from comma separated flat files, what would

Re: sparkR could not find function textFile

2015-07-01 Thread Shivaram Venkataraman
Zhou zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 4:15 PM To: shiva...@eecs.berkeley.edu shiva...@eecs.berkeley.edu Cc: Aleksander Eskilson alek.eskil...@cerner.com, user@spark.apache.org user@spark.apache.org Subject: Re: sparkR could not find function textFile Thanks to both

Re: sparkR could not find function textFile

2015-07-01 Thread Sourav Mazumder
...@gmail.com Date: Thursday, June 25, 2015 at 4:15 PM To: shiva...@eecs.berkeley.edu shiva...@eecs.berkeley.edu Cc: Aleksander Eskilson alek.eskil...@cerner.com, user@spark.apache.org user@spark.apache.org Subject: Re: sparkR could not find function textFile Thanks to both Shivaram and Alek

Re: sparkR could not find function textFile

2015-06-26 Thread Eskilson,Aleksander
...@eecs.berkeley.edumailto:shiva...@eecs.berkeley.edu, user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: sparkR could not find function textFile I tried out the solution using spark-csv package, and it worked fine now :) Thanks. Yes, I'm playing

Re: sparkR could not find function textFile

2015-06-26 Thread Wei Zhou
, 2015 at 4:38 PM To: Aleksander Eskilson alek.eskil...@cerner.com Cc: shiva...@eecs.berkeley.edu shiva...@eecs.berkeley.edu, user@spark.apache.org user@spark.apache.org Subject: Re: sparkR could not find function textFile I tried out the solution using spark-csv package, and it worked fine

sparkR could not find function textFile

2015-06-25 Thread Wei Zhou
Hi all, I am exploring sparkR by activating the shell and following the tutorial here https://amplab-extras.github.io/SparkR-pkg/ And when I tried to read in a local file with textFile(sc, file_location), it gives an error could not find function textFile. By reading through sparkR doc for 1.4,

Re: sparkR could not find function textFile

2015-06-25 Thread Eskilson,Aleksander
at 3:33 PM To: user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: sparkR could not find function textFile Hi all, I am exploring sparkR by activating the shell and following the tutorial here https://amplab-extras.github.io/SparkR-pkg

Re: sparkR could not find function textFile

2015-06-25 Thread Wei Zhou
, Alek [1] -- https://issues.apache.org/jira/browse/SPARK-7230 From: Wei Zhou zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 3:33 PM To: user@spark.apache.org user@spark.apache.org Subject: sparkR could not find function textFile Hi all, I am exploring sparkR by activating

Re: sparkR could not find function textFile

2015-06-25 Thread Wei Zhou
SparkR:::textFile(…). Hope that helps, Alek [1] -- https://issues.apache.org/jira/browse/SPARK-7230 From: Wei Zhou zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 3:33 PM To: user@spark.apache.org user@spark.apache.org Subject: sparkR could not find function textFile Hi all

Re: sparkR could not find function textFile

2015-06-25 Thread Shivaram Venkataraman
at 3:33 PM To: user@spark.apache.org user@spark.apache.org Subject: sparkR could not find function textFile Hi all, I am exploring sparkR by activating the shell and following the tutorial here https://amplab-extras.github.io/SparkR-pkg/ https://urldefense.proofpoint.com/v2/url?u=https

Re: sparkR could not find function textFile

2015-06-25 Thread Eskilson,Aleksander
...@cerner.commailto:alek.eskil...@cerner.com Cc: user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: sparkR could not find function textFile Hi Alek, Just a follow up question. This is what I did in sparkR shell: lines - SparkR:::textFile(sc, ./README.md

Re: sparkR could not find function textFile

2015-06-25 Thread Wei Zhou
://issues.apache.org/jira/browse/SPARK-7230 From: Wei Zhou zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 3:33 PM To: user@spark.apache.org user@spark.apache.org Subject: sparkR could not find function textFile Hi all, I am exploring sparkR by activating the shell and following

Re: sparkR could not find function textFile

2015-06-25 Thread Shivaram Venkataraman
zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 3:33 PM To: user@spark.apache.org user@spark.apache.org Subject: sparkR could not find function textFile Hi all, I am exploring sparkR by activating the shell and following the tutorial here https://amplab-extras.github.io/SparkR-pkg

Re: sparkR could not find function textFile

2015-06-25 Thread Eskilson,Aleksander
@spark.apache.orgmailto:user@spark.apache.org Subject: Re: sparkR could not find function textFile Thanks to both Shivaram and Alek. Then if I want to create DataFrame from comma separated flat files, what would you recommend me to do? One way I can think of is first reading the data as you would do

Re: sparkR could not find function textFile

2015-06-25 Thread Wei Zhou
From: Wei Zhou zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 4:15 PM To: shiva...@eecs.berkeley.edu shiva...@eecs.berkeley.edu Cc: Aleksander Eskilson alek.eskil...@cerner.com, user@spark.apache.org user@spark.apache.org Subject: Re: sparkR could not find function textFile Thanks

Re: sparkR could not find function textFile

2015-06-25 Thread Wei Zhou
, for example, you’d use SparkR:::textFile(…). Hope that helps, Alek [1] -- https://issues.apache.org/jira/browse/SPARK-7230 From: Wei Zhou zhweisop...@gmail.com Date: Thursday, June 25, 2015 at 3:33 PM To: user@spark.apache.org user@spark.apache.org Subject: sparkR could not find function