spark ec2 script doest not install necessary files to launch spark

2015-11-06 Thread Emaasit
Hello, I followed the instructions for launching Spark 1.5.1 on my AWS EC2 but the script is not installing all the folders/files required to initialize Spark. Since the log message is long, I have created a gist here: https://gist.github.com/Emaasit/696145959bbbd989bfe1 Please help. I have been

Re: inlcudePackage() deprecated?

2015-06-04 Thread Daniel Emaasit
-6817 Thanks Shivaram On Thu, Jun 4, 2015 at 3:10 AM, Daniel Emaasit daniel.emaa...@gmail.com wrote: Hello Shivaram, Was the includePackage() function deprecated in SparkR 1.4.0? I don't see it in the documentation? If it was, does that mean that we can use R packages on Spark DataFrames

Re: DataFrames coming in SparkR in Apache Spark 1.4.0

2015-06-03 Thread Emaasit
You can build Spark from the 1.4 release branch yourself: https://github.com/apache/spark/tree/branch-1.4 - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com

Error: Building Spark 1.4.0 from Github-1.4 release branch

2015-06-03 Thread Emaasit
xception C:\Program Files\Apache Software Foundation\spark-branch-1.4 - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com -- View this message in context: http

Re: Spark 1.4.0 build Error on Windows

2015-06-03 Thread Daniel Emaasit
! Shivaram On Tue, Jun 2, 2015 at 6:05 PM, Daniel Emaasit daniel.emaa...@gmail.com wrote: Oops, My bad. I was building from the wrong Directory. On Tue, Jun 2, 2015 at 5:57 PM, Daniel Emaasit daniel.emaa...@gmail.com wrote: Hello Shivaram, While I was able to build Spark 1.3.0. I am

DataFrames coming in SparkR in Apache Spark 1.4.0

2015-06-02 Thread Emaasit
/latest/sparkr.html Happy coding, Daniel - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com -- View this message in context: http://apache-spark-user-list.1001560

Re: IDE for sparkR

2015-06-02 Thread Emaasit
, lib), .libPaths())) library(SparkR) sc - sparkR.init(master=local) - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com -- View this message in context: http

Book: Data Analysis with SparkR

2014-11-21 Thread Emaasit
Is the a book on SparkR for the absolute terrified beginner? I use R for my daily analysis and I am interested in a detailed guide to using SparkR for data analytics: like a book or online tutorials. If there's any please direct me to the address. Thanks, Daniel -- View this message in