Hi there,
Parallelize is part of the RDD API which was made private for Spark v.
1.4.0. Some functions in the RDD API were considered too low-level to
expose, so only most of the DataFrame API is currently public. The
original rationale for this decision can be found on the issue's JIRA [1].
The
Thanks! It's good to know
--- Original Message ---
From: Eskilson,Aleksander alek.eskil...@cerner.com
Sent: June 25, 2015 5:57 AM
To: Felix C felixcheun...@hotmail.com, user@spark.apache.org
Subject: Re: SparkR parallelize not found with 1.4.1?
Hi there,
Parallelize is part of the RDD API
---
From: Eskilson,Aleksander alek.eskil...@cerner.com
Sent: June 25, 2015 5:57 AM
To: Felix C felixcheun...@hotmail.com, user@spark.apache.org
Subject: Re: SparkR parallelize not found with 1.4.1?
Hi there,
Parallelize is part of the RDD API which was made private for Spark v.
1.4.0. Some
Hi,
It must be something very straightforward...
Not working:
parallelize(sc)
Error: could not find function parallelize
Working:
df - createDataFrame(sqlContext, localDF)
What did I miss?
Thanks
