Sorry .. toDF() gives an error
[error]
/home/ubuntu/work/spark/spark-samples/ml-samples/src/main/scala/sql/InferredSchema.scala:24:
value toDF is not a member of org.apache.spark.rdd.RDD[Person]
[error] val people =
sc.textFile("/home/ubuntu/work/spark-src/spark/examples/src/main/resources/people.txt").map(_.split(",")).map(p
=> Person(p(0), p(1).trim.toInt)).toDF()
On Sun, May 17, 2015 at 5:41 PM, Cheng, Hao <hao.ch...@intel.com> wrote:
> Typo? Should be .toDF(), not .toRD()
>
>
>
> *From:* Ram Sriharsha [mailto:sriharsha....@gmail.com]
> *Sent:* Monday, May 18, 2015 8:31 AM
> *To:* Rajdeep Dua
> *Cc:* user
> *Subject:* Re: InferredSchema Example in Spark-SQL
>
>
>
> you mean toDF() ? (toDF converts the RDD to a DataFrame, in this case
> inferring schema from the case class)
>
>
>
>
>
>
>
> On Sun, May 17, 2015 at 5:07 PM, Rajdeep Dua <rajdeep....@gmail.com>
> wrote:
>
> Hi All,
>
> Was trying the Inferred Schema spart example
>
> http://spark.apache.org/docs/latest/sql-programming-guide.html#overview
>
>
>
> I am getting the following compilation error on the function toRD()
>
>
>
> value toRD is not a member of org.apache.spark.rdd.RDD[Person]
>
> [error] val people =
> sc.textFile("/home/ubuntu/work/spark-src/spark/examples/src/main/resources/people.txt").map(_.split(",")).map(p
> => Person(p(0), p(1).trim.toInt)).toRD()
>
> [error]
>
>
>
> Thanks
>
> Rajdeep
>
>
>
>
>
>
>
>
