I am trying to perform some insert column operations in dataframe.
Following is the code I used:
val df = sqlContext.read.json(examples/src/main/resources/people.json)
df.show() { works correctly }
df.withColumn(age, df.col(name) ) { works correctly }
df.withColumn(age, df.col(name) ).show()
Hi,
I am trying to extract the filenames from which a Dstream is generated by
parsing the toDebugString method on RDD
I am implementing the following code in spark-shell:
import org.apache.spark.streaming.{StreamingContext, Seconds}
val ssc = new StreamingContext(sc,Seconds(10))
val lines =
I also started the streaming context by running ssc.start() but still apart
from logs nothing of g gets printed.
-- Forwarded message --
From: Animesh Baranawal animeshbarana...@gmail.com
Date: Thu, May 28, 2015 at 6:57 PM
Subject: SPARK STREAMING PROBLEM
To: user@spark.apache.org
