Re: json in Cassandra to RDDs

2017-07-01 Thread ayan guha
Hi If you are asking how to parse the json column from Cassandra, I would suggest you to look into from_json function. It would help you to parse a json field, given you know the schema upfront. On Sat, Jul 1, 2017 at 8:54 PM, Conconscious wrote: > Hi list, > > I'm using Cassandra with only 2 f

json in Cassandra to RDDs

2017-07-01 Thread Conconscious
Hi list, I'm using Cassandra with only 2 fields (id, json). I'm using Spark to query the json. Until now I can use a json file and query that file, but Cassandra and RDDs of the json field not yet. sc = spark.sparkContext path = "/home/me/red50k.json" redirectsDF = spark.read.json(path) redirects