let's say my json file lines looks like this
{user: baz, tags : [foo, bar] }
sqlContext.jsonFile(data.json)
...
How could I query for user with bar tags using SQL
sqlContext.sql(select user from users where tags ?contains? 'bar' )
I could simplify the request and use the returned RDD to
yeah that's where I ended up. Thanks ! I'll give it a try.
On Thu, Jan 15, 2015 at 8:46 PM, Ayoub [via Apache Spark User List]
ml-node+s1001560n21172...@n3.nabble.com wrote:
You could try to use hive context which bring HiveQL, it would allow you
to query nested structures using LATERAL VIEW
