The SQL parser without HiveContext is really simple, which is why I generally recommend users use HiveContext. However, you can do it with dataframes:
import org.apache.spark.sql.functions._ table("purchases").select(explode(df("purchase_items")).as("item")) On Fri, Sep 25, 2015 at 4:21 PM, Jerry Lam <chiling...@gmail.com> wrote: > Hi sparkers, > > Anyone knows how to do LATERAL VIEW EXPLODE without HiveContext? > I don't want to start up a metastore and derby just because I need LATERAL > VIEW EXPLODE. > > I have been trying but I always get the exception like this: > > Name: java.lang.RuntimeException > Message: [1.68] failure: ``union'' expected but identifier view found > > with the query look like: > > "select items from purhcases lateral view explode(purchase_items) tbl as > items" > > Best Regards, > > Jerry > >