Re: Dynamic sql in Spark 1.5

Sorry, I'm not quite following what your intent is. Not sure how TagN column is being derived. Is Dataset1 your input and Dataset 2 your output? I Don't see the relationship between them clearly. Can you describe your input, and the expected output. -- Ali On Feb 2, 2016, at 11:28 PM,

Re: Dynamic sql in Spark 1.5

Hi, I have data set like : Dataset 1 HeaderCol1 HeadCol2 HeadCol3 dataset 1 dataset2 dataset 3 dataset 11 dataset13 dataset 13 dataset 21 dataset22 dataset 23 Datset 2 HeadColumn1 HeadColumn2HeadColumn3 HeadColumn4 Tag1 Dataset1 Tag2 Dataset1

Re: Dynamic sql in Spark 1.5

While you can construct the SQL string dynamically in scala/java/python, it would be best to use the Dataframe API for creating dynamic SQL queries. See http://spark.apache.org/docs/1.5.2/sql-programming-guide.html for details. On Feb 2, 2016, at 6:49 PM, Divya Gehlot

Dynamic sql in Spark 1.5

Hi, Does Spark supports dyamic sql ? Would really appreciate the help , if any one could share some references/examples. Thanks, Divya