Re: append rows to dataframe

Summarizing an offline message: The following worked for Divya: dffiltered = dffiltered.unionAll(dfresult.filter ... On Mon, Mar 14, 2016 at 5:54 AM, Lohith Samaga M wrote: > If all sql results have same set of columns you could UNION all the > dataframes > > Create

RE: append rows to dataframe

If all sql results have same set of columns you could UNION all the dataframes Create an empty df and Union all Then reassign new df to original df before next union all Not sure if it is a good idea, but it works Lohith Sent from my Sony Xperia™ smartphone Divya Gehlot wrote Hi,

Re: append rows to dataframe

dffiltered = unionAll(dfresult.filter(dfFilterSQLs( i)).select("Col1","Col2","Col3","Col4","Col5")) FYI On Sun, Mar 13, 2016 at 8:50 PM, Ted Yu wrote: > Have you tried unionAll() method of DataFrame ? > > On Sun, Mar 13, 2016 at 8:44 PM, Divya Gehlot

Re: append rows to dataframe

Have you tried unionAll() method of DataFrame ? On Sun, Mar 13, 2016 at 8:44 PM, Divya Gehlot wrote: > Hi, > > Please bear me for asking such a naive question > I have list of conditions (dynamic sqls) sitting in hbase table . > I need to iterate through those dynamic