RE: concat spark dataframes

com] Sent: Wednesday, June 15, 2016 4:08 PM To: Mohammed Guller Cc: Natu Lauchande; user Subject: Re: concat spark dataframes Hey, There are quite a lot of fields. But, there are no common fields between the 2 dataframes. Can I not concatenate the 2 frames like we can do in pandas such that the

Re: concat spark dataframes

/Big-Data-Analytics-Spark-Practitioners/dp/1484209656/> > > > > *From:* Natu Lauchande [mailto:nlaucha...@gmail.com] > *Sent:* Wednesday, June 15, 2016 2:07 PM > *To:* spR > *Cc:* user > *Subject:* Re: concat spark dataframes > > > > Hi, > > You can select the com

RE: concat spark dataframes

] Sent: Wednesday, June 15, 2016 2:07 PM To: spR Cc: user Subject: Re: concat spark dataframes Hi, You can select the common collumns and use DataFrame.union all . Regards, Natu On Wed, Jun 15, 2016 at 8:57 PM, spR <data.smar...@gmail.com<mailto:data.smar...@gmail.com>> wrote: hi,

Re: concat spark dataframes

Hi, You can select the common collumns and use DataFrame.union all . Regards, Natu On Wed, Jun 15, 2016 at 8:57 PM, spR wrote: > hi, > > how to concatenate spark dataframes? I have 2 frames with certain columns. > I want to get a dataframe with columns from both the

concat spark dataframes

hi, how to concatenate spark dataframes? I have 2 frames with certain columns. I want to get a dataframe with columns from both the other frames. Regards, Misha