I think DF performs the same as the SQL API does in the multi-inserts, if you
don’t use the cached table.
Hao
From: Daniel Haviv [mailto:daniel.ha...@veracity-group.com]
Sent: Friday, October 9, 2015 3:09 PM
To: Cheng, Hao
Cc: user
Subject: Re: Insert via HiveContext is slow
Thanks Hao
out soon.
>
>
>
> Hao
>
>
>
> *From:* Daniel Haviv [mailto:daniel.ha...@veracity-group.com]
> *Sent:* Friday, October 9, 2015 3:08 AM
> *To:* user
> *Subject:* Re: Insert via HiveContext is slow
>
>
>
> Forgot to mention that my insert is a multi table insert
Forgot to mention that my insert is a multi table insert :
sqlContext2.sql("""from avro_events
lateral view explode(usChnlList) usParamLine as usParamLine
lateral view explode(dsChnlList) dsParamLine as dsParamLine
insert into table UpStreamParam
out soon.
Hao
From: Daniel Haviv [mailto:daniel.ha...@veracity-group.com]
Sent: Friday, October 9, 2015 3:08 AM
To: user
Subject: Re: Insert via HiveContext is slow
Forgot to mention that my insert is a multi table insert :
sqlContext2.sql("""from avro_events
later