RE: Hive using Spark engine vs native spark with hive integration.

2020-10-06 Thread Manu Jacob
tion of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Tue, 6 Oct 2020 at 16:47, Manu Jacob mailto:manu.ja

Hive using Spark engine vs native spark with hive integration.

2020-10-06 Thread Manu Jacob
Hi All, Not sure if I need to ask this question on hive community or spark community. We have a set of hive scripts that runs on EMR (Tez engine). We would like to experiment by moving some of it onto Spark. We are planning to experiment with two options. 1. Use the current code based on HQ