Thanks for this insight guys. On your point below and I quote:
... "It's even as fast as Spark by using the default mr engine" OK as we are all experimentalists, are we stating that the classic MapReduce computation can outdo Spark's in-memory computation. I would be curious to know this. Thanks view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Fri, 6 Jan 2023 at 03:35, ypeng <yp...@t-online.de> wrote: > Hello, > > Just from my personal testing, Hive 3.1.3 has much better performance than > the old ones. > It's even as fast as Spark by using the default mr engine. > My test process and dataset, > https://blog.crypt.pw/Another-10-million-dataset-testing-for-Spark-and-Hive > > Thanks. >