Re: Poor Hive 3.1.0 performance

2021-11-24 Thread Sharath Punreddy
unsubscribe Sincerely, Sharath Punreddy Email: srpunre...@gmail.com Phone: 626-470-7867 On Tue, Nov 23, 2021 at 3:27 AM gwenael le barzic wrote: > Hello. > > I send you this mail because I migrated my cluster recently to HDP 3.1.4. > (hive 3.1.0) > > I experience very slow queries when I perfo

Re: Poor Hive 3.1.0 performance

2021-11-23 Thread gwenael le barzic
Hey guys. Analyzing the jstack, I found that the ALTER DATABASE SET LOCATION performs a check on all the folders inside the database folder in HDFS. And I have some databases with some tables with a lt of partitions ;-). So nothing abnormal here. Best regards. On Tue, Nov 23, 2021 at 10:26

Poor Hive 3.1.0 performance

2021-11-23 Thread gwenael le barzic
Hello. I send you this mail because I migrated my cluster recently to HDP 3.1.4. (hive 3.1.0) I experience very slow queries when I perform ALTER DATABASE SET LOCATION ''. When I check the logs of hiveserver2, I can see that the compiling step of the query takes a looot of time (around 8 minuts