AW: Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval

2021-02-14 Thread Julien Tane
h Talebzadeh Gesendet: Sonntag, 14. Februar 2021 12:01:05 An: user Betreff: Re: Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval Hi Julien, I am not aware that either Hive or HDFS logs provide matrix on performance of either. However, tools like

Re: Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval

2021-02-14 Thread Mich Talebzadeh
r | Managing Director: Dr. Thilo Gans, Bernd Vermaaten > Webseite | www.solute.de > Sitz | Registered Office: Karlsruhe > Registergericht | Register Court: Amtsgericht Mannheim > Registernummer | Register No.: HRB 110579 > USt-ID | VAT ID: DE234663798 > > *Informationen zum Datenschut

AW: Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval

2021-02-14 Thread Julien Tane
schutz/grundsaetze-der-datenverarbeitung.php Von: Mich Talebzadeh Gesendet: Samstag, 13. Februar 2021 10:09:10 An: user Betreff: Re: Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval Hi Juuien, I assume you mean you are using JD

Re: Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval

2021-02-13 Thread Mich Talebzadeh
Hi Juuien, I assume you mean you are using JDBC drivers to retrieve from the source table in Hive (older version) to the target table in Hive (newer version). 1) what JDBC drivers are you using? 2) Are these environments kerberized in both cases? 3) Have you considered other JDBC drivers for Hive

Migration of Hadoop Warehouse to newer versions lead to bad performance for JDBC-data-retrieval

2021-02-12 Thread Julien Tane
Dear all, we are in the process of switching from our old cluster with HDP 2.5: HDFS2.7.3 YARN2.7.3 Tez 0.7.0 Hive1.2.1000 to a new cluster with HDP 3.1: HDFS3.1.1.3.1 YARN3.1.0 HIVE3.0.0.3.1 Tez 0.9.0.3.1 We (1st) query and (2nd) retrieve data from table_0 from