h Talebzadeh
Gesendet: Sonntag, 14. Februar 2021 12:01:05
An: user
Betreff: Re: Migration of Hadoop Warehouse to newer versions lead to bad
performance for JDBC-data-retrieval
Hi Julien,
I am not aware that either Hive or HDFS logs provide matrix on performance of
either. However, tools like
r | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
> Webseite | www.solute.de
> Sitz | Registered Office: Karlsruhe
> Registergericht | Register Court: Amtsgericht Mannheim
> Registernummer | Register No.: HRB 110579
> USt-ID | VAT ID: DE234663798
>
> *Informationen zum Datenschut
schutz/grundsaetze-der-datenverarbeitung.php
Von: Mich Talebzadeh
Gesendet: Samstag, 13. Februar 2021 10:09:10
An: user
Betreff: Re: Migration of Hadoop Warehouse to newer versions lead to bad
performance for JDBC-data-retrieval
Hi Juuien,
I assume you mean you are using JD
Hi Juuien,
I assume you mean you are using JDBC drivers to retrieve from the source
table in Hive (older version) to the target table in Hive (newer version).
1) what JDBC drivers are you using?
2) Are these environments kerberized in both cases?
3) Have you considered other JDBC drivers for Hive
Dear all,
we are in the process of switching from our old cluster with HDP 2.5:
HDFS2.7.3
YARN2.7.3
Tez 0.7.0
Hive1.2.1000
to a new cluster with HDP 3.1:
HDFS3.1.1.3.1
YARN3.1.0
HIVE3.0.0.3.1
Tez 0.9.0.3.1
We (1st) query and (2nd) retrieve data from table_0 from