-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71038/
-----------------------------------------------------------

(Updated July 11, 2019, noon)


Review request for hive, Jesús Camacho Rodríguez, Jason Dere, Zoltan Haindrich, 
and Vineet Garg.


Bugs: HIVE-21965
    https://issues.apache.org/jira/browse/HIVE-21965


Repository: hive-git


Description (updated)
-------

Implement parallel processing in HiveStrictManagedMigration
===========================================================

1. Process tables paralelly using a thread pool for each. Thread pools size can 
be defined by command line options. If no options are given the default pool 
size is the number of cpu cores.
2. Add option for filtering table type.

I had to remove database parallel processing because the ForkJoinPool 
implementation does not support nested parallel streams.


Diffs (updated)
-----

  ql/src/java/org/apache/hadoop/hive/ql/util/CloseableThreadLocal.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/util/HiveStrictManagedMigration.java 
80025b7046 
  
ql/src/java/org/apache/hadoop/hive/ql/util/NamedForkJoinWorkerThreadFactory.java
 PRE-CREATION 
  ql/src/test/org/apache/hadoop/hive/ql/TxnCommandsBaseForTests.java 5f39fdccb5 
  ql/src/test/org/apache/hadoop/hive/ql/util/CloseableThreadLocalTest.java 
PRE-CREATION 
  
ql/src/test/org/apache/hadoop/hive/ql/util/TestHiveStrictManagedMigration.java 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71038/diff/2/

Changes: https://reviews.apache.org/r/71038/diff/1-2/


Testing
-------

New UT for testing migration.


Thanks,

Krisztian Kasa

Reply via email to