----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71038/ -----------------------------------------------------------
(Updated July 11, 2019, noon) Review request for hive, Jesús Camacho Rodríguez, Jason Dere, Zoltan Haindrich, and Vineet Garg. Bugs: HIVE-21965 https://issues.apache.org/jira/browse/HIVE-21965 Repository: hive-git Description (updated) ------- Implement parallel processing in HiveStrictManagedMigration =========================================================== 1. Process tables paralelly using a thread pool for each. Thread pools size can be defined by command line options. If no options are given the default pool size is the number of cpu cores. 2. Add option for filtering table type. I had to remove database parallel processing because the ForkJoinPool implementation does not support nested parallel streams. Diffs (updated) ----- ql/src/java/org/apache/hadoop/hive/ql/util/CloseableThreadLocal.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/util/HiveStrictManagedMigration.java 80025b7046 ql/src/java/org/apache/hadoop/hive/ql/util/NamedForkJoinWorkerThreadFactory.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/TxnCommandsBaseForTests.java 5f39fdccb5 ql/src/test/org/apache/hadoop/hive/ql/util/CloseableThreadLocalTest.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/util/TestHiveStrictManagedMigration.java PRE-CREATION Diff: https://reviews.apache.org/r/71038/diff/2/ Changes: https://reviews.apache.org/r/71038/diff/1-2/ Testing ------- New UT for testing migration. Thanks, Krisztian Kasa