----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/67929/ -----------------------------------------------------------
(Updated July 18, 2018, 12:12 p.m.) Review request for Sqoop. Bugs: SQOOP-3329 https://issues.apache.org/jira/browse/SQOOP-3329 Repository: sqoop-trunk Description ------- - Removed kitesdk dependency from ivy.xml - Removed Kite Dataset API based Parquet import implementation - Since Parquet library was a transitive dependency of the Kite SDK I added org.apache.parquet.avro-parquet 1.9 as a direct dependency - In this dependency the parquet package has changed to org.apache.parquet so I needed to make changes in several classes according to this - Removed all the Parquet related test cases from TestHiveImport. These scenarios are already covered in TestHiveServer2ParquetImport. - Modified the documentation to reflect these changes. Diffs ----- ivy.xml 1f587f3eb ivy/libraries.properties 565a8bf50 src/docs/user/hive-notes.txt af97d94b3 src/docs/user/import.txt a2c16d956 src/java/org/apache/sqoop/SqoopOptions.java cc1b75281 src/java/org/apache/sqoop/avro/AvroUtil.java 1663b1d1a src/java/org/apache/sqoop/mapreduce/parquet/ParquetJobConfiguratorImplementation.java 050c85488 src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetExportJobConfigurator.java 2180cc20e src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetImportJobConfigurator.java 90b910a34 src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetMergeJobConfigurator.java 66ebc5b80 src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteMergeParquetReducer.java 02816d77f src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetExportJobConfigurator.java 6ebc5a31b src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetExportMapper.java 122ff3fc9 src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetImportJobConfigurator.java 7e179a27d src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetImportMapper.java 0a91e4a20 src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetJobConfiguratorFactory.java bd07c09f4 src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetMergeJobConfigurator.java ed045cd14 src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetUtils.java a4768c932 src/java/org/apache/sqoop/tool/BaseSqoopTool.java 87fc5e987 src/test/org/apache/sqoop/TestMerge.java 2b3280a5a src/test/org/apache/sqoop/TestParquetExport.java 0fab1880c src/test/org/apache/sqoop/TestParquetImport.java b1488e8af src/test/org/apache/sqoop/TestParquetIncrementalImportMerge.java adad0cc11 src/test/org/apache/sqoop/hive/TestHiveImport.java 436f0e512 src/test/org/apache/sqoop/hive/TestHiveServer2ParquetImport.java b55179a4f src/test/org/apache/sqoop/tool/TestBaseSqoopTool.java dbda8b7f4 src/test/org/apache/sqoop/util/ParquetReader.java f1c2fe10a Diff: https://reviews.apache.org/r/67929/diff/1/ Testing ------- Ran unit and third party tests. File Attachments (updated) ---------------- trunkdependencies.graphml https://reviews.apache.org/media/uploaded/files/2018/07/18/4df23fec-c7a7-4dc6-8ac1-0872ee6fdadf__trunkdependencies.graphml kiteremovaldependencies.graphml https://reviews.apache.org/media/uploaded/files/2018/07/18/e8cbb4d3-1da3-4b64-96ea-09f647ece126__kiteremovaldependencies.graphml Thanks, Szabolcs Vasas