David Knupp has posted comments on this change. Change subject: IMPALA-4482: Use ALTER TABLE / RECOVER PARTITIONS when loading tpcds.store_sales ......................................................................
Patch Set 6: And just to confirm that this works: ./testdata/bin/generate-schema-statements.py --exploration_strategy=core --workload=tpcds --scale_factor= --verbose --force_reload --hive_warehouse_dir=/test-warehouse --hdfs_namenode=localhost:20500 --backend=localhost:21000 INFO:bootstrap_virtualenv:Installing Kudu into the virtualenv Target Dataset: tpcds HDFS path: /test-warehouse/tpcds.customer_demographics does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.date_dim does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.time_dim does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.item does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.store does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.promotion does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.household_demographics does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_address does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.store_sales_unpartitioned does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.store_sales does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_demographics_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.date_dim_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.time_dim_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.item_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.store_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.promotion_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.household_demographics_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_address_seq_snap does not exists or is empty. Data will be loaded. Skipping 'tpcds_seq_snap.store_sales_unpartitioned' due to include constraint match. HDFS path: /test-warehouse/tpcds.store_sales_seq_snap does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_demographics_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.date_dim_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.time_dim_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.item_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.store_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.promotion_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.household_demographics_parquet does not exists or is empty. Data will be loaded. HDFS path: /test-warehouse/tpcds.customer_address_parquet does not exists or is empty. Data will be loaded. Skipping 'tpcds_parquet.store_sales_unpartitioned' due to include constraint match. HDFS path: /test-warehouse/tpcds.store_sales_parquet does not exists or is empty. Data will be loaded. -- To view, visit http://gerrit.cloudera.org:8080/5177 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iaae97d1d44201aeeacacdd39adbae35753512950 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: David Knupp <dkn...@cloudera.com> Gerrit-Reviewer: David Knupp <dkn...@cloudera.com> Gerrit-Reviewer: Dimitris Tsirogiannis <dtsirogian...@cloudera.com> Gerrit-Reviewer: Harrison Sheinblatt <h...@hotmail.com> Gerrit-Reviewer: Internal Jenkins Gerrit-Reviewer: Jim Apple <jbapple-imp...@apache.org> Gerrit-HasComments: No