[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Impala Public Jenkins has submitted this change and it was merged. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Reviewed-on: http://gerrit.cloudera.org:8080/7102 Reviewed-by: Tim Armstrong Tested-by: Impala Public Jenkins --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc M be/src/exec/nested-loop-join-node.cc M be/src/exec/nested-loop-join-node.h D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 41 files changed, 36 insertions(+), 4,363 deletions(-) Approvals: Impala Public Jenkins: Verified Tim Armstrong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 13 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Impala Public Jenkins has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 12: Verified+1 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 12 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 12: Code-Review+2 Rebase. Kicking off a merge ahead of the follow-on patches. -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 12 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Impala Public Jenkins has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 12: Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/969/ -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 12 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 11: Code-Review+2 Rebase -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 11 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Hello Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/7102 to look at the new patch set (#11). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc M be/src/exec/nested-loop-join-node.cc M be/src/exec/nested-loop-join-node.h D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 41 files changed, 36 insertions(+), 4,363 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/11 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 11 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 10: Code-Review+2 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 10 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 9: Code-Review+2 rebase -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 9 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 8: Code-Review+2 rebase -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 8 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 7: Code-Review+2 Rebase -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 7 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Hello Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/7102 to look at the new patch set (#7). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc M be/src/exec/nested-loop-join-node.cc M be/src/exec/nested-loop-join-node.h D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 41 files changed, 34 insertions(+), 4,361 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/7 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 7 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 6: It seems like a good idea, just didn't want to do an ad-hoc solution. Filed https://issues.apache.org/jira/browse/IMPALA-5610 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Dan Hecht has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 6: Code-Review+2 Okay, if we have precedence for "silently" deprecating, then that's fine. -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 6: We could probably use the GFlag validator mechanism: https://gflags.github.io/gflags/#validate -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 6: Sorry meant to respond to that one. We don't generally warn on deprecated command-line flags. E.g. I checked some of the llama flags. It seems like we should add a general mechanism for warning when deprecated flags are set rather than doing this as a special-case, right? -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Dan Hecht has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 6: What about this question: > Maybe print something to the warning log if either flag is set to true? -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 5: PS5 was a rebase, PS6 addressed the comment -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 5 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has uploaded a new patch set (#6). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc M be/src/exec/nested-loop-join-node.cc M be/src/exec/nested-loop-join-node.h D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 41 files changed, 34 insertions(+), 4,360 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/6 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 6 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 4: (2 comments) http://gerrit.cloudera.org:8080/#/c/7102/4/be/src/exec/blocking-join-node.cc File be/src/exec/blocking-join-node.cc: Line 158: *status = SendBuildInputToSink(state, build_sink); > one line? Done http://gerrit.cloudera.org:8080/#/c/7102/3/be/src/exec/blocking-join-node.h File be/src/exec/blocking-join-node.h: Line 116 Need to remove the remaining overrides of this. -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 4 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has uploaded a new patch set (#5). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc M be/src/exec/nested-loop-join-node.cc M be/src/exec/nested-loop-join-node.h D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 41 files changed, 31 insertions(+), 4,354 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/5 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 5 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Dan Hecht has posted comments on this change. Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. Patch Set 4: (1 comment) Looks good when the time is right. Maybe print something to the warning log if either flag is set to true? http://gerrit.cloudera.org:8080/#/c/7102/4/be/src/exec/blocking-join-node.cc File be/src/exec/blocking-join-node.cc: Line 158: *status = SendBuildInputToSink(state, build_sink); one line? -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 4 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has uploaded a new patch set (#4). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc M be/src/exec/nested-loop-join-node.cc M be/src/exec/nested-loop-join-node.h D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exec/partitioned-hash-join-node.cc M be/src/exec/partitioned-hash-join-node.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 41 files changed, 31 insertions(+), 4,352 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/4 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 4 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has uploaded a new patch set (#3). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 33 files changed, 30 insertions(+), 4,328 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/3 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 3 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has uploaded a new patch set (#2). Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/blocking-join-node.cc M be/src/exec/blocking-join-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 33 files changed, 30 insertions(+), 4,332 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/2 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 2 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong
[Impala-ASF-CR] IMPALA-4674: Part 1: remove old aggs and joins
Tim Armstrong has uploaded a new change for review. http://gerrit.cloudera.org:8080/7102 Change subject: IMPALA-4674: Part 1: remove old aggs and joins .. IMPALA-4674: Part 1: remove old aggs and joins This is intended to be merged at the same time as Part 2 but is separated out to make the change more reviewable. Part 2 assumes that it does not need special logic to handle this mode (e.g. because the old aggs and joins don't use reservation). Disable the --enable_partitioned_{aggregation,hash_join} options and remove all product and test code associated with them. Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 --- M be/src/codegen/gen_ir_descriptions.py M be/src/codegen/impala-ir.cc M be/src/exec/CMakeLists.txt D be/src/exec/aggregation-node-ir.cc D be/src/exec/aggregation-node.cc D be/src/exec/aggregation-node.h M be/src/exec/exec-node.cc D be/src/exec/hash-join-node-ir.cc D be/src/exec/hash-join-node.cc D be/src/exec/hash-join-node.h M be/src/exec/hdfs-parquet-scanner.cc D be/src/exec/old-hash-table-ir.cc D be/src/exec/old-hash-table-test.cc D be/src/exec/old-hash-table.cc D be/src/exec/old-hash-table.h D be/src/exec/old-hash-table.inline.h M be/src/exprs/agg-fn-evaluator.cc M be/src/runtime/row-batch.cc M be/src/runtime/row-batch.h D testdata/workloads/functional-query/queries/QueryTest/legacy-joins-aggs.test M tests/common/environ.py M tests/common/skip.py D tests/custom_cluster/test_legacy_joins_aggs.py M tests/metadata/test_ddl.py M tests/query_test/test_aggregation.py M tests/query_test/test_join_queries.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_runtime_filters.py M tests/query_test/test_scanners.py M tests/query_test/test_tpch_nested_queries.py 31 files changed, 27 insertions(+), 4,228 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/02/7102/1 -- To view, visit http://gerrit.cloudera.org:8080/7102 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I5ce2236d37c0ced188a4a81f7e00d4b8ac98e7e9 Gerrit-PatchSet: 1 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong