Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/9758 )
Change subject: IMPALA-6715,IMPALA-6736: fix stress TPC workload selection ...................................................................... IMPALA-6715,IMPALA-6736: fix stress TPC workload selection IMPALA-6715: This commit IMPALA-6551: Change Kudu TPCDS and TPCH columns to DECIMAL added additional decimal_v2 queries to the stress test that amount to running the same query twice. This makes the binary search run incredibly slow. - Fix the query selection. Add additional queries that weren't matching before, like the tpcds-q[0-9]+a.test series. - Add a test that will at least ensure if testdata/workloads/tpc*/queries is modified, the stress test will still find the same number of queries for the given workload. There's no obvious place to put this test: it's not testing the product at all, so: - Add a new directory tests/infra for such tests and add it to tests/run-tests.py. - Move the test from IMPALA-6441 into tests/infra. Testing: - Core private build passed. I manually looked to make sure the moved and new tests ran. - Short stress test run. I checked the runtime info and saw the new TPCDS queries in the JSON. - While testing on hardware clusters down stream, I noticed... IMPALA-6736: TPC-DS Q67A is 10x more expensive to run without spilling than any other query. I fixed the --filter-query-mem-ratio option to work. This will still run Q67A during the binary search phase, but if a cluster is too small, the query will be skipped. Change-Id: I3e26b64d38aa8d63a176daf95c4ac5dee89508da Reviewed-on: http://gerrit.cloudera.org:8080/9758 Reviewed-by: David Knupp <dkn...@cloudera.com> Tested-by: Impala Public Jenkins --- A tests/infra/test_stress_infra.py M tests/metadata/test_explain.py M tests/run-tests.py M tests/stress/concurrent_select.py 4 files changed, 88 insertions(+), 27 deletions(-) Approvals: David Knupp: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/9758 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I3e26b64d38aa8d63a176daf95c4ac5dee89508da Gerrit-Change-Number: 9758 Gerrit-PatchSet: 6 Gerrit-Owner: Michael Brown <mi...@cloudera.com> Gerrit-Reviewer: David Knupp <dkn...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Michael Brown <mi...@cloudera.com> Gerrit-Reviewer: Nithya Janarthanan <njanartha...@cloudera.com> Gerrit-Reviewer: Tim Armstrong <tarmstr...@cloudera.com>