Riza Suminto has uploaded this change for review. ( http://gerrit.cloudera.org:8080/19796
Change subject: IMPALA-12090: Split runtime profiles made by single_node_perf_run.py ...................................................................... IMPALA-12090: Split runtime profiles made by single_node_perf_run.py single_node_perf_run.py produce a single text file containing all runtime profiles from perf run from one git hash. This is handy, but the resulting text file can be very long and makes it difficult to analyze individual profile. This patch add --split_profiles option into single_node_perf_run.py so it will extract runtime profiles into individual file instead of single long text file. Files in profile directory will look like this: $ ls -1 perf_results/latest/2267d9d104cc3fb0740cba09acb369b4d7ae4f52_profiles/ 2023-04-24T09:47:37.804348_TPCDS-Q14-1.txt 2023-04-24T09:47:46.551682_TPCDS-Q14-1.txt 2023-04-24T09:47:53.162474_TPCDS-Q14-1.txt 2023-04-24T09:47:58.734194_TPCDS-Q14-2.txt 2023-04-24T09:48:02.793736_TPCDS-Q14-2.txt 2023-04-24T09:48:06.580700_TPCDS-Q14-2.txt 2023-04-24T09:48:12.968678_TPCDS-Q23-1.txt 2023-04-24T09:48:18.060801_TPCDS-Q23-1.txt 2023-04-24T09:48:22.307676_TPCDS-Q23-1.txt 2023-04-24T09:48:26.602270_TPCDS-Q23-2.txt 2023-04-24T09:48:31.342496_TPCDS-Q23-2.txt 2023-04-24T09:48:35.832333_TPCDS-Q23-2.txt Testing: - Manually test run the script with selected queries from tpcds workload. Change-Id: Ibc2d3cefd7ad61b76cbef74c734543ef9ca51795 --- M bin/single_node_perf_run.py 1 file changed, 43 insertions(+), 11 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/96/19796/1 -- To view, visit http://gerrit.cloudera.org:8080/19796 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ibc2d3cefd7ad61b76cbef74c734543ef9ca51795 Gerrit-Change-Number: 19796 Gerrit-PatchSet: 1 Gerrit-Owner: Riza Suminto <[email protected]>
