gortiz opened a new pull request, #13035: URL: https://github.com/apache/pinot/pull/13035
This PR adds some multi-stage metrics. The whole PR is built on top of https://github.com/apache/pinot/pull/12704 so it should only be merged once (and if) that other PR is merged. All new metrics are server based. Specifically, they are: * Meters: * HASH_JOIN_TIMES_MAX_ROWS_REACHED (global): How many times the max number of rows per join has been reached. If this happens multiple times in a single query, the meter will be increased as many times as this limit is reached. * AGGREGATE_TIMES_NUM_GROUPS_LIMIT_REACHED (global): How many times the max number of groups has been reached. If this happens multiple times in a single query, the meter will be increased as many times as this limit is reached. * MULTI_STAGE_IN_MEMORY_MESSAGES (global): How many messages have been sent from one stage to the other without being serialized. Optimizations like collocated joins can increase this number. * MULTI_STAGE_RAW_MESSAGES (global): How many times messages have been sent from one stage to the other in serialized way. Optimizations like collocated joins can reduce this number. * MULTI_STAGE_RAW_BYTES (global): How many bytes have been sent from one stage to the other. The smaller this number, the better. * Timers * HASH_JOIN_CPU_TIME_BUILDING_HASH_TABLE_MS (global): The CPU time (in ms) spent building the hash table on each hash join. * MULTI_STAGE_SERIALIZATION_CPU_TIME_MS (global): The CPU time (in ms) spent when messages are being serialized from one stage to the other. * MULTI_STAGE_DESERIALIZATION_CPU_TIME_MS (global): The CPU time (in ms) spent when messages are being deserialized after being received by other stage. * RECEIVE_DOWNSTREAM_CPU_TIME_MS (global): The CPU time (in ms) spent by sender mailboxes waiting the receiver (upstream) to read the messages. * RECEIVE_UPSTREAM_CPU_WAIT_MS (global): The CPU time (in ms) spent by receiver mailboxes waiting for new data from the sender (upstream). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
