alamb commented on issue #15949: URL: https://github.com/apache/datafusion/issues/15949#issuecomment-2891161932
I noticed the above query has only 91 groups: ```sql DataFusion CLI v47.0.0 > SELECT "OS", AVG(to_timestamp("ResponseEndTiming")-to_timestamp("ResponseStartTiming")) as avg_response_time,AVG(to_timestamp("ResponseEndTiming")-to_timestamp("ConnectTiming")) as avg_latency FROM 'data/hits_partitioned' GROUP BY "OS" ORDER BY avg_latency DESC; +-----+-------------------------------------------+------------------------------------------+ | OS | avg_response_time | avg_latency | +-----+-------------------------------------------+------------------------------------------+ | 103 | 0 days 0 hours 13 mins 47.509466437 secs | 0 days 0 hours 13 mins 47.509466437 secs | | 74 | 0 days 0 hours 12 mins 51.287431013 secs | 0 days 0 hours 13 mins 47.184892702 secs | | 49 | 0 days 0 hours 13 mins 9.107811258 secs | 0 days 0 hours 13 mins 42.811185779 secs | | 77 | 0 days 0 hours 9 mins 47.668864464 secs | 0 days 0 hours 11 mins 26.796840642 secs | | 112 | 0 days 0 hours 3 mins 19.018355160 secs | 0 days 0 hours 8 mins 32.958042116 secs | | 70 | 0 days 0 hours 1 mins 31.113089802 secs | 0 days 0 hours 8 mins 8.089117199 secs | | 59 | 0 days 0 hours 0 mins -59.687500000 secs | 0 days 0 hours 4 mins 44.562500000 secs | | 101 | 0 days 0 hours 0 mins 27.485986881 secs | 0 days 0 hours 4 mins 24.220234545 secs | | 12 | 0 days 0 hours 0 mins 0.915553578 secs | 0 days 0 hours 3 mins 21.616990075 secs | | 39 | 0 days 0 hours 2 mins 11.248827183 secs | 0 days 0 hours 3 mins 1.060289083 secs | | 46 | 0 days 0 hours 2 mins 51.602040816 secs | 0 days 0 hours 2 mins 51.602040816 secs | | 104 | 0 days 0 hours -1 mins -41.261186264 secs | 0 days 0 hours 2 mins 7.463059313 secs | | 45 | 0 days 0 hours 0 mins 31.872238129 secs | 0 days 0 hours 1 mins 37.324755565 secs | | 7 | 0 days 0 hours -2 mins -38.098571146 secs | 0 days 0 hours 1 mins 35.758543491 secs | | 126 | 0 days 0 hours -2 mins -25.507751501 secs | 0 days 0 hours 1 mins 32.933894412 secs | | 33 | 0 days 0 hours -2 mins -11.200000000 secs | 0 days 0 hours 1 mins 31.200000000 secs | | 9 | 0 days 0 hours -3 mins -53.293441768 secs | 0 days 0 hours 1 mins 28.609912908 secs | | 11 | 0 days 0 hours -3 mins -48.205086798 secs | 0 days 0 hours 1 mins 23.773112636 secs | | 44 | 0 days 0 hours -2 mins -30.470355300 secs | 0 days 0 hours 1 mins 22.076928357 secs | | 1 | 0 days 0 hours -2 mins -22.108601400 secs | 0 days 0 hours 1 mins 16.524448796 secs | | 2 | 0 days 0 hours -2 mins -10.731476126 secs | 0 days 0 hours 1 mins 16.255794248 secs | | 37 | 0 days 0 hours -1 mins -4.520792848 secs | 0 days 0 hours 1 mins 7.226195102 secs | | 116 | 0 days 0 hours 0 mins 32.117647058 secs | 0 days 0 hours 1 mins 6.509803921 secs | | 0 | 0 days 0 hours 0 mins 29.708039353 secs | 0 days 0 hours 0 mins 58.786563598 secs | | 57 | 0 days 0 hours 0 mins -54.983173266 secs | 0 days 0 hours 0 mins 56.604541731 secs | | 3 | 0 days 0 hours -1 mins -57.406106095 secs | 0 days 0 hours 0 mins 54.878138590 secs | | 5 | 0 days 0 hours -1 mins -14.716715226 secs | 0 days 0 hours 0 mins 46.498521635 secs | | 68 | 0 days 0 hours -1 mins -41.598033744 secs | 0 days 0 hours 0 mins 41.615774557 secs | | 67 | 0 days 0 hours 0 mins 27.802898817 secs | 0 days 0 hours 0 mins 37.835699842 secs | | 38 | 0 days 0 hours -1 mins -0.347826086 secs | 0 days 0 hours 0 mins 36.797101449 secs | | 98 | 0 days 0 hours -1 mins -25.621956238 secs | 0 days 0 hours 0 mins 36.477770676 secs | | 34 | 0 days 0 hours -1 mins -18.701492537 secs | 0 days 0 hours 0 mins 27.402985074 secs | | 35 | 0 days 0 hours 0 mins -35.877821173 secs | 0 days 0 hours 0 mins 21.667386721 secs | | 17 | 0 days 0 hours -1 mins -38.074618882 secs | 0 days 0 hours 0 mins 17.008558438 secs | | 58 | 0 days 0 hours -3 mins -54.294117647 secs | 0 days 0 hours 0 mins 16.588235294 secs | | 54 | 0 days 0 hours 0 mins -53.554054054 secs | 0 days 0 hours 0 mins 16.304054054 secs | | 14 | 0 days 0 hours -3 mins -2.845982142 secs | 0 days 0 hours 0 mins 14.861607142 secs | | 13 | 0 days 0 hours -1 mins -6.324333862 secs | 0 days 0 hours 0 mins 13.454561496 secs | | 10 | 0 days 0 hours 0 mins 8.780079478 secs | 0 days 0 hours 0 mins 9.103530175 secs | | 71 | 0 days 0 hours 0 mins 7.617299688 secs | 0 days 0 hours 0 mins 7.712214154 secs | | . | | . | | . | +-----+-------------------------------------------+------------------------------------------+ 91 row(s) fetched. (First 40 displayed. Use --maxrows to adjust) Elapsed 0.224 seconds. ``` I recommend we also add other columns to the `GROUP BY` to increase the number of groups / challenge of the aggregate? That could also be a second query potentially ```sql GROUP BY "RegionID", "UserAgent", "OS" ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org