alamb commented on issue #5504: URL: https://github.com/apache/arrow-datafusion/issues/5504#issuecomment-1721306824
So I can find the compute resources to run this, and I think we can use existing timeseries databases to track performance over time (e.g. IOx or grafana). The only missing piece is getting the data into a format that can be loaded into these systems I think we could get a simple version of this feature going like: 1. Invoke [bench.sh](https://github.com/apache/arrow-datafusion/blob/main/benchmarks/bench.sh) for the benchmarks of interest 2. Use https://github.com/apache/arrow-datafusion/issues/6107 to convert the existing bench output to lineprotocol (I wrote up more details of this transformation) 3. Check in the line protocol somewhere 4. Upload lineprotocol to influxdb or some other system that supports it to make some simple visualizations -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
