richardstartin opened a new pull request #8015: URL: https://github.com/apache/pinot/pull/8015
This speeds up the `DataTypeTransformer` by roughly 10%, based on profiling a very slow RealtimeToOfflineTask mapping phase in #8014, where over 30% of samples from a 5 minute profile were in this method. ``` Benchmark (_columnCount) Mode Cnt Score Error Units BenchmarkDataTypeTransformer.transform 10 avgt 5 976.600 ± 47.032 ns/op BenchmarkDataTypeTransformer.transform 20 avgt 5 1887.237 ± 33.353 ns/op BenchmarkDataTypeTransformer.transform 30 avgt 5 2962.023 ± 63.032 ns/op BenchmarkDataTypeTransformer.transform 40 avgt 5 3719.709 ± 182.929 ns/op BenchmarkDataTypeTransformer.transform 50 avgt 5 5010.587 ± 318.171 ns/op ``` after ``` Benchmark (_columnCount) Mode Cnt Score Error Units BenchmarkDataTypeTransformer.transform 10 avgt 5 893.628 ± 18.360 ns/op BenchmarkDataTypeTransformer.transform 20 avgt 5 1676.606 ± 84.147 ns/op BenchmarkDataTypeTransformer.transform 30 avgt 5 2628.794 ± 38.903 ns/op BenchmarkDataTypeTransformer.transform 40 avgt 5 3552.151 ± 166.255 ns/op BenchmarkDataTypeTransformer.transform 50 avgt 5 4403.456 ± 183.033 ns/op ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
