richardstartin opened a new pull request #8015:
URL: https://github.com/apache/pinot/pull/8015


   This speeds up the `DataTypeTransformer` by roughly 10%, based on profiling 
a very slow RealtimeToOfflineTask mapping phase in #8014, where over 30% of 
samples from a 5 minute profile were in this method.
   
   ```
   Benchmark                               (_columnCount)  Mode  Cnt     Score  
   Error  Units
   BenchmarkDataTypeTransformer.transform              10  avgt    5   976.600 
±  47.032  ns/op
   BenchmarkDataTypeTransformer.transform              20  avgt    5  1887.237 
±  33.353  ns/op
   BenchmarkDataTypeTransformer.transform              30  avgt    5  2962.023 
±  63.032  ns/op
   BenchmarkDataTypeTransformer.transform              40  avgt    5  3719.709 
± 182.929  ns/op
   BenchmarkDataTypeTransformer.transform              50  avgt    5  5010.587 
± 318.171  ns/op
   ```
   after
   ```
   Benchmark                               (_columnCount)  Mode  Cnt     Score  
   Error  Units
   BenchmarkDataTypeTransformer.transform              10  avgt    5   893.628 
±  18.360  ns/op
   BenchmarkDataTypeTransformer.transform              20  avgt    5  1676.606 
±  84.147  ns/op
   BenchmarkDataTypeTransformer.transform              30  avgt    5  2628.794 
±  38.903  ns/op
   BenchmarkDataTypeTransformer.transform              40  avgt    5  3552.151 
± 166.255  ns/op
   BenchmarkDataTypeTransformer.transform              50  avgt    5  4403.456 
± 183.033  ns/op
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to