hansva opened a new issue, #9346:
URL: https://github.com/apache/hop/issues/9346

   ### Apache Hop version?
   
   2.20.0
   
   ### Java version?
   
   21
   
   ### Operating system
   
   Other
   
   ### What happened?
   
   *Serialize to file* (`CubeOutput.java:231-232`) and *De-serialize from file* 
(`CubeInput.java:135-136`) put a `DataOutputStream` / `DataInputStream` 
directly on the GZIP stream. Every small write or read of a value becomes its 
own deflate/inflate call. Profiling shows 96% (write) and 87% (read) of the CPU 
under the GZIP stream, at about 143k and 405k rows/s on main.
   
   ### Proposed fix
   
   Put a 64 KB buffered stream between the data stream and the GZIP stream. 
Build the chain in one helper, used by `CubeOutput`, `CubeInput` and 
`CubeInputMeta.getFields()`.
   
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: Transforms


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to