hansva commented on issue #7911: URL: https://github.com/apache/hop/issues/7911#issuecomment-5280490301
I am closing this ticket as not actionable. Your data will no longer be in the same order because you split the rows into 2 different streams, this will create 2 different sets. I would avoid blocking as much as possible, it will kill performance and as you hav experienced it can make your buffers fill up and put the pipeline in a deadlocked state. In contrary to many other ETL platforms, we do not handle data transform per transform and dump all rows into memory, we use a semi-streaming (microbatch) approach where we keep pushing data downstream this gives us a lower memory footprint during execution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
