mattcasters commented on issue #7752: URL: https://github.com/apache/hop/issues/7752#issuecomment-5226468243
It's not really a bug but a documented behavior with circular dependencies. Loading all data into memory is perhaps less than ideal in all scenario. There's a reason why we don't have infinite buffers between transforms and that is obviously to avoid running out of memory. That being said, if we could detect the circular dependency we could opt to serialize rows to disk to get around the limitation as a generic solution. I guess that shifts the problem to detecting that there is a circular dependency at play. In any case, my preference would be to avoid starting extra threads and possibly causing out of memory errors and to favor a more generic solution for the problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
