juliuszsompolski commented on PR #59143: URL: https://github.com/apache/spark/pull/59143#issuecomment-5912887804
@HyukjinKwon thanks for the review and pointing to additional application spots. It seems I didn't go deep enough looking for them. My fix was investigating it from the angle of InferFiltersFromConstraints and then ConstantPropagation, because there are cases that can create really huge predicate trees there and I hit some stack overflows in my internal testing last week so decided to tackle it. I now applied building balanced trees in more places, added a test and regenerated the q58 golden files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
