cloud-fan commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-638626662
Yea we need this PR to unblock backporting SPARK-28067 to 3.0. > the mechanism is a validation of the UnsafeRow which can be applied to all stateful operations. What are other stateful operations that use unsafe row? I think we can apply the check everywhere. > Unless we have a chance to bring a show-stopper bug in the validation logic This is something we don't know. Adding a flag seems safer. > it doesn't touch the existing part of checkpoint and simply put the schema information into a new file. I'm not saying we shouldn't merge it. I just want to prioritize this PR so that we may be able to include sum correctness bug in 3.0. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
