GitHub user robbinspg opened a pull request: https://github.com/apache/spark/pull/13707
[SPARK-15822][SQL] avoid UTF8String references into freed pages ## What changes were proposed in this pull request? In SMJ codegen we need to save copies of UTF8String values as the final iterator.next() will free the underlying memory page. ## How was this patch tested? Test application as described in 15822 now passes. You can merge this pull request into a Git repository by running: $ git pull https://github.com/robbinspg/spark-1 master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/13707.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #13707 ---- commit d201034e628456b9640eb8483da849217aa80c92 Author: Pete Robbins <robbin...@gmail.com> Date: 2016-06-16T14:33:31Z Create copy of UTF8String in SMJ commit 1288f1e88f90b751cd0640864d7cc6cb5a9dfeca Author: Pete Robbins <robbin...@gmail.com> Date: 2016-06-16T15:21:23Z make copy() public ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org