Github user robert3005 commented on the issue: https://github.com/apache/spark/pull/21596 FYI - I have found nondeterministic flakes with RDDOperationScope in newer jackson, you can see fix at https://github.com/palantir/spark/pull/379. What happens is that jackson object mapper doesn't apply option serializer to parent field resulting in wrong json representation. Unfortunately I haven't been able to isolate the issue.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org