Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21157 Yea, my point is that it breaks other codes without a warning at all. We already have the copy of cloudpickle. The best should be a deduplicated fix for it, shouldn't it? I am still solid -1 on the complete removal for Spark 2.x. We should find another way first for now. Removing out is the last resort. I would consider the complete removal in Spark 3.x after having sufficient discussions.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org