holdenk commented on code in PR #58620:
URL: https://github.com/apache/spark/pull/58620#discussion_r4042469736
##########
core/src/main/scala/org/apache/spark/internal/config/Deploy.scala:
##########
@@ -51,6 +51,20 @@ private[spark] object Deploy {
.checkValue(_ > 0, "spark.deploy.recoveryTimeout must be positive.")
.createOptional
+ val RECOVERY_SERIALIZATION_FILTER =
+ ConfigBuilder("spark.deploy.recoverySerializationFilter")
+ .doc("JEP-290 serialization filter pattern applied when the master
deserializes " +
+ "recovery state written by the built-in JavaSerializer (currently
enforced for " +
+ "the ZOOKEEPER recovery mode). The default allows only JDK, Scala and
Spark " +
+ "classes, which covers everything the master persists
(ApplicationInfo, " +
+ "DriverInfo, WorkerInfo and their fields); znodes containing anything
else are " +
+ "treated as corrupt and dropped during recovery. Set to '*' to disable
filtering. " +
+ "Introduced in 4.3.0; also available in 3.5.10, 4.0.5, 4.1.4 and
4.2.1; and in " +
Review Comment:
I have a 3.5 branch version which uses JDK8 primitives fro filtering but yes
happy to drop the backport text and we'll just have the version show up :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
