Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/23215#discussion_r239453312
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1396,6 +1396,16 @@ object SQLConf {
.booleanConf
.createWithDefault(false)
+ val VALIDATE_PARTITION_COLUMNS =
+ buildConf("spark.sql.sources.validatePartitionColumns")
+ .internal()
+ .doc("When this option is set to true, partition column values will
be validated with " +
+ "provided schema. If the validation fails, a runtime exception is
thrown." +
+ "When this option is set to false, the partition column value will
be converted to null " +
+ "if it can not be converted to corresponding provided schema.")
--- End diff --
`... can not be casted to ...`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
