Yin Huai created SPARK-6052:
-------------------------------
Summary: In JSON schema inference, we should always set
containsNull of an ArrayType to true
Key: SPARK-6052
URL: https://issues.apache.org/jira/browse/SPARK-6052
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Yin Huai
Priority: Blocker
We should not try to figure out if an array contains null or not because we may
miss arrays with null if we do sampling or future data may have nulls in the
array.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
