Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14124
BTW, actually, this is not only about user-given schema.
Currently, it always reads data into dataframe by datasources based on
`FileFormat` ignoring nullability in schema (for both user-given schema and
inferred/read schema).
However, this does not happen when reading for streaming by the datasources
(and another JSON api).
So, this PR tries to make them consistent to ignore the nullability in
schema.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
