[ 
https://issues.apache.org/jira/browse/SPARK-33316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gengliang Wang reassigned SPARK-33316:
--------------------------------------

    Assignee: Bo Zhang

> Support nullable Avro schemas for non-nullable data in Avro writing
> -------------------------------------------------------------------
>
>                 Key: SPARK-33316
>                 URL: https://issues.apache.org/jira/browse/SPARK-33316
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0, 3.0.0, 3.0.1
>            Reporter: Bo Zhang
>            Assignee: Bo Zhang
>            Priority: Major
>             Fix For: 3.1.0
>
>
> Currently when users try to use nullable Avro schemas for non-nullable data 
> in Avro writing, Spark will throw a IncompatibleSchemaException.
> There are some cases when users do not have full control over the nullability 
> of the data, or the nullability of the Avro schemas they have to use. We 
> should support nullable Avro schemas for non-nullable data in Avro writing 
> for better usability.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to