[
https://issues.apache.org/jira/browse/SPARK-35291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
umar Asir updated SPARK-35291:
------------------------------
Description:
We are trying to merge data using DeltaTable's merge API. on inserting a null
value into the not-null column results in NullPointerException instead of
throwing constrain violation error
^Caused by: java.lang.NullPointerExceptionCaused by:
java.lang.NullPointerException at
org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown
Source) at
org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.apply(Unknown
Source) at
org.apache.spark.sql.catalyst.encoders.ExpressionEncoder$Deserializer.apply(ExpressionEncoder.scala:184)
... 17 more^
Please find the sample program [^NotNullIssue.scala] reading source data from
parquet files [^cdwqasourceupdate.7z] and writing data with merge to
[^cdwqatgtupdate.7z]
Attaching log [^run1.log]
was:
We are trying to merge data using DeltaTable's merge API. on inserting a null
value into the not-null column results in NullPointerException instead of
throwing constrain violation error
^Caused by: java.lang.NullPointerExceptionCaused by:
java.lang.NullPointerException at
org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown
Source) at
org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.apply(Unknown
Source) at
org.apache.spark.sql.catalyst.encoders.ExpressionEncoder$Deserializer.apply(ExpressionEncoder.scala:184)
... 17 more^
Please find the sample program [^NotNullIssue.scala] reading source data from
parquet files [^cdwqasourceupdate.7z] and writing data with merge to
[^cdwqatgtupdate.7z]
Merge results on null pointer exception on trying to insert null data to not
column
Attaching log [^run1.log]
> NullPointerException at
> org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown
> Source)
> --------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-35291
> URL: https://issues.apache.org/jira/browse/SPARK-35291
> Project: Spark
> Issue Type: Bug
> Components: Optimizer, SQL
> Affects Versions: 3.0.2
> Reporter: umar Asir
> Priority: Major
> Attachments: NotNullIssue.scala, cdwqasourceupdate.7z,
> cdwqatgtupdate.7z, run1.log
>
>
> We are trying to merge data using DeltaTable's merge API. on inserting a null
> value into the not-null column results in NullPointerException instead of
> throwing constrain violation error
>
> ^Caused by: java.lang.NullPointerExceptionCaused by:
> java.lang.NullPointerException at
> org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown
> Source) at
> org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.apply(Unknown
> Source) at
> org.apache.spark.sql.catalyst.encoders.ExpressionEncoder$Deserializer.apply(ExpressionEncoder.scala:184)
> ... 17 more^
>
> Please find the sample program [^NotNullIssue.scala] reading source data from
> parquet files [^cdwqasourceupdate.7z] and writing data with merge to
> [^cdwqatgtupdate.7z]
>
> Attaching log [^run1.log]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
