[ https://issues.apache.org/jira/browse/SPARK-35291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
umar Asir updated SPARK-35291: ------------------------------ Attachment: NotNullIssue.scala > NullPointerException at > org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown > Source) > -------------------------------------------------------------------------------------------------------------------------------------------- > > Key: SPARK-35291 > URL: https://issues.apache.org/jira/browse/SPARK-35291 > Project: Spark > Issue Type: Bug > Components: Optimizer, SQL > Affects Versions: 3.0.2 > Reporter: umar Asir > Priority: Major > Attachments: NotNullIssue.scala, cdwqasourceupdate.7z, > cdwqatgtupdate.7z, run1.log > > > We are trying to merge data using DeltaTable's merge API. on inserting a null > value into the not-null column results in NullPointerException instead of > throwing constrain violation error > > ^Caused by: java.lang.NullPointerExceptionCaused by: > java.lang.NullPointerException at > org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.CreateExternalRow_0$(Unknown > Source) at > org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificSafeProjection.apply(Unknown > Source) at > org.apache.spark.sql.catalyst.encoders.ExpressionEncoder$Deserializer.apply(ExpressionEncoder.scala:184) > ... 17 more^ > > Please find the sample program [^NotNullIssue.scala] reading source data from > parquet files [^cdwqasourceupdate.7z] and writing data with merge to > [^cdwqatgtupdate.7z] > > Attaching log [^run1.log] > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org