[ https://issues.apache.org/jira/browse/SPARK-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li updated SPARK-12258: ---------------------------- Comment: was deleted (was: [~cloud_fan] It sounds like it is related to the PR https://github.com/apache/spark/pull/9770. We just need to include the timestamp, bigDecimal and date in the filter, since they are not primitive types. I just tried it. It works! If you do not mind, can I try to fix it? Thanks!) > Hive Timestamp UDF is binded with '1969-12-31 15:59:59.999999' for null value > ----------------------------------------------------------------------------- > > Key: SPARK-12258 > URL: https://issues.apache.org/jira/browse/SPARK-12258 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.6.0 > Reporter: Ian > > {code} > test("Timestamp UDF and Null value") { > hiveContext.runSqlHive("CREATE TABLE ts_test (ts TIMESTAMP) STORED AS > TEXTFILE") > hiveContext.runSqlHive("INSERT INTO TABLE ts_test VALUES(Null)") > hiveContext.udf.register("dummy", > (ts: Timestamp) => ts > ) > val result = hiveContext.sql("SELECT dummy(ts) FROM > ts_test").collect().mkString("\n") > assertResult("[null]")(result) > } > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org