[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-22 Thread Kousuke Saruta (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402951#comment-17402951
 ] 

Kousuke Saruta commented on SPARK-36429:


Issue resolved in https://github.com/apache/spark/pull/33684.

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Assignee: jiaan.geng
>Priority: Major
> Fix For: 3.2.0
>
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-09 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395857#comment-17395857
 ] 

Apache Spark commented on SPARK-36429:
--

User 'beliefer' has created a pull request for this issue:
https://github.com/apache/spark/pull/33684

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Assignee: jiaan.geng
>Priority: Major
> Fix For: 3.2.0
>
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-06 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394726#comment-17394726
 ] 

Apache Spark commented on SPARK-36429:
--

User 'sarutak' has created a pull request for this issue:
https://github.com/apache/spark/pull/33670

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Assignee: jiaan.geng
>Priority: Major
> Fix For: 3.2.0
>
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-06 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394724#comment-17394724
 ] 

Apache Spark commented on SPARK-36429:
--

User 'sarutak' has created a pull request for this issue:
https://github.com/apache/spark/pull/33670

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Assignee: jiaan.geng
>Priority: Major
> Fix For: 3.2.0
>
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-06 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394680#comment-17394680
 ] 

Apache Spark commented on SPARK-36429:
--

User 'ulysses-you' has created a pull request for this issue:
https://github.com/apache/spark/pull/33668

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Assignee: jiaan.geng
>Priority: Major
> Fix For: 3.2.0
>
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-06 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394679#comment-17394679
 ] 

Apache Spark commented on SPARK-36429:
--

User 'ulysses-you' has created a pull request for this issue:
https://github.com/apache/spark/pull/33668

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Assignee: jiaan.geng
>Priority: Major
> Fix For: 3.2.0
>
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-06 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394557#comment-17394557
 ] 

Apache Spark commented on SPARK-36429:
--

User 'sarutak' has created a pull request for this issue:
https://github.com/apache/spark/pull/33663

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Priority: Major
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-05 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393891#comment-17393891
 ] 

Apache Spark commented on SPARK-36429:
--

User 'beliefer' has created a pull request for this issue:
https://github.com/apache/spark/pull/33654

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Priority: Major
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

2021-08-05 Thread jiaan.geng (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393828#comment-17393828
 ] 

jiaan.geng commented on SPARK-36429:


I'm working on.

> JacksonParser should throw exception when data type unsupported.
> 
>
> Key: SPARK-36429
> URL: https://issues.apache.org/jira/browse/SPARK-36429
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.2.0
>Reporter: jiaan.geng
>Priority: Major
>
> Currently, when set spark.sql.timestampType=TIMESTAMP_NTZ, the behavior is 
> different between from_json and from_csv.
> {code:java}
> -- !query
> select from_json('{"t":"26/October/2015"}', 't Timestamp', 
> map('timestampFormat', 'dd/M/'))
> -- !query schema
> struct>
> -- !query output
> {"t":null}
> {code}
> {code:java}
> -- !query
> select from_csv('26/October/2015', 't Timestamp', map('timestampFormat', 
> 'dd/M/'))
> -- !query schema
> struct<>
> -- !query output
> java.lang.Exception
> Unsupported type: timestamp_ntz
> {code}
> We should make from_json throws exception too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org