[jira] [Commented] (SPARK-39001) Document which options are unsupported in CSV and JSON functions
[ https://issues.apache.org/jira/browse/SPARK-39001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527811#comment-17527811 ] Apache Spark commented on SPARK-39001: -- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/36346 > Document which options are unsupported in CSV and JSON functions > > > Key: SPARK-39001 > URL: https://issues.apache.org/jira/browse/SPARK-39001 > Project: Spark > Issue Type: Documentation > Components: SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Assignee: Hyukjin Kwon >Priority: Major > Fix For: 3.3.0, 3.4.0 > > > See https://github.com/apache/spark/pull/36294. Some of CSV and JSON options > don't work in expressions because some of them are plan-wise options like > parseMode = DROPMALFORMED. > We should document that which options are not working. possibly we should > also throw an exception. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39001) Document which options are unsupported in CSV and JSON functions
[ https://issues.apache.org/jira/browse/SPARK-39001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527812#comment-17527812 ] Apache Spark commented on SPARK-39001: -- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/36346 > Document which options are unsupported in CSV and JSON functions > > > Key: SPARK-39001 > URL: https://issues.apache.org/jira/browse/SPARK-39001 > Project: Spark > Issue Type: Documentation > Components: SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Assignee: Hyukjin Kwon >Priority: Major > Fix For: 3.3.0, 3.4.0 > > > See https://github.com/apache/spark/pull/36294. Some of CSV and JSON options > don't work in expressions because some of them are plan-wise options like > parseMode = DROPMALFORMED. > We should document that which options are not working. possibly we should > also throw an exception. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39001) Document which options are unsupported in CSV and JSON functions
[ https://issues.apache.org/jira/browse/SPARK-39001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527402#comment-17527402 ] Apache Spark commented on SPARK-39001: -- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/36339 > Document which options are unsupported in CSV and JSON functions > > > Key: SPARK-39001 > URL: https://issues.apache.org/jira/browse/SPARK-39001 > Project: Spark > Issue Type: Documentation > Components: SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Priority: Major > > See https://github.com/apache/spark/pull/36294. Some of CSV and JSON options > don't work in expressions because some of them are plan-wise options like > parseMode = DROPMALFORMED. > We should document that which options are not working. possibly we should > also throw an exception. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39001) Document which options are unsupported in CSV and JSON functions
[ https://issues.apache.org/jira/browse/SPARK-39001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527401#comment-17527401 ] Apache Spark commented on SPARK-39001: -- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/36339 > Document which options are unsupported in CSV and JSON functions > > > Key: SPARK-39001 > URL: https://issues.apache.org/jira/browse/SPARK-39001 > Project: Spark > Issue Type: Documentation > Components: SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Priority: Major > > See https://github.com/apache/spark/pull/36294. Some of CSV and JSON options > don't work in expressions because some of them are plan-wise options like > parseMode = DROPMALFORMED. > We should document that which options are not working. possibly we should > also throw an exception. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39001) Document which options are unsupported in CSV and JSON functions
[ https://issues.apache.org/jira/browse/SPARK-39001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527400#comment-17527400 ] Hyukjin Kwon commented on SPARK-39001: -- Actually this is pretty straightforward. let me just make a quick PR > Document which options are unsupported in CSV and JSON functions > > > Key: SPARK-39001 > URL: https://issues.apache.org/jira/browse/SPARK-39001 > Project: Spark > Issue Type: Documentation > Components: SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Priority: Major > > See https://github.com/apache/spark/pull/36294. Some of CSV and JSON options > don't work in expressions because some of them are plan-wise options like > parseMode = DROPMALFORMED. > We should document that which options are not working. possibly we should > also throw an exception. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-39001) Document which options are unsupported in CSV and JSON functions
[ https://issues.apache.org/jira/browse/SPARK-39001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526785#comment-17526785 ] Hyukjin Kwon commented on SPARK-39001: -- cc [~revans2] and [~tgraves] FYI. [~itholic] mind taking a look when you find some time? > Document which options are unsupported in CSV and JSON functions > > > Key: SPARK-39001 > URL: https://issues.apache.org/jira/browse/SPARK-39001 > Project: Spark > Issue Type: Documentation > Components: SQL >Affects Versions: 3.3.0 >Reporter: Hyukjin Kwon >Priority: Major > > See https://github.com/apache/spark/pull/36294. Some of CSV and JSON options > don't work in expressions because some of them are plan-wise options like > parseMode = DROPMALFORMED. > We should document that which options are not working. possibly we should > also throw an exception. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
