[jira] [Updated] (SPARK-26372) CSV parsing uses previous good value for bad input field

[ https://issues.apache.org/jira/browse/SPARK-26372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26372: - Labels: (was: correctness) > CSV parsing uses previous good value for bad input field >

[jira] [Updated] (SPARK-26372) CSV parsing uses previous good value for bad input field

[ https://issues.apache.org/jira/browse/SPARK-26372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26372: - Labels: correctness (was: ) > CSV parsing uses previous good value for bad input field >

[jira] [Resolved] (SPARK-26372) CSV parsing uses previous good value for bad input field

[ https://issues.apache.org/jira/browse/SPARK-26372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26372. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23323

[jira] [Assigned] (SPARK-26372) CSV parsing uses previous good value for bad input field

[ https://issues.apache.org/jira/browse/SPARK-26372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26372: Assignee: Bruce Robbins > CSV parsing uses previous good value for bad input field >

[jira] [Commented] (SPARK-26372) CSV parsing uses previous good value for bad input field

[ https://issues.apache.org/jira/browse/SPARK-26372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722367#comment-16722367 ] ASF GitHub Bot commented on SPARK-26372: asfgit closed pull request #23323: [SPARK-26372][SQL]

[jira] [Commented] (SPARK-26078) WHERE .. IN fails to filter rows when used in combination with UNION

[ https://issues.apache.org/jira/browse/SPARK-26078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722363#comment-16722363 ] ASF GitHub Bot commented on SPARK-26078: asfgit closed pull request #23057: [SPARK-26078][SQL]

[jira] [Assigned] (SPARK-26078) WHERE .. IN fails to filter rows when used in combination with UNION

[ https://issues.apache.org/jira/browse/SPARK-26078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26078: --- Assignee: Marco Gaido > WHERE .. IN fails to filter rows when used in combination with

[jira] [Resolved] (SPARK-26078) WHERE .. IN fails to filter rows when used in combination with UNION

[ https://issues.apache.org/jira/browse/SPARK-26078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26078. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23057

[jira] [Commented] (SPARK-26243) Use java.time API for parsing timestamps and dates from JSON

[ https://issues.apache.org/jira/browse/SPARK-26243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722345#comment-16722345 ] ASF GitHub Bot commented on SPARK-26243: asfgit closed pull request #23196: [SPARK-26243][SQL]

[jira] [Resolved] (SPARK-26243) Use java.time API for parsing timestamps and dates from JSON

[ https://issues.apache.org/jira/browse/SPARK-26243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26243. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23196

[jira] [Assigned] (SPARK-26243) Use java.time API for parsing timestamps and dates from JSON

[ https://issues.apache.org/jira/browse/SPARK-26243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26243: --- Assignee: Maxim Gekk > Use java.time API for parsing timestamps and dates from JSON >

[jira] [Commented] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722326#comment-16722326 ] Jordan Moore commented on SPARK-26314: -- It is powered by, yes. But I say it became purely based on

[jira] [Commented] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722322#comment-16722322 ] Dongjoon Hyun commented on SPARK-26314: --- Sorry, but I totally disagree from the first point. bq.

[jira] [Comment Edited] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722310#comment-16722310 ] Dongjoon Hyun edited comment on SPARK-26314 at 12/15/18 10:43 PM: --

[jira] [Commented] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722314#comment-16722314 ] Jordan Moore commented on SPARK-26314: -- [~dongjoon], I however feel like AVRO-1124 won't have any

[jira] [Comment Edited] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722310#comment-16722310 ] Dongjoon Hyun edited comment on SPARK-26314 at 12/15/18 10:48 PM: --

[jira] [Comment Edited] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722314#comment-16722314 ] Jordan Moore edited comment on SPARK-26314 at 12/15/18 10:57 PM: -

[jira] [Commented] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722310#comment-16722310 ] Dongjoon Hyun commented on SPARK-26314: --- [~cricket007]. Thank you for mentioning AVRO-1124 and the

[jira] [Comment Edited] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722310#comment-16722310 ] Dongjoon Hyun edited comment on SPARK-26314 at 12/15/18 10:50 PM: --

[jira] [Commented] (SPARK-26378) Queries of wide CSV data slowed after SPARK-26151

[ https://issues.apache.org/jira/browse/SPARK-26378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722311#comment-16722311 ] Bruce Robbins commented on SPARK-26378: --- I will try to submit a PR tomorrow. > Queries of wide

[jira] [Created] (SPARK-26378) Queries of wide CSV data slowed after SPARK-26151

Bruce Robbins created SPARK-26378: - Summary: Queries of wide CSV data slowed after SPARK-26151 Key: SPARK-26378 URL: https://issues.apache.org/jira/browse/SPARK-26378 Project: Spark Issue

[jira] [Created] (SPARK-26377) java.lang.IllegalStateException: No current assignment for partition

pavan created SPARK-26377: - Summary: java.lang.IllegalStateException: No current assignment for partition Key: SPARK-26377 URL: https://issues.apache.org/jira/browse/SPARK-26377 Project: Spark

[jira] [Updated] (SPARK-26377) java.lang.IllegalStateException: No current assignment for partition

[ https://issues.apache.org/jira/browse/SPARK-26377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pavan updated SPARK-26377: -- Description: Hi,    I am using sparkkafkaDirectStream with subscriberPattern with initial offsets for

[jira] [Commented] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722240#comment-16722240 ] Jordan Moore commented on SPARK-26314: -- Hi [~dongjoon], I'm sure you are speaking for the Spark

[jira] [Assigned] (SPARK-26376) Skip inputs without tokens by JSON datasource

[ https://issues.apache.org/jira/browse/SPARK-26376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26376: Assignee: Apache Spark > Skip inputs without tokens by JSON datasource >

[jira] [Assigned] (SPARK-26376) Skip inputs without tokens by JSON datasource

[ https://issues.apache.org/jira/browse/SPARK-26376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26376: Assignee: (was: Apache Spark) > Skip inputs without tokens by JSON datasource >

[jira] [Commented] (SPARK-26376) Skip inputs without tokens by JSON datasource

[ https://issues.apache.org/jira/browse/SPARK-26376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722209#comment-16722209 ] ASF GitHub Bot commented on SPARK-26376: MaxGekk opened a new pull request #23325:

[jira] [Created] (SPARK-26376) Skip inputs without tokens by JSON datasource

Maxim Gekk created SPARK-26376: -- Summary: Skip inputs without tokens by JSON datasource Key: SPARK-26376 URL: https://issues.apache.org/jira/browse/SPARK-26376 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-26315) auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-26315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26315: - Assignee: Song Ci > auto cast threshold from Integer to Float in approxSimilarityJoin of >

[jira] [Commented] (SPARK-26315) auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-26315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722180#comment-16722180 ] ASF GitHub Bot commented on SPARK-26315: srowen closed pull request #23313:

[jira] [Resolved] (SPARK-26315) auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-26315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26315. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 2.3.3

[jira] [Updated] (SPARK-26315) auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-26315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26315: -- Priority: Minor (was: Major) Issue Type: Bug (was: Improvement) > auto cast threshold from

[jira] [Updated] (SPARK-26375) Rule PruneFileSourcePartitions should be fired before any other rules based on table statistics

[ https://issues.apache.org/jira/browse/SPARK-26375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang, Gang updated SPARK-26375: --- Description: In catalyst, some optimize rules are base on table statistics, like rule ReorderJoin,

[jira] [Commented] (SPARK-26358) Spark deployed mode question

[ https://issues.apache.org/jira/browse/SPARK-26358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722121#comment-16722121 ] Hyukjin Kwon commented on SPARK-26358: -- Hm, can you copy and paste the comments you run? I have a

[jira] [Updated] (SPARK-26375) Rule PruneFileSourcePartitions should be fired before any other rules based on table statistics

[ https://issues.apache.org/jira/browse/SPARK-26375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang, Gang updated SPARK-26375: --- Summary: Rule PruneFileSourcePartitions should be fired before any other rules based on table

[jira] [Created] (SPARK-26375) Rule PruneFileSourcePartitions should be fired before any other rules based on data size

Wang, Gang created SPARK-26375: -- Summary: Rule PruneFileSourcePartitions should be fired before any other rules based on data size Key: SPARK-26375 URL: https://issues.apache.org/jira/browse/SPARK-26375

[jira] [Created] (SPARK-26374) Support new date/timestamp parser in HadoopFsRelationTest

Maxim Gekk created SPARK-26374: -- Summary: Support new date/timestamp parser in HadoopFsRelationTest Key: SPARK-26374 URL: https://issues.apache.org/jira/browse/SPARK-26374 Project: Spark Issue