[jira] [Resolved] (SPARK-24934) Complex type and binary type in in-memory partition pruning does not work due to missing upper/lower bounds cases

[ https://issues.apache.org/jira/browse/SPARK-24934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24934. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.4.0

[jira] [Updated] (SPARK-24966) Fix the precedence rule for set operations.

[ https://issues.apache.org/jira/browse/SPARK-24966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24966: Target Version/s: 2.4.0 > Fix the precedence rule for set operations. >

[jira] [Updated] (SPARK-24955) spark continuing to execute on a task despite not reading all data from a downed machine

[ https://issues.apache.org/jira/browse/SPARK-24955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] San Tung updated SPARK-24955: - Description: We've recently run into a few instances where a downed node has led to incomplete data,

[jira] [Updated] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24957: Target Version/s: 2.4.0 > Decimal arithmetic can lead to wrong values using codegen >

[jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561334#comment-16561334 ] Saisai Shao commented on SPARK-24957: - Not necessary to mark as blocker, we still have plenty of

[jira] [Updated] (SPARK-24932) Allow update mode for streaming queries with join

[ https://issues.apache.org/jira/browse/SPARK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24932: Target Version/s: (was: 2.3.2) > Allow update mode for streaming queries with join >

[jira] [Commented] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-24964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561330#comment-16561330 ] Albert Baker commented on SPARK-24964: -- Fair enough, thanks for your help. > Please add OWASP

[jira] [Commented] (SPARK-24932) Allow update mode for streaming queries with join

[ https://issues.apache.org/jira/browse/SPARK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561331#comment-16561331 ] Saisai Shao commented on SPARK-24932: - I'm going to remove the target version for this JIRA.

[jira] [Updated] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-24964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24964: Target Version/s: (was: 2.3.2, 2.4.0, 3.0.0, 2.3.3) > Please add OWASP Dependency Check to all

[jira] [Commented] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml)

[ https://issues.apache.org/jira/browse/SPARK-24964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561327#comment-16561327 ] Saisai Shao commented on SPARK-24964: - I'm going to remove the set target version, usually we don't

[jira] [Commented] (SPARK-9850) Adaptive execution in Spark

[ https://issues.apache.org/jira/browse/SPARK-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561326#comment-16561326 ] Carson Wang commented on SPARK-9850: We have a new proposal and implementation for Spark SQL adaptive

[jira] [Commented] (SPARK-24966) Fix the precedence rule for set operations.

[ https://issues.apache.org/jira/browse/SPARK-24966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561303#comment-16561303 ] Dilip Biswal commented on SPARK-24966: -- I am working on a fix for this. > Fix the precedence rule

[jira] [Created] (SPARK-24966) Fix the precedence rule for set operations.

Dilip Biswal created SPARK-24966: Summary: Fix the precedence rule for set operations. Key: SPARK-24966 URL: https://issues.apache.org/jira/browse/SPARK-24966 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-24965) Spark SQL fails when reading a partitioned hive table with different formats per partition

[ https://issues.apache.org/jira/browse/SPARK-24965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561278#comment-16561278 ] Kris Geusebroek commented on SPARK-24965: - PR: https://github.com/apache/spark/pull/21893 >

[jira] [Comment Edited] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561277#comment-16561277 ] David Vogelbacher edited comment on SPARK-24957 at 7/29/18 9:55 PM:

[jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561277#comment-16561277 ] David Vogelbacher commented on SPARK-24957: --- [~mgaido] I wasn't able to reproduce the

[jira] [Created] (SPARK-24965) Spark SQL fails when reading a partitioned hive table with different formats per partition

Kris Geusebroek created SPARK-24965: --- Summary: Spark SQL fails when reading a partitioned hive table with different formats per partition Key: SPARK-24965 URL: https://issues.apache.org/jira/browse/SPARK-24965

[jira] [Commented] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561266#comment-16561266 ] Parth Gandhi commented on SPARK-24935: -- [~cloud_fan] I too had the same doubt that maybe hive UDAF

[jira] [Created] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml)

Albert Baker created SPARK-24964: Summary: Please add OWASP Dependency Check to all comonent builds(pom.xml) Key: SPARK-24964 URL: https://issues.apache.org/jira/browse/SPARK-24964 Project: Spark

[jira] [Created] (SPARK-24963) Integration tests will fail if they run in a namespace not being the default

Stavros Kontopoulos created SPARK-24963: --- Summary: Integration tests will fail if they run in a namespace not being the default Key: SPARK-24963 URL: https://issues.apache.org/jira/browse/SPARK-24963

[jira] [Assigned] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error

[ https://issues.apache.org/jira/browse/SPARK-24809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-24809: --- Assignee: Lijia Liu > Serializing LongHashedRelation in executor may result in data error >

[jira] [Resolved] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error

[ https://issues.apache.org/jira/browse/SPARK-24809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24809. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.2 2.2.3

[jira] [Assigned] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24005: Assignee: Apache Spark > Remove usage of Scala’s parallel collection >

[jira] [Assigned] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24005: Assignee: (was: Apache Spark) > Remove usage of Scala’s parallel collection >

[jira] [Commented] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561221#comment-16561221 ] Apache Spark commented on SPARK-24005: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-24962) refactor CodeGenerator.createUnsafeArray

[ https://issues.apache.org/jira/browse/SPARK-24962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561211#comment-16561211 ] Apache Spark commented on SPARK-24962: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24962) refactor CodeGenerator.createUnsafeArray

[ https://issues.apache.org/jira/browse/SPARK-24962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24962: Assignee: Apache Spark > refactor CodeGenerator.createUnsafeArray >

[jira] [Assigned] (SPARK-24962) refactor CodeGenerator.createUnsafeArray

[ https://issues.apache.org/jira/browse/SPARK-24962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24962: Assignee: (was: Apache Spark) > refactor CodeGenerator.createUnsafeArray >

[jira] [Created] (SPARK-24962) refactor CodeGenerator.createUnsafeArray

Kazuaki Ishizaki created SPARK-24962: Summary: refactor CodeGenerator.createUnsafeArray Key: SPARK-24962 URL: https://issues.apache.org/jira/browse/SPARK-24962 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-24940) Coalesce Hint for SQL Queries

[ https://issues.apache.org/jira/browse/SPARK-24940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24940: Assignee: Apache Spark > Coalesce Hint for SQL Queries > - >

[jira] [Assigned] (SPARK-24940) Coalesce Hint for SQL Queries

[ https://issues.apache.org/jira/browse/SPARK-24940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24940: Assignee: (was: Apache Spark) > Coalesce Hint for SQL Queries >

[jira] [Commented] (SPARK-24940) Coalesce Hint for SQL Queries

[ https://issues.apache.org/jira/browse/SPARK-24940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561175#comment-16561175 ] Apache Spark commented on SPARK-24940: -- User 'jzhuge' has created a pull request for this issue:

[jira] [Commented] (SPARK-24882) separate responsibilities of the data source v2 read API

[ https://issues.apache.org/jira/browse/SPARK-24882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561145#comment-16561145 ] Ryan Blue commented on SPARK-24882: --- [~cloud_fan], thanks for making those changes. I'll have a look

[jira] [Resolved] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4

[ https://issues.apache.org/jira/browse/SPARK-24956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24956. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 Resolved by 

[jira] [Updated] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4

[ https://issues.apache.org/jira/browse/SPARK-24956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24956: -- Priority: Minor (was: Major) > Upgrade maven from 3.3.9 to 3.5.4 > -

[jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561080#comment-16561080 ] Apache Spark commented on SPARK-24957: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24957: Assignee: Apache Spark > Decimal arithmetic can lead to wrong values using codegen >

[jira] [Assigned] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24957: Assignee: (was: Apache Spark) > Decimal arithmetic can lead to wrong values using

[jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen

[ https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561077#comment-16561077 ] Marco Gaido commented on SPARK-24957: - I am not sure what you mean by "When codegen is disabled all