[jira] [Commented] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209309#comment-17209309 ] Apache Spark commented on SPARK-33073: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-33082) Remove hive-1.2 workaround code

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33082: Assignee: (was: Apache Spark) > Remove hive-1.2 workaround code >

[jira] [Commented] (SPARK-33082) Remove hive-1.2 workaround code

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209307#comment-17209307 ] Apache Spark commented on SPARK-33082: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33082) Remove hive-1.2 workaround code

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33082: Assignee: Apache Spark > Remove hive-1.2 workaround code >

[jira] [Commented] (SPARK-33082) Remove hive-1.2 workaround code

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209306#comment-17209306 ] Apache Spark commented on SPARK-33082: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33082) Remove hive-1.2 workaround code

2020-10-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33082: - Summary: Remove hive-1.2 workaround code Key: SPARK-33082 URL: https://issues.apache.org/jira/browse/SPARK-33082 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-30542) Two Spark structured streaming jobs cannot write to same base path

2020-10-06 Thread Sachin Pasalkar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209297#comment-17209297 ] Sachin Pasalkar commented on SPARK-30542: - [~SparkSiva] Did you get a response to it? I see it's

[jira] [Assigned] (SPARK-33034) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (Oracle dialect)

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33034: --- Assignee: Maxim Gekk > Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and

[jira] [Resolved] (SPARK-33034) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (Oracle dialect)

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33034. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29912

[jira] [Commented] (SPARK-32067) Use unique ConfigMap name for executor pod template

2020-10-06 Thread Stijn De Haes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209279#comment-17209279 ] Stijn De Haes commented on SPARK-32067: --- [~dongjoon] Ok thank you very much :) > Use unique

[jira] [Commented] (SPARK-33017) PySpark Context should have getCheckpointDir() method

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209269#comment-17209269 ] Apache Spark commented on SPARK-33017: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33073: - Fix Version/s: (was: 3.0.2) > Improve error handling on Pandas to Arrow conversion failures

[jira] [Resolved] (SPARK-33007) Optimize to_json + named_struct + from_json expression chain

2020-10-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33007. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29942

[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

2020-10-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209229#comment-17209229 ] Sean R. Owen commented on SPARK-33043: -- My unofficial guess is December, just based on previous

[jira] [Commented] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209225#comment-17209225 ] Apache Spark commented on SPARK-32381: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

2020-10-06 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209221#comment-17209221 ] Karen Feng commented on SPARK-33043: When can we anticipate a 3.0.2 release with the fix? >

[jira] [Updated] (SPARK-33081) Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2 dialect)

2020-10-06 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-33081: --- Summary: Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (DB2

[jira] [Updated] (SPARK-33080) Replace compiler reporter with more robust and maintainable solution

2020-10-06 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-33080: - Description: Currently existing solution to have build to fail on any warning except

[jira] [Updated] (SPARK-33080) Replace compiler reporter with more robust and maintainable solution

2020-10-06 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-33080: - Description: Currently existing solution to have build to fail on any warning except

[jira] [Updated] (SPARK-33080) Replace compiler reporter with more robust and maintainable solution

2020-10-06 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-33080: - Description: Currently existing solution to have build to fail on any warning except

[jira] [Created] (SPARK-33081) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (DB2 dialect)

2020-10-06 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-33081: -- Summary: Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (DB2 dialect) Key: SPARK-33081 URL:

[jira] [Created] (SPARK-33080) Replace compiler reporter with more robust and maintainable solution

2020-10-06 Thread Denis Pyshev (Jira)
Denis Pyshev created SPARK-33080: Summary: Replace compiler reporter with more robust and maintainable solution Key: SPARK-33080 URL: https://issues.apache.org/jira/browse/SPARK-33080 Project: Spark

[jira] [Commented] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209197#comment-17209197 ] Apache Spark commented on SPARK-33079: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209196#comment-17209196 ] Apache Spark commented on SPARK-33079: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33079: Assignee: Apache Spark (was: Kousuke Saruta) > Add Scala 2.13 build test in GitHub

[jira] [Assigned] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33079: Assignee: Kousuke Saruta (was: Apache Spark) > Add Scala 2.13 build test in GitHub

[jira] [Updated] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33079: --- Description: SPARK-32926 added a build test to GitHub Action for Scala 2.13 but it's only

[jira] [Updated] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33079: --- Description: SPARK-32926 added a build test to GitHub Action for Scala 2.13 but it's only

[jira] [Created] (SPARK-33079) Add Scala 2.13 build test in GitHub Action for SBT

2020-10-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33079: -- Summary: Add Scala 2.13 build test in GitHub Action for SBT Key: SPARK-33079 URL: https://issues.apache.org/jira/browse/SPARK-33079 Project: Spark Issue

[jira] [Created] (SPARK-33078) Add SQL config to control Json expression optimization

2020-10-06 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33078: --- Summary: Add SQL config to control Json expression optimization Key: SPARK-33078 URL: https://issues.apache.org/jira/browse/SPARK-33078 Project: Spark Issue

[jira] [Assigned] (SPARK-32857) Flaky o.a.s.scheduler.BarrierTaskContextSuite.throw exception if the number of barrier() calls are not the same on every task

2020-10-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32857: - Assignee: wuyi > Flaky o.a.s.scheduler.BarrierTaskContextSuite.throw exception if the

[jira] [Resolved] (SPARK-32857) Flaky o.a.s.scheduler.BarrierTaskContextSuite.throw exception if the number of barrier() calls are not the same on every task

2020-10-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32857. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29732

[jira] [Commented] (SPARK-32067) Use unique ConfigMap name for executor pod template

2020-10-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209149#comment-17209149 ] Dongjoon Hyun commented on SPARK-32067: --- Thanks, but no worry, [~sdehaes]. If there is no

[jira] [Updated] (SPARK-32067) Use unique ConfigMap name for executor pod template

2020-10-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Affects Version/s: (was: 2.4.7) > Use unique ConfigMap name for executor pod template >

[jira] [Commented] (SPARK-32511) Add dropFields method to Column class

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209065#comment-17209065 ] Apache Spark commented on SPARK-32511: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33071) Join with ambiguous column succeeding but giving wrong output

2020-10-06 Thread Aoyuan Liao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209064#comment-17209064 ] Aoyuan Liao commented on SPARK-33071: - Yeah, I agree with you. IMHO, would prefer a error message

[jira] [Commented] (SPARK-32511) Add dropFields method to Column class

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209061#comment-17209061 ] Apache Spark commented on SPARK-32511: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33071) Join with ambiguous column succeeding but giving wrong output

2020-10-06 Thread George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209050#comment-17209050 ] George commented on SPARK-33071: [~EveLiao] Yeah that sounds correct, another workaround I found was

[jira] [Updated] (SPARK-33077) Spark 3 / Cats 2.2.0 classpath issue

2020-10-06 Thread Sami Dalouche (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sami Dalouche updated SPARK-33077: -- Description: A small project with minimal dependencies as well as instructions on how to

[jira] [Created] (SPARK-33077) Spark 3 / Cats 2.2.0 classpath issue

2020-10-06 Thread Sami Dalouche (Jira)
Sami Dalouche created SPARK-33077: - Summary: Spark 3 / Cats 2.2.0 classpath issue Key: SPARK-33077 URL: https://issues.apache.org/jira/browse/SPARK-33077 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33039) Misleading watermark calculation in structure streaming

2020-10-06 Thread Aoyuan Liao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209030#comment-17209030 ] Aoyuan Liao commented on SPARK-33039: - Since the window: [2020-08-29 10:15:00, 2020-08-29 10:15:10]

[jira] [Commented] (SPARK-33071) Join with ambiguous column succeeding but giving wrong output

2020-10-06 Thread Aoyuan Liao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209026#comment-17209026 ] Aoyuan Liao commented on SPARK-33071: - Need to talk with experienced contributors to see if it is a

[jira] [Commented] (SPARK-33067) Add negative checks to JDBC v2 Table Catalog tests

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208992#comment-17208992 ] Apache Spark commented on SPARK-33067: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32963) empty string should be consistent for schema name in SparkGetSchemasOperation

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32963. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29834

[jira] [Assigned] (SPARK-32963) empty string should be consistent for schema name in SparkGetSchemasOperation

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32963: --- Assignee: Kent Yao > empty string should be consistent for schema name in

[jira] [Created] (SPARK-33076) Change pyspark.sql.functions.lower(col) to get col name

2020-10-06 Thread Shahar Luftig (Jira)
Shahar Luftig created SPARK-33076: - Summary: Change pyspark.sql.functions.lower(col) to get col name Key: SPARK-33076 URL: https://issues.apache.org/jira/browse/SPARK-33076 Project: Spark

[jira] [Commented] (SPARK-32243) HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208787#comment-17208787 ] Apache Spark commented on SPARK-32243: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-32243) HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208788#comment-17208788 ] Apache Spark commented on SPARK-32243: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32243) HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32243. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29054

[jira] [Assigned] (SPARK-32243) HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32243: --- Assignee: angerszhu > HiveSessionCatalog call super.makeFunctionExpression should show

[jira] [Assigned] (SPARK-27428) Test "metrics StatsD sink with Timer " fails on BigEndian

2020-10-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-27428: Assignee: Michael Munday > Test "metrics StatsD sink with Timer " fails on BigEndian >

[jira] [Resolved] (SPARK-27428) Test "metrics StatsD sink with Timer " fails on BigEndian

2020-10-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-27428. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-33035) Updates the obsoleted entries of attribute mapping in QueryPlan#transformUpWithNewOutput

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208676#comment-17208676 ] Apache Spark commented on SPARK-33035: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33035) Updates the obsoleted entries of attribute mapping in QueryPlan#transformUpWithNewOutput

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208677#comment-17208677 ] Apache Spark commented on SPARK-33035: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33039) Misleading watermark calculation in structure streaming

2020-10-06 Thread Sandish Kumar HN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208674#comment-17208674 ] Sandish Kumar HN commented on SPARK-33039: -- [~EveLiao] I had made the change as output mode to

[jira] [Resolved] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33073. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33073: Assignee: Bryan Cutler > Improve error handling on Pandas to Arrow conversion failures >

[jira] [Resolved] (SPARK-32511) Add dropFields method to Column class

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32511. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29795

[jira] [Created] (SPARK-33075) Only disable auto bucketed scan for cached query

2020-10-06 Thread Cheng Su (Jira)
Cheng Su created SPARK-33075: Summary: Only disable auto bucketed scan for cached query Key: SPARK-33075 URL: https://issues.apache.org/jira/browse/SPARK-33075 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208568#comment-17208568 ] Apache Spark commented on SPARK-33074: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208566#comment-17208566 ] Apache Spark commented on SPARK-33074: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33074: Assignee: (was: Apache Spark) > Classify dialect exceptions in JDBC v2 Table Catalog

[jira] [Assigned] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33074: Assignee: Apache Spark > Classify dialect exceptions in JDBC v2 Table Catalog >

[jira] [Assigned] (SPARK-33035) Updates the obsoleted entries of attribute mapping in QueryPlan#transformUpWithNewOutput

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33035: --- Assignee: Takeshi Yamamuro > Updates the obsoleted entries of attribute mapping in >

[jira] [Resolved] (SPARK-33035) Updates the obsoleted entries of attribute mapping in QueryPlan#transformUpWithNewOutput

2020-10-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33035. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29911

[jira] [Created] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33074: -- Summary: Classify dialect exceptions in JDBC v2 Table Catalog Key: SPARK-33074 URL: https://issues.apache.org/jira/browse/SPARK-33074 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32082) Project Zen: Improving Python usability

2020-10-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32082: - Priority: Critical (was: Major) > Project Zen: Improving Python usability >

[jira] [Commented] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208523#comment-17208523 ] Apache Spark commented on SPARK-33073: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33073: Assignee: (was: Apache Spark) > Improve error handling on Pandas to Arrow conversion

[jira] [Assigned] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33073: Assignee: Apache Spark > Improve error handling on Pandas to Arrow conversion failures >

[jira] [Updated] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-33073: - Description: Currently, when converting from Pandas to Arrow for Pandas UDF return values or

[jira] [Created] (SPARK-33073) Improve error handling on Pandas to Arrow conversion failures

2020-10-06 Thread Bryan Cutler (Jira)
Bryan Cutler created SPARK-33073: Summary: Improve error handling on Pandas to Arrow conversion failures Key: SPARK-33073 URL: https://issues.apache.org/jira/browse/SPARK-33073 Project: Spark