[jira] [Commented] (SPARK-33013) The constrains may grow exponentially in sql optimizer 'InferFiltersFromConstraints', which leads to driver oom

[ https://issues.apache.org/jira/browse/SPARK-33013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212131#comment-17212131 ] Takeshi Yamamuro commented on SPARK-33013: -- Yea, that's a known issue, so I will close this.

[jira] [Resolved] (SPARK-33013) The constrains may grow exponentially in sql optimizer 'InferFiltersFromConstraints', which leads to driver oom

[ https://issues.apache.org/jira/browse/SPARK-33013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33013. -- Resolution: Not A Problem > The constrains may grow exponentially in sql optimizer >

[jira] [Resolved] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33116. -- Resolution: Invalid > Spark SQL window function with order by cause result incorrect

[jira] [Commented] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212130#comment-17212130 ] Takeshi Yamamuro commented on SPARK-33116: -- In SQL, they are different, I think. The statement

[jira] [Created] (SPARK-33117) Update zstd-jni to 1.4.5-6

Dongjoon Hyun created SPARK-33117: - Summary: Update zstd-jni to 1.4.5-6 Key: SPARK-33117 URL: https://issues.apache.org/jira/browse/SPARK-33117 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-32907) adaptively blockify instances

[ https://issues.apache.org/jira/browse/SPARK-32907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-32907: -- Assignee: zhengruifeng > adaptively blockify instances > - > >

[jira] [Updated] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27872: -- Fix Version/s: 2.4.8 > Driver and executors use a different service account breaking pull

[jira] [Resolved] (SPARK-32047) Add provider disable possibility just like in delegation token provider

[ https://issues.apache.org/jira/browse/SPARK-32047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32047. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29964

[jira] [Assigned] (SPARK-32047) Add provider disable possibility just like in delegation token provider

[ https://issues.apache.org/jira/browse/SPARK-32047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32047: Assignee: Gabor Somogyi > Add provider disable possibility just like in delegation token

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212105#comment-17212105 ] Jim Kleckner commented on SPARK-24266: -- I believe that the PR is ready to merge to the 3.0 branch

[jira] [Updated] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Will Du updated SPARK-33116: Description: Prepare the data CREATE TABLE IF NOT EXISTS product_catalog ( name STRING,category

[jira] [Updated] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Will Du updated SPARK-33116: Description: Prepare the data CREATE TABLE IF NOT EXISTS product_catalog ( name STRING,category

[jira] [Updated] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Will Du updated SPARK-33116: Description: Prepare the data CREATE TABLE IF NOT EXISTS product_catalog ( name STRING,category

[jira] [Created] (SPARK-33116) Spark SQL window function with order by cause result incorrect

Will Du created SPARK-33116: --- Summary: Spark SQL window function with order by cause result incorrect Key: SPARK-33116 URL: https://issues.apache.org/jira/browse/SPARK-33116 Project: Spark Issue

[jira] [Commented] (SPARK-32907) adaptively blockify instances

[ https://issues.apache.org/jira/browse/SPARK-32907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212092#comment-17212092 ] Apache Spark commented on SPARK-32907: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-21708) Migrate build to sbt 1.3.13

[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212091#comment-17212091 ] Apache Spark commented on SPARK-21708: -- User 'williamhyun' has created a pull request for this

[jira] [Commented] (SPARK-21708) Migrate build to sbt 1.3.13

[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212090#comment-17212090 ] Apache Spark commented on SPARK-21708: -- User 'williamhyun' has created a pull request for this

[jira] [Commented] (SPARK-33013) The constrains may grow exponentially in sql optimizer 'InferFiltersFromConstraints', which leads to driver oom

[ https://issues.apache.org/jira/browse/SPARK-33013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212085#comment-17212085 ] Yang Jie commented on SPARK-33013: -- It appears to be a known issue that can configured

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212078#comment-17212078 ] Hyukjin Kwon commented on SPARK-33044: -- We need a confirmation from [~shaneknapp], [~LuciferYang].

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212077#comment-17212077 ] Yang Jie commented on SPARK-33044: -- [~dongjoon] has this issue completed？ > Add a Jenkins build and

[jira] [Assigned] (SPARK-33106) Fix sbt resolvers clash

[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33106: - Assignee: Denis Pyshev > Fix sbt resolvers clash > --- > >

[jira] [Resolved] (SPARK-33106) Fix sbt resolvers clash

[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33106. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30006

[jira] [Commented] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212067#comment-17212067 ] Apache Spark commented on SPARK-33115: -- User 'gemelen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33115: Assignee: (was: Apache Spark) > `kvstore` and `unsafe` doc tasks fail >

[jira] [Assigned] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33115: Assignee: Apache Spark > `kvstore` and `unsafe` doc tasks fail >

[jira] [Commented] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212066#comment-17212066 ] Apache Spark commented on SPARK-33115: -- User 'gemelen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33106) Fix sbt resolvers clash

[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33106: Assignee: (was: Apache Spark) > Fix sbt resolvers clash > --- >

[jira] [Commented] (SPARK-33106) Fix sbt resolvers clash

[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212059#comment-17212059 ] Apache Spark commented on SPARK-33106: -- User 'gemelen' has created a pull request for this issue:

[jira] [Commented] (SPARK-33106) Fix sbt resolvers clash

[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212058#comment-17212058 ] Apache Spark commented on SPARK-33106: -- User 'gemelen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33106) Fix sbt resolvers clash

[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33106: Assignee: Apache Spark > Fix sbt resolvers clash > --- > >

[jira] [Updated] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-33115: - Description: `build/sbt publishLocal` task fails in two modules: {code:java} [error] stack

[jira] [Updated] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-33115: - Description: `build/sbt publishLocal` task fails in two modules: {code:java} [error] stack

[jira] [Updated] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

[ https://issues.apache.org/jira/browse/SPARK-33115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-33115: - Description: `build/sbt publishLocal` task fails in two modules: {code:java} [error] stack

[jira] [Created] (SPARK-33115) `kvstore` and `unsafe` doc tasks fail

Denis Pyshev created SPARK-33115: Summary: `kvstore` and `unsafe` doc tasks fail Key: SPARK-33115 URL: https://issues.apache.org/jira/browse/SPARK-33115 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33113) [SparkR] gapply works with arrow disabled, fails with arrow enabled stringsAsFactors=TRUE

[ https://issues.apache.org/jira/browse/SPARK-33113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Pliszka updated SPARK-33113: -- Summary: [SparkR] gapply works with arrow disabled, fails with arrow enabled

[jira] [Updated] (SPARK-33113) [SparkR] gapply works with arrow disabled, fails with arrow enabled

[ https://issues.apache.org/jira/browse/SPARK-33113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Pliszka updated SPARK-33113: -- Description: Running in databricks on Azure library("arrow") library("SparkR") df <-

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211987#comment-17211987 ] Dongjoon Hyun commented on SPARK-27733: --- HIVE-21737 seems to be blocked by AVRO-2817 . > Upgrade

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211984#comment-17211984 ] Dongjoon Hyun commented on SPARK-27733: --- Ya. It's removed for all these stuffs and more. :) >

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211955#comment-17211955 ] t oo commented on SPARK-27733: -- hive 1 gone I think > Upgrade to Avro 1.10.0 > -- > >

[jira] [Updated] (SPARK-33114) Add metadata in MapStatus to support custom shuffle manager

[ https://issues.apache.org/jira/browse/SPARK-33114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33114: Target Version/s: (was: 3.0.1) > Add metadata in MapStatus to support custom shuffle manager >

[jira] [Commented] (SPARK-33107) Remove hive-2.3 workaround code

[ https://issues.apache.org/jira/browse/SPARK-33107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211869#comment-17211869 ] Apache Spark commented on SPARK-33107: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33107) Remove hive-2.3 workaround code

[ https://issues.apache.org/jira/browse/SPARK-33107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211868#comment-17211868 ] Apache Spark commented on SPARK-33107: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33114) Add metadata in MapStatus to support custom shuffle manager

[ https://issues.apache.org/jira/browse/SPARK-33114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33114: Assignee: Apache Spark > Add metadata in MapStatus to support custom shuffle manager >

[jira] [Commented] (SPARK-33114) Add metadata in MapStatus to support custom shuffle manager

[ https://issues.apache.org/jira/browse/SPARK-33114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211837#comment-17211837 ] Apache Spark commented on SPARK-33114: -- User 'boy-uber' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33114) Add metadata in MapStatus to support custom shuffle manager

[ https://issues.apache.org/jira/browse/SPARK-33114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33114: Assignee: (was: Apache Spark) > Add metadata in MapStatus to support custom shuffle