[jira] [Assigned] (SPARK-40606) Eliminate `to_pandas` warnings in test

2022-09-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40606: - Assignee: Ruifeng Zheng > Eliminate `to_pandas` warnings in test >

[jira] [Resolved] (SPARK-40606) Eliminate `to_pandas` warnings in test

2022-09-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40606. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38042

[jira] [Updated] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-40617: --- Description: Spurious failures because of the assert: {noformat} 22/09/29 09:46:24

[jira] [Commented] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611353#comment-17611353 ] Attila Zsolt Piros commented on SPARK-34779: [~praetp] I managed to reproduce it in a unit

[jira] [Commented] (SPARK-39869) Fix flaky hive - slow tests because of out-of-memory

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611348#comment-17611348 ] Apache Spark commented on SPARK-39869: -- User 'LuciferYang' has created a pull request for this

[jira] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-29 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563 ] ming95 deleted comment on SPARK-40563: was (Author: zing): The issue has been fixed in the latest master branch. > Error at where clause, when sql case executes by else branch >

[jira] [Resolved] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-29 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 resolved SPARK-40563. Fix Version/s: 3.3.1 Resolution: Fixed The issue has been fixed in the latest master

[jira] [Commented] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-29 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611343#comment-17611343 ] ming95 commented on SPARK-40563: In my test , the issue has been fixed in the latest master

[jira] [Created] (SPARK-40619) HivePartitionFilteringSuites teset aborted due to `java.lang.OutOfMemoryError: Metaspace`

2022-09-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-40619: Summary: HivePartitionFilteringSuites teset aborted due to `java.lang.OutOfMemoryError: Metaspace` Key: SPARK-40619 URL: https://issues.apache.org/jira/browse/SPARK-40619

[jira] [Commented] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611340#comment-17611340 ] Apache Spark commented on SPARK-40617: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40617: Assignee: Apache Spark (was: Attila Zsolt Piros) > Assertion failed in

[jira] [Assigned] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40617: Assignee: Attila Zsolt Piros (was: Apache Spark) > Assertion failed in

[jira] [Commented] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611339#comment-17611339 ] Apache Spark commented on SPARK-40617: -- User 'attilapiros' has created a pull request for this

[jira] [Commented] (SPARK-40616) Loss of precision using SparkSQL shell on high-precision DECIMAL types

2022-09-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611328#comment-17611328 ] Yuming Wang commented on SPARK-40616: - Please try to set

[jira] [Assigned] (SPARK-40590) Fix `ps.read_parquet` when pandas_metadata is True

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40590: Assignee: (was: Apache Spark) > Fix `ps.read_parquet` when pandas_metadata is True >

[jira] [Assigned] (SPARK-40590) Fix `ps.read_parquet` when pandas_metadata is True

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40590: Assignee: Apache Spark > Fix `ps.read_parquet` when pandas_metadata is True >

[jira] [Commented] (SPARK-40590) Fix `ps.read_parquet` when pandas_metadata is True

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611327#comment-17611327 ] Apache Spark commented on SPARK-40590: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40577) Fix CategoricalIndex.append

2022-09-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40577: Assignee: Haejoon Lee > Fix CategoricalIndex.append > --- > >

[jira] [Resolved] (SPARK-40577) Fix CategoricalIndex.append

2022-09-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40577. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38015

[jira] [Commented] (SPARK-40165) Update test plugins to latest versions

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611322#comment-17611322 ] Apache Spark commented on SPARK-40165: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40589: - Assignee: Haejoon Lee > Fix test for `DataFrame.corr_with` to skip the pandas

[jira] [Resolved] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40589. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38031

[jira] [Assigned] (SPARK-40314) Add inline Scala and Python bindings

2022-09-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40314: - Assignee: Adam Binford > Add inline Scala and Python bindings >

[jira] [Resolved] (SPARK-40314) Add inline Scala and Python bindings

2022-09-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40314. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37770

[jira] [Assigned] (SPARK-40600) Support recursiveFileLookup for partitioned datasource

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40600: Assignee: Apache Spark > Support recursiveFileLookup for partitioned datasource >

[jira] [Commented] (SPARK-40600) Support recursiveFileLookup for partitioned datasource

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611318#comment-17611318 ] Apache Spark commented on SPARK-40600: -- User 'wForget' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40600) Support recursiveFileLookup for partitioned datasource

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40600: Assignee: (was: Apache Spark) > Support recursiveFileLookup for partitioned

[jira] [Commented] (SPARK-40600) Support recursiveFileLookup for partitioned datasource

2022-09-29 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611315#comment-17611315 ] Zhen Wang commented on SPARK-40600: --- There is a related implementation in

[jira] [Resolved] (SPARK-39853) Support stage level schedule for standalone cluster when dynamic allocation is disabled

2022-09-29 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-39853. -- Resolution: Fixed Issue resolved by https://github.com/apache/spark/pull/37268 > Support stage level

[jira] [Assigned] (SPARK-39853) Support stage level schedule for standalone cluster when dynamic allocation is disabled

2022-09-29 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi reassigned SPARK-39853: Assignee: huangtengfei > Support stage level schedule for standalone cluster when dynamic allocation >

[jira] [Commented] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611293#comment-17611293 ] Apache Spark commented on SPARK-40618: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40618: Assignee: (was: Apache Spark) > Bug in MergeScalarSubqueries rule attempting to

[jira] [Assigned] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40618: Assignee: Apache Spark > Bug in MergeScalarSubqueries rule attempting to merge nested

[jira] [Created] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-09-29 Thread Daniel (Jira)
Daniel created SPARK-40618: -- Summary: Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent Key: SPARK-40618 URL: https://issues.apache.org/jira/browse/SPARK-40618 Project: Spark

[jira] [Comment Edited] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611256#comment-17611256 ] Attila Zsolt Piros edited comment on SPARK-34779 at 9/29/22 10:05 PM:

[jira] [Comment Edited] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611256#comment-17611256 ] Attila Zsolt Piros edited comment on SPARK-34779 at 9/29/22 10:05 PM:

[jira] [Commented] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611256#comment-17611256 ] Attila Zsolt Piros commented on SPARK-34779: [~praetp] I have a working theory but an

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611248#comment-17611248 ] phoebe chen commented on SPARK-39725: - [~bjornjorgensen]  Thanks so much for your super fast

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611230#comment-17611230 ] Bjørn Jørgensen commented on SPARK-39725: - Well yes, we do download it..  build spark and log to

[jira] [Updated] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-40617: --- Description: {noformat} 22/09/29 09:46:24 ERROR SparkUncaughtExceptionHandler:

[jira] [Commented] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611217#comment-17611217 ] Attila Zsolt Piros commented on SPARK-34779: [~praetp] I have opened a new Jira and soon PR:

[jira] [Updated] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-40617: --- Description: Spurious failures beacuse of the assert: {noformat} 22/09/29 09:46:24

[jira] [Updated] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-40617: --- Description: Spurious failures regarding the assert: {noformat} 22/09/29 09:46:24

[jira] [Updated] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-40617: --- Description: {noformat} 22/09/29 09:46:24 ERROR SparkUncaughtExceptionHandler:

[jira] [Assigned] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-40617: -- Assignee: Attila Zsolt Piros > Assertion failed in ExecutorMetricsPoller

[jira] [Created] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

2022-09-29 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-40617: -- Summary: Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0" Key: SPARK-40617 URL: https://issues.apache.org/jira/browse/SPARK-40617

[jira] [Resolved] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40613. -- Fix Version/s: 3.4.0 Assignee: Yuming Wang Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40613: - Priority: Minor (was: Major) > Update sbt-protoc to 1.0.6 > -- > >

[jira] [Resolved] (SPARK-40458) Bump Kubernetes Client Version to 6.1.1

2022-09-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40458. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37990

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611184#comment-17611184 ] phoebe chen commented on SPARK-39725: - [~bjornjorgensen]  [~hyukjin.kwon]  As this PR will also

[jira] [Commented] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611181#comment-17611181 ] Attila Zsolt Piros commented on SPARK-34779: [~praetp]

[jira] [Updated] (SPARK-40616) Loss of precision using SparkSQL shell on high-precision DECIMAL types

2022-09-29 Thread xsys (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40616: - Description: h3. Describe the bug We are trying to save {{DECIMAL}} values with high precision in a table

[jira] [Updated] (SPARK-40616) Loss of precision using SparkSQL shell on high-precision DECIMAL types

2022-09-29 Thread xsys (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40616: - Description: h3. Describe the bug We are trying to save {{DECIMAL}} values with high precision in a table

[jira] [Updated] (SPARK-40616) Loss of precision using SparkSQL shell on high-precision DECIMAL types

2022-09-29 Thread xsys (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40616: - Description: h3. Describe the bug We are trying to save {{DECIMAL}} values with high precision in a table

[jira] [Updated] (SPARK-40616) Loss of precision using SparkSQL shell on high-precision DECIMAL types

2022-09-29 Thread xsys (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40616: - Description: h3. Describe the bug We are trying to save {{DECIMAL}} values with high precision in a table

[jira] [Created] (SPARK-40616) Loss of precision using SparkSQL shell on high-precision DECIMAL types

2022-09-29 Thread xsys (Jira)
xsys created SPARK-40616: Summary: Loss of precision using SparkSQL shell on high-precision DECIMAL types Key: SPARK-40616 URL: https://issues.apache.org/jira/browse/SPARK-40616 Project: Spark

[jira] [Updated] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40613: Parent: SPARK-39375 Issue Type: Sub-task (was: Improvement) > Update sbt-protoc to 1.0.6

[jira] [Assigned] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40605: --- Assignee: Yang Jie > Connect module should use log4j2.properties to configure test log

[jira] [Resolved] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40605. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38041

[jira] [Assigned] (SPARK-40615) Check unsupported data type when decorrelating subqueries

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40615: Assignee: Apache Spark > Check unsupported data type when decorrelating subqueries >

[jira] [Assigned] (SPARK-40615) Check unsupported data type when decorrelating subqueries

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40615: Assignee: (was: Apache Spark) > Check unsupported data type when decorrelating

[jira] [Commented] (SPARK-40615) Check unsupported data type when decorrelating subqueries

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611101#comment-17611101 ] Apache Spark commented on SPARK-40615: -- User 'allisonwang-db' has created a pull request for this

[jira] [Updated] (SPARK-40615) Check unsupported data type when decorrelating subqueries

2022-09-29 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-40615: - Description: Currently, we don't check if the join condition after subquery decorrelation is

[jira] [Created] (SPARK-40615) Check unsupported data type when decorrelating subqueries

2022-09-29 Thread Allison Wang (Jira)
Allison Wang created SPARK-40615: Summary: Check unsupported data type when decorrelating subqueries Key: SPARK-40615 URL: https://issues.apache.org/jira/browse/SPARK-40615 Project: Spark

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611052#comment-17611052 ] phoebe chen commented on SPARK-39725: - Thanks [~bjornjorgensen] for the quick response! Good to know 

[jira] [Created] (SPARK-40614) Job aborted due to stage failure: Task 165 in stage 292.0 failed 4 times, most recent failure: Lost task 165.3 in stage 292.0 (TID 122333) (x.x.x.x executor 0): java.lan

2022-09-29 Thread Marzieh (Jira)
Marzieh created SPARK-40614: --- Summary: Job aborted due to stage failure: Task 165 in stage 292.0 failed 4 times, most recent failure: Lost task 165.3 in stage 292.0 (TID 122333) (x.x.x.x executor 0): java.lang.NullPointerException

[jira] [Commented] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611030#comment-17611030 ] Apache Spark commented on SPARK-40613: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611029#comment-17611029 ] Apache Spark commented on SPARK-40613: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40613: Assignee: Apache Spark > Update sbt-protoc to 1.0.6 > -- > >

[jira] [Assigned] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40613: Assignee: (was: Apache Spark) > Update sbt-protoc to 1.0.6 >

[jira] [Updated] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40613: Attachment: screenshot-1.png > Update sbt-protoc to 1.0.6 > -- > >

[jira] [Created] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40613: --- Summary: Update sbt-protoc to 1.0.6 Key: SPARK-40613 URL: https://issues.apache.org/jira/browse/SPARK-40613 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40613) Update sbt-protoc to 1.0.6

2022-09-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40613: Description: !screenshot-1.png! > Update sbt-protoc to 1.0.6 > -- > >

[jira] [Assigned] (SPARK-40612) On Kubernetes for long running app Spark using an invalid principal to renew the delegation token

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40612: Assignee: Apache Spark (was: Attila Zsolt Piros) > On Kubernetes for long running app

[jira] [Commented] (SPARK-40612) On Kubernetes for long running app Spark using an invalid principal to renew the delegation token

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611025#comment-17611025 ] Apache Spark commented on SPARK-40612: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-40612) On Kubernetes for long running app Spark using an invalid principal to renew the delegation token

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40612: Assignee: Attila Zsolt Piros (was: Apache Spark) > On Kubernetes for long running app

[jira] [Created] (SPARK-40612) On Kubernetes for long running app Spark using an invalid principal to renew the delegation token

2022-09-29 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-40612: -- Summary: On Kubernetes for long running app Spark using an invalid principal to renew the delegation token Key: SPARK-40612 URL:

[jira] [Commented] (SPARK-40609) Casts types according to bucket info for Equality expression

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611014#comment-17611014 ] Apache Spark commented on SPARK-40609: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-40609) Casts types according to bucket info for Equality expression

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611013#comment-17611013 ] Apache Spark commented on SPARK-40609: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-40611) Improve the performance for setInterval & getInterval of UnsafeRow

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611011#comment-17611011 ] Apache Spark commented on SPARK-40611: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40609) Casts types according to bucket info for Equality expression

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40609: Assignee: Apache Spark > Casts types according to bucket info for Equality expression >

[jira] [Assigned] (SPARK-40609) Casts types according to bucket info for Equality expression

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40609: Assignee: (was: Apache Spark) > Casts types according to bucket info for Equality

[jira] [Assigned] (SPARK-40611) Improve the performance for setInterval & getInterval of UnsafeRow

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40611: Assignee: Apache Spark > Improve the performance for setInterval & getInterval of

[jira] [Assigned] (SPARK-39146) The singleton Jackson ObjectMapper should be preferred

2022-09-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39146: Assignee: Yang Jie > The singleton Jackson ObjectMapper should be preferred >

[jira] [Resolved] (SPARK-39146) The singleton Jackson ObjectMapper should be preferred

2022-09-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39146. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37999

[jira] [Created] (SPARK-40611) Improve the performance for setInterval & getInterval of UnsafeRow

2022-09-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-40611: -- Summary: Improve the performance for setInterval & getInterval of UnsafeRow Key: SPARK-40611 URL: https://issues.apache.org/jira/browse/SPARK-40611 Project: Spark

[jira] [Updated] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2022-09-29 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] icyjhl updated SPARK-40610: --- Description: When I run a insert overwrite statement, I got error saying:   {code:java} MetaStoreClient

[jira] [Updated] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2022-09-29 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] icyjhl updated SPARK-40610: --- Attachment: spark_sql.sql > Spark fall back to use getPartitions instead of getPartitionsByFilter when >

[jira] [Updated] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2022-09-29 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] icyjhl updated SPARK-40610: --- Attachment: spark_error.log > Spark fall back to use getPartitions instead of getPartitionsByFilter when >

[jira] [Updated] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2022-09-29 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] icyjhl updated SPARK-40610: --- Attachment: sql_in_mysql.sql > Spark fall back to use getPartitions instead of getPartitionsByFilter when

[jira] [Created] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2022-09-29 Thread icyjhl (Jira)
icyjhl created SPARK-40610: -- Summary: Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause Key: SPARK-40610 URL:

[jira] [Commented] (SPARK-34779) ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2022-09-29 Thread Paul Praet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610965#comment-17610965 ] Paul Praet commented on SPARK-34779: We are seeing spurious failures on the assert(): {noformat}

[jira] [Commented] (SPARK-40540) Migrate compilation errors onto error classes

2022-09-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610960#comment-17610960 ] Apache Spark commented on SPARK-40540: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-40536) Make Spark Connect port configurable.

2022-09-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40536. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38006

[jira] [Assigned] (SPARK-40536) Make Spark Connect port configurable.

2022-09-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40536: Assignee: Martin Grund > Make Spark Connect port configurable. >

[jira] [Updated] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39725: Attachment: jetty-io-spark.png > Upgrade jetty-http from 9.4.46.v20220331 to

[jira] [Updated] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39725: Attachment: (was: jetty-io.png) > Upgrade jetty-http from 9.4.46.v20220331 to

[jira] [Comment Edited] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610926#comment-17610926 ] Bjørn Jørgensen edited comment on SPARK-39725 at 9/29/22 10:39 AM: ---

[jira] [Comment Edited] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610926#comment-17610926 ] Bjørn Jørgensen edited comment on SPARK-39725 at 9/29/22 10:38 AM: ---

[jira] [Created] (SPARK-40609) Casts types according to bucket info for Equality expression

2022-09-29 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40609: --- Summary: Casts types according to bucket info for Equality expression Key: SPARK-40609 URL: https://issues.apache.org/jira/browse/SPARK-40609 Project: Spark

  1   2   >