[jira] [Resolved] (SPARK-34886) Port/integrate Koalas DataFrame unit test into PySpark

2021-04-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34886. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32083 [https://gi

[jira] [Assigned] (SPARK-34886) Port/integrate Koalas DataFrame unit test into PySpark

2021-04-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34886: Assignee: Xinrong Meng > Port/integrate Koalas DataFrame unit test into PySpark > ---

[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317700#comment-17317700 ] Apache Spark commented on SPARK-35002: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35002. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32096 [https://

[jira] [Assigned] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35002: - Assignee: Yuming Wang > Fix the java.net.BindException when testing with Github Action

[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317659#comment-17317659 ] Apache Spark commented on SPARK-35002: -- User 'wangyum' has created a pull request f

[jira] [Updated] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35002: Summary: Fix the java.net.BindException when testing with Github Action (was: Try to fix the java

[jira] [Assigned] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35002: Assignee: (was: Apache Spark) > Try to fix the java.net.BindException when testing wi

[jira] [Commented] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317656#comment-17317656 ] Apache Spark commented on SPARK-35002: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35002: Assignee: Apache Spark > Try to fix the java.net.BindException when testing with Github A

[jira] [Created] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-35002: --- Summary: Try to fix the java.net.BindException when testing with Github Action Key: SPARK-35002 URL: https://issues.apache.org/jira/browse/SPARK-35002 Project: Spark

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34674: Assignee: Apache Spark > Spark app on k8s doesn't terminate without call to sparkContext.

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34674: Assignee: (was: Apache Spark) > Spark app on k8s doesn't terminate without call to sp

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317648#comment-17317648 ] Dongjoon Hyun commented on SPARK-34674: --- This is reverted due to the Hive Thrift S

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34674: - Assignee: (was: Sergey Kotlov) > Spark app on k8s doesn't terminate without call to

[jira] [Reopened] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-34674: --- > Spark app on k8s doesn't terminate without call to sparkContext.stop() method > --

[jira] [Updated] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34674: -- Fix Version/s: (was: 3.1.2) (was: 3.2.0) > Spark app on k8s doesn't

[jira] [Created] (SPARK-35001) Use ps as the short name instead of pp

2021-04-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-35001: Summary: Use ps as the short name instead of pp Key: SPARK-35001 URL: https://issues.apache.org/jira/browse/SPARK-35001 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34837) Support ANSI SQL intervals by the aggregate function `avg`

2021-04-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317639#comment-17317639 ] jiaan.geng commented on SPARK-34837: I'm doing now. > Support ANSI SQL intervals by

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317622#comment-17317622 ] Dongjoon Hyun commented on SPARK-35000: --- Oh, is `KubernetesClusterManager` itself

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317621#comment-17317621 ] Dongjoon Hyun commented on SPARK-35000: --- Thank you for filing a new JIRA and makin

[jira] [Commented] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

2021-04-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317589#comment-17317589 ] jiaan.geng commented on SPARK-34716: OK. I will take a look. > Support ANSI SQL int

[jira] [Resolved] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you resolved SPARK-34991. - Resolution: Won't Fix > Mark GlobalLimit outputPartitioning as SinglePartition > ---

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317566#comment-17317566 ] Apache Spark commented on SPARK-35000: -- User 'KarlManong' has created a pull reques

[jira] [Assigned] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35000: Assignee: (was: Apache Spark) > Spark App in container will not exit when exception h

[jira] [Assigned] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35000: Assignee: Apache Spark > Spark App in container will not exit when exception happen > ---

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317563#comment-17317563 ] KarlManong commented on SPARK-35000: [~dongjoon] please have a look, thanks > Spark

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317564#comment-17317564 ] Apache Spark commented on SPARK-35000: -- User 'KarlManong' has created a pull reques

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Description: when submitting an app on k8s, someone can using an unauthed account to submit, and ex

[jira] [Updated] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34991: Description: Accroding to the semantics of `GlobalLimitExec`, the outputPartitioning should alway

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Attachment: screenshot-1.png > Spark App in container will not exit when exception happen >

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Attachment: 21664.stack > Spark App in container will not exit when exception happen > -

[jira] [Created] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
KarlManong created SPARK-35000: -- Summary: Spark App in container will not exit when exception happen Key: SPARK-35000 URL: https://issues.apache.org/jira/browse/SPARK-35000 Project: Spark Issue

[jira] [Closed] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng closed SPARK-34998. Duplicated. > Consolidate PySpark testing utils > - > >

[jira] [Created] (SPARK-34999) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34999: Summary: Consolidate PySpark testing utils Key: SPARK-34999 URL: https://issues.apache.org/jira/browse/SPARK-34999 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-34998. -- Resolution: Duplicate > Consolidate PySpark testing utils > -

[jira] [Created] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34998: Summary: Consolidate PySpark testing utils Key: SPARK-34998 URL: https://issues.apache.org/jira/browse/SPARK-34998 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34674: - Assignee: Sergey Kotlov > Spark app on k8s doesn't terminate without call to sparkConte

[jira] [Resolved] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34674. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pul

[jira] [Resolved] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34994. - Fix Version/s: 2.4.8 Resolution: Fixed Issue resolved by pull request 32100 [https://gith

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34994: --- Assignee: L. C. Hsieh > Fix git error when pushing the tag after release script succeeds >

[jira] [Updated] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-08 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-34995: -- Description: There are some more commits remaining after the main codes were ported. -  [http

[jira] [Created] (SPARK-34997) Make graceful shutdown controllable by property

2021-04-08 Thread Oleg Kuznetsov (Jira)
Oleg Kuznetsov created SPARK-34997: -- Summary: Make graceful shutdown controllable by property Key: SPARK-34997 URL: https://issues.apache.org/jira/browse/SPARK-34997 Project: Spark Issue Typ

[jira] [Created] (SPARK-34996) Port Koalas Series related unit tests into PySpark

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34996: Summary: Port Koalas Series related unit tests into PySpark Key: SPARK-34996 URL: https://issues.apache.org/jira/browse/SPARK-34996 Project: Spark Issue Type

[jira] [Created] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-34995: - Summary: Port/integrate Koalas remaining codes into PySpark Key: SPARK-34995 URL: https://issues.apache.org/jira/browse/SPARK-34995 Project: Spark Issue Ty

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317436#comment-17317436 ] Shane Knapp commented on SPARK-34738: - no, you're right.  i just noticed that 'minik

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317426#comment-17317426 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] the operator is I

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317418#comment-17317418 ] Shane Knapp edited comment on SPARK-34738 at 4/8/21, 6:40 PM:

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317418#comment-17317418 ] Shane Knapp commented on SPARK-34738: - {noformat} Given path (/opt/spark/pv-tests/tm

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34994: Assignee: Apache Spark > Fix git error when pushing the tag after release script succeeds

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34994: Assignee: (was: Apache Spark) > Fix git error when pushing the tag after release scri

[jira] [Commented] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317413#comment-17317413 ] Apache Spark commented on SPARK-34994: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317412#comment-17317412 ] Apache Spark commented on SPARK-34994: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34994: --- Summary: Fix git error when pushing the tag after release script succeeds Key: SPARK-34994 URL: https://issues.apache.org/jira/browse/SPARK-34994 Project: Spark

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317409#comment-17317409 ] Shane Knapp commented on SPARK-34738: - i think it's more than suspicious!  :) https

[jira] [Resolved] (SPARK-34973) Cleanup unused fields and methods in vectorized Parquet reader

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34973. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32071 [https://gith

[jira] [Assigned] (SPARK-34973) Cleanup unused fields and methods in vectorized Parquet reader

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34973: --- Assignee: Chao Sun > Cleanup unused fields and methods in vectorized Parquet reader > -

[jira] [Assigned] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34905: Assignee: (was: Apache Spark) > Enable ANSI intervals in SQLQueryTestSuite >

[jira] [Commented] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317395#comment-17317395 ] Apache Spark commented on SPARK-34905: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317396#comment-17317396 ] Apache Spark commented on SPARK-34905: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34905: Assignee: Apache Spark > Enable ANSI intervals in SQLQueryTestSuite > ---

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317391#comment-17317391 ] Attila Zsolt Piros commented on SPARK-34738: >From the log we can see the mo

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317381#comment-17317381 ] Attila Zsolt Piros edited comment on SPARK-34738 at 4/8/21, 6:02 PM: -

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317381#comment-17317381 ] Attila Zsolt Piros commented on SPARK-34738: No worries. I have guess. Che

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by `fro

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by `fro

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by `fro

[jira] [Created] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
Lauri Koobas created SPARK-34993: Summary: from_json() acts differently on created and literal strings with backslashes Key: SPARK-34993 URL: https://issues.apache.org/jira/browse/SPARK-34993 Project:

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317334#comment-17317334 ] Shane Knapp edited comment on SPARK-34738 at 4/8/21, 4:45 PM:

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317334#comment-17317334 ] Shane Knapp commented on SPARK-34738: - done (attached to the issue) > Upgrade Minik

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Attachment: integration-tests.log > Upgrade Minikube and kubernetes cluster version on Jenkins > -

[jira] [Resolved] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34984. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32087 [https://gith

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34988: - Fix Version/s: 3.0.3 3.1.2 2.4.8 > Upgrade Jetty for CVE-2

[jira] [Created] (SPARK-34992) Index Appending when Duplicate Column names

2021-04-08 Thread Hallah Butt (Jira)
Hallah Butt created SPARK-34992: --- Summary: Index Appending when Duplicate Column names Key: SPARK-34992 URL: https://issues.apache.org/jira/browse/SPARK-34992 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317255#comment-17317255 ] Apache Spark commented on SPARK-34884: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Yuming Wang (was: Apache Spark) > Improve dynamic partition pruning evaluation

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Apache Spark (was: Yuming Wang) > Improve dynamic partition pruning evaluation

[jira] [Commented] (SPARK-34881) New SQL Function: TRY_CAST

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317254#comment-17317254 ] Apache Spark commented on SPARK-34881: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
ulysses you created SPARK-34991: --- Summary: Mark GlobalLimit outputPartitioning as SinglePartition Key: SPARK-34991 URL: https://issues.apache.org/jira/browse/SPARK-34991 Project: Spark Issue Ty

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 2:22 PM: -

[jira] [Resolved] (SPARK-34962) Explicit representation of star in MergeIntoTable's Update and Insert action

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34962. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32067 [https://gith

[jira] [Resolved] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33233. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30145 [https://gith

[jira] [Assigned] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33233: --- Assignee: angerszhu > CUBE/ROLLUP can't support UnresolvedOrdinal > ---

[jira] [Created] (SPARK-34990) Add a test for Parquet Modular Encryption in Spark

2021-04-08 Thread Maya Anderson (Jira)
Maya Anderson created SPARK-34990: - Summary: Add a test for Parquet Modular Encryption in Spark Key: SPARK-34990 URL: https://issues.apache.org/jira/browse/SPARK-34990 Project: Spark Issue Ty

[jira] [Reopened] (SPARK-34946) Block unsupported correlated scalar subquery in Aggregate

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-34946: - > Block unsupported correlated scalar subquery in Aggregate > --

[jira] [Resolved] (SPARK-34946) Block unsupported correlated scalar subquery in Aggregate

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34946. - Fix Version/s: 3.2.0 Assignee: Allison Wang Resolution: Fixed > Block unsupporte

[jira] [Updated] (SPARK-34932) deprecate GROUP BY ... GROUPING SETS (...) and promote GROUP BY GROUPING SETS (...)

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34932: Summary: deprecate GROUP BY ... GROUPING SETS (...) and promote GROUP BY GROUPING SETS (...) (was

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Assigned] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34989: Assignee: Apache Spark > Improve the performance of mapChildren and withNewChildren metho

[jira] [Assigned] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34989: Assignee: (was: Apache Spark) > Improve the performance of mapChildren and withNewChi

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317133#comment-17317133 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317132#comment-17317132 ] Apache Spark commented on SPARK-34989: -- User 'dbaliafroozeh' has created a pull req

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317131#comment-17317131 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317130#comment-17317130 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

  1   2   >