[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317659#comment-17317659 ] Apache Spark commented on SPARK-35002: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35002: Summary: Fix the java.net.BindException when testing with Github Action (was: Try to fix the

[jira] [Assigned] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35002: Assignee: (was: Apache Spark) > Try to fix the java.net.BindException when testing

[jira] [Commented] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317656#comment-17317656 ] Apache Spark commented on SPARK-35002: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35002: Assignee: Apache Spark > Try to fix the java.net.BindException when testing with Github

[jira] [Created] (SPARK-35002) Try to fix the java.net.BindException when testing with Github Action

2021-04-08 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-35002: --- Summary: Try to fix the java.net.BindException when testing with Github Action Key: SPARK-35002 URL: https://issues.apache.org/jira/browse/SPARK-35002 Project: Spark

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34674: Assignee: Apache Spark > Spark app on k8s doesn't terminate without call to

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34674: Assignee: (was: Apache Spark) > Spark app on k8s doesn't terminate without call to

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317648#comment-17317648 ] Dongjoon Hyun commented on SPARK-34674: --- This is reverted due to the Hive Thrift Server UT

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34674: - Assignee: (was: Sergey Kotlov) > Spark app on k8s doesn't terminate without call

[jira] [Reopened] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-34674: --- > Spark app on k8s doesn't terminate without call to sparkContext.stop() method >

[jira] [Updated] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34674: -- Fix Version/s: (was: 3.1.2) (was: 3.2.0) > Spark app on k8s

[jira] [Created] (SPARK-35001) Use ps as the short name instead of pp

2021-04-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-35001: Summary: Use ps as the short name instead of pp Key: SPARK-35001 URL: https://issues.apache.org/jira/browse/SPARK-35001 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34837) Support ANSI SQL intervals by the aggregate function `avg`

2021-04-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317639#comment-17317639 ] jiaan.geng commented on SPARK-34837: I'm doing now. > Support ANSI SQL intervals by the aggregate

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317622#comment-17317622 ] Dongjoon Hyun commented on SPARK-35000: --- Oh, is `KubernetesClusterManager` itself not created in

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317621#comment-17317621 ] Dongjoon Hyun commented on SPARK-35000: --- Thank you for filing a new JIRA and making a PR. BTW,

[jira] [Commented] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

2021-04-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317589#comment-17317589 ] jiaan.geng commented on SPARK-34716: OK. I will take a look. > Support ANSI SQL intervals by the

[jira] [Resolved] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you resolved SPARK-34991. - Resolution: Won't Fix > Mark GlobalLimit outputPartitioning as SinglePartition >

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317566#comment-17317566 ] Apache Spark commented on SPARK-35000: -- User 'KarlManong' has created a pull request for this

[jira] [Assigned] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35000: Assignee: (was: Apache Spark) > Spark App in container will not exit when exception

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317563#comment-17317563 ] KarlManong commented on SPARK-35000: [~dongjoon] please have a look, thanks > Spark App in

[jira] [Assigned] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35000: Assignee: Apache Spark > Spark App in container will not exit when exception happen >

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317564#comment-17317564 ] Apache Spark commented on SPARK-35000: -- User 'KarlManong' has created a pull request for this

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Description: when submitting an app on k8s, someone can using an unauthed account to submit, and

[jira] [Updated] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34991: Description: Accroding to the semantics of `GlobalLimitExec`, the outputPartitioning should

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Attachment: screenshot-1.png > Spark App in container will not exit when exception happen >

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Attachment: 21664.stack > Spark App in container will not exit when exception happen >

[jira] [Created] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
KarlManong created SPARK-35000: -- Summary: Spark App in container will not exit when exception happen Key: SPARK-35000 URL: https://issues.apache.org/jira/browse/SPARK-35000 Project: Spark Issue

[jira] [Closed] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng closed SPARK-34998. Duplicated. > Consolidate PySpark testing utils > - > >

[jira] [Created] (SPARK-34999) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34999: Summary: Consolidate PySpark testing utils Key: SPARK-34999 URL: https://issues.apache.org/jira/browse/SPARK-34999 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-34998. -- Resolution: Duplicate > Consolidate PySpark testing utils > -

[jira] [Created] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34998: Summary: Consolidate PySpark testing utils Key: SPARK-34998 URL: https://issues.apache.org/jira/browse/SPARK-34998 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34674: - Assignee: Sergey Kotlov > Spark app on k8s doesn't terminate without call to

[jira] [Resolved] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34674. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34994. - Fix Version/s: 2.4.8 Resolution: Fixed Issue resolved by pull request 32100

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34994: --- Assignee: L. C. Hsieh > Fix git error when pushing the tag after release script succeeds >

[jira] [Updated] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-08 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-34995: -- Description: There are some more commits remaining after the main codes were ported. - 

[jira] [Created] (SPARK-34997) Make graceful shutdown controllable by property

2021-04-08 Thread Oleg Kuznetsov (Jira)
Oleg Kuznetsov created SPARK-34997: -- Summary: Make graceful shutdown controllable by property Key: SPARK-34997 URL: https://issues.apache.org/jira/browse/SPARK-34997 Project: Spark Issue

[jira] [Created] (SPARK-34996) Port Koalas Series related unit tests into PySpark

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34996: Summary: Port Koalas Series related unit tests into PySpark Key: SPARK-34996 URL: https://issues.apache.org/jira/browse/SPARK-34996 Project: Spark Issue

[jira] [Created] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-34995: - Summary: Port/integrate Koalas remaining codes into PySpark Key: SPARK-34995 URL: https://issues.apache.org/jira/browse/SPARK-34995 Project: Spark Issue

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317436#comment-17317436 ] Shane Knapp commented on SPARK-34738: - no, you're right.  i just noticed that 'minikube' was already

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317426#comment-17317426 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] the operator is IN: {noformat}

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317418#comment-17317418 ] Shane Knapp edited comment on SPARK-34738 at 4/8/21, 6:40 PM: -- {noformat}

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317418#comment-17317418 ] Shane Knapp commented on SPARK-34738: - {noformat} Given path

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34994: Assignee: Apache Spark > Fix git error when pushing the tag after release script

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34994: Assignee: (was: Apache Spark) > Fix git error when pushing the tag after release

[jira] [Commented] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317413#comment-17317413 ] Apache Spark commented on SPARK-34994: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317412#comment-17317412 ] Apache Spark commented on SPARK-34994: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34994: --- Summary: Fix git error when pushing the tag after release script succeeds Key: SPARK-34994 URL: https://issues.apache.org/jira/browse/SPARK-34994 Project: Spark

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317409#comment-17317409 ] Shane Knapp commented on SPARK-34738: - i think it's more than suspicious!  :)

[jira] [Resolved] (SPARK-34973) Cleanup unused fields and methods in vectorized Parquet reader

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34973. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32071

[jira] [Assigned] (SPARK-34973) Cleanup unused fields and methods in vectorized Parquet reader

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34973: --- Assignee: Chao Sun > Cleanup unused fields and methods in vectorized Parquet reader >

[jira] [Assigned] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34905: Assignee: (was: Apache Spark) > Enable ANSI intervals in SQLQueryTestSuite >

[jira] [Commented] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317395#comment-17317395 ] Apache Spark commented on SPARK-34905: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317396#comment-17317396 ] Apache Spark commented on SPARK-34905: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34905: Assignee: Apache Spark > Enable ANSI intervals in SQLQueryTestSuite >

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317391#comment-17317391 ] Attila Zsolt Piros commented on SPARK-34738: >From the log we can see the mount is not ok:

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317381#comment-17317381 ] Attila Zsolt Piros edited comment on SPARK-34738 at 4/8/21, 6:02 PM: -

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317381#comment-17317381 ] Attila Zsolt Piros commented on SPARK-34738: No worries. I have guess. Check

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by

[jira] [Created] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
Lauri Koobas created SPARK-34993: Summary: from_json() acts differently on created and literal strings with backslashes Key: SPARK-34993 URL: https://issues.apache.org/jira/browse/SPARK-34993

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317334#comment-17317334 ] Shane Knapp edited comment on SPARK-34738 at 4/8/21, 4:45 PM: -- done

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317334#comment-17317334 ] Shane Knapp commented on SPARK-34738: - done (attached to the issue) > Upgrade Minikube and

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Attachment: integration-tests.log > Upgrade Minikube and kubernetes cluster version on Jenkins >

[jira] [Resolved] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34984. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32087

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34988: - Fix Version/s: 3.0.3 3.1.2 2.4.8 > Upgrade Jetty for

[jira] [Created] (SPARK-34992) Index Appending when Duplicate Column names

2021-04-08 Thread Hallah Butt (Jira)
Hallah Butt created SPARK-34992: --- Summary: Index Appending when Duplicate Column names Key: SPARK-34992 URL: https://issues.apache.org/jira/browse/SPARK-34992 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317255#comment-17317255 ] Apache Spark commented on SPARK-34884: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Yuming Wang (was: Apache Spark) > Improve dynamic partition pruning

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Apache Spark (was: Yuming Wang) > Improve dynamic partition pruning

[jira] [Commented] (SPARK-34881) New SQL Function: TRY_CAST

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317254#comment-17317254 ] Apache Spark commented on SPARK-34881: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
ulysses you created SPARK-34991: --- Summary: Mark GlobalLimit outputPartitioning as SinglePartition Key: SPARK-34991 URL: https://issues.apache.org/jira/browse/SPARK-34991 Project: Spark Issue

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 2:22 PM: - I have

[jira] [Resolved] (SPARK-34962) Explicit representation of star in MergeIntoTable's Update and Insert action

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34962. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32067

[jira] [Resolved] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33233. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30145

[jira] [Assigned] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33233: --- Assignee: angerszhu > CUBE/ROLLUP can't support UnresolvedOrdinal >

[jira] [Created] (SPARK-34990) Add a test for Parquet Modular Encryption in Spark

2021-04-08 Thread Maya Anderson (Jira)
Maya Anderson created SPARK-34990: - Summary: Add a test for Parquet Modular Encryption in Spark Key: SPARK-34990 URL: https://issues.apache.org/jira/browse/SPARK-34990 Project: Spark Issue

[jira] [Reopened] (SPARK-34946) Block unsupported correlated scalar subquery in Aggregate

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-34946: - > Block unsupported correlated scalar subquery in Aggregate >

[jira] [Resolved] (SPARK-34946) Block unsupported correlated scalar subquery in Aggregate

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34946. - Fix Version/s: 3.2.0 Assignee: Allison Wang Resolution: Fixed > Block

[jira] [Updated] (SPARK-34932) deprecate GROUP BY ... GROUPING SETS (...) and promote GROUP BY GROUPING SETS (...)

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34932: Summary: deprecate GROUP BY ... GROUPING SETS (...) and promote GROUP BY GROUPING SETS (...)

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Assigned] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34989: Assignee: Apache Spark > Improve the performance of mapChildren and withNewChildren

[jira] [Assigned] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34989: Assignee: (was: Apache Spark) > Improve the performance of mapChildren and

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317133#comment-17317133 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317132#comment-17317132 ] Apache Spark commented on SPARK-34989: -- User 'dbaliafroozeh' has created a pull request for this

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317131#comment-17317131 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317130#comment-17317130 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic

[jira] [Created] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
Ali Afroozeh created SPARK-34989: Summary: Improve the performance of mapChildren and withNewChildren methods Key: SPARK-34989 URL: https://issues.apache.org/jira/browse/SPARK-34989 Project: Spark

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 11:50 AM: -- I

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34988: - Fix Version/s: 3.2.0 > Upgrade Jetty for CVE-2021-28165 > > >

  1   2   >