[jira] [Created] (SPARK-37874) Link to Pandas UDF documentation is broken

2022-01-11 Thread Alex Ott (Jira)
Alex Ott created SPARK-37874: Summary: Link to Pandas UDF documentation is broken Key: SPARK-37874 URL: https://issues.apache.org/jira/browse/SPARK-37874 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-37873) SQL Syntax links are broken

2022-01-11 Thread Alex Ott (Jira)
Alex Ott created SPARK-37873: Summary: SQL Syntax links are broken Key: SPARK-37873 URL: https://issues.apache.org/jira/browse/SPARK-37873 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-37258) Upgrade kubernetes-client >= 5.11.0 to support Volcano

2022-01-11 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37258: Summary: Upgrade kubernetes-client >= 5.11.0 to support Volcano (was: Upgrade kubernetes-client

[jira] [Commented] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474255#comment-17474255 ] Apache Spark commented on SPARK-37855: -- User 'ulysses-you' has created a pull request for this

[jira] [Resolved] (SPARK-37731) refactor and cleanup function lookup in Analyzer

2022-01-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37731. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35004

[jira] [Assigned] (SPARK-37731) refactor and cleanup function lookup in Analyzer

2022-01-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37731: --- Assignee: Wenchen Fan > refactor and cleanup function lookup in Analyzer >

[jira] [Resolved] (SPARK-37833) Add `precondition` job for skip the main GitHub Action jobs

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37833. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35174

[jira] [Assigned] (SPARK-37833) Add `precondition` job for skip the main GitHub Action jobs

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37833: - Assignee: Dongjoon Hyun > Add `precondition` job for skip the main GitHub Action jobs

[jira] [Updated] (SPARK-37872) [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.x

2022-01-11 Thread Jin Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Shen updated SPARK-37872: - Description: Here is the code:  

[jira] [Updated] (SPARK-37872) [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.x

2022-01-11 Thread Jin Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Shen updated SPARK-37872: - Summary: [SQL] Some classes are move from org.codehaus.janino:janino to

[jira] [Updated] (SPARK-37872) [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.0

2022-01-11 Thread Jin Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Shen updated SPARK-37872: - Description: Here is the code:  

[jira] [Created] (SPARK-37872) [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.0

2022-01-11 Thread Jin Shen (Jira)
Jin Shen created SPARK-37872: Summary: [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.0 Key: SPARK-37872 URL:

[jira] [Assigned] (SPARK-37863) Add submitTime for Spark Application

2022-01-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37863: Assignee: Apache Spark > Add submitTime for Spark Application >

[jira] [Resolved] (SPARK-37863) Add submitTime for Spark Application

2022-01-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37863. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35162

[jira] [Commented] (SPARK-37833) Add `precondition` job for skip the main GitHub Action jobs

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473231#comment-17473231 ] Apache Spark commented on SPARK-37833: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37833) Add `precondition` job for skip the main GitHub Action jobs

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37833: Assignee: (was: Apache Spark) > Add `precondition` job for skip the main GitHub

[jira] [Assigned] (SPARK-37833) Add `precondition` job for skip the main GitHub Action jobs

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37833: Assignee: Apache Spark > Add `precondition` job for skip the main GitHub Action jobs >

[jira] [Resolved] (SPARK-37869) Update pytest-mypy-plugins to 1.9.3

2022-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37869. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35169

[jira] [Assigned] (SPARK-37869) Update pytest-mypy-plugins to 1.9.3

2022-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37869: Assignee: Maciej Szymkiewicz > Update pytest-mypy-plugins to 1.9.3 >

[jira] [Commented] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

2022-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473228#comment-17473228 ] Hyukjin Kwon commented on SPARK-37857: -- from a cursory look, we should probably fix. Are you

[jira] [Updated] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

2022-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37857: - Priority: Minor (was: Major) > Any depth search not working in get_json_object ($..foo) >

[jira] [Resolved] (SPARK-37861) How to reload udf jar class without restart driver and executor

2022-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37861. -- Resolution: Invalid For questions, please interact with user or dev mailing list first before

[jira] [Resolved] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37871. --- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37871: - Assignee: Dongjoon Hyun > Use python3 instead of python in BaseScriptTransformation

[jira] [Commented] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473205#comment-17473205 ] Apache Spark commented on SPARK-37636: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473204#comment-17473204 ] Apache Spark commented on SPARK-37636: -- User 'imback82' has created a pull request for this issue:

[jira] [Commented] (SPARK-36664) Log time spent waiting for cluster resources

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473184#comment-17473184 ] Apache Spark commented on SPARK-36664: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473174#comment-17473174 ] Apache Spark commented on SPARK-37871: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37871: Assignee: (was: Apache Spark) > Use python3 instead of python in

[jira] [Commented] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473172#comment-17473172 ] Apache Spark commented on SPARK-37871: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37871: Assignee: Apache Spark > Use python3 instead of python in BaseScriptTransformation tests

[jira] [Created] (SPARK-37871) Use python3 instead of python in BaseScriptTransformation tests

2022-01-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37871: - Summary: Use python3 instead of python in BaseScriptTransformation tests Key: SPARK-37871 URL: https://issues.apache.org/jira/browse/SPARK-37871 Project: Spark

[jira] [Updated] (SPARK-37870) Enable Apple Silicon Jenkins CI (Java/Scala/Python/R)

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37870: -- Summary: Enable Apple Silicon Jenkins CI (Java/Scala/Python/R) (was: Enable Apple Silicon

[jira] [Resolved] (SPARK-37870) Enable Apple Silicon Jenkins CI

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37870. --- Fix Version/s: 3.3.0 Resolution: Fixed > Enable Apple Silicon Jenkins CI >

[jira] [Assigned] (SPARK-37870) Enable Apple Silicon Jenkins CI

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37870: - Assignee: Dongjoon Hyun > Enable Apple Silicon Jenkins CI >

[jira] [Created] (SPARK-37870) Enable Apple Silicon Jenkins CI

2022-01-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37870: - Summary: Enable Apple Silicon Jenkins CI Key: SPARK-37870 URL: https://issues.apache.org/jira/browse/SPARK-37870 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473139#comment-17473139 ] Dongjoon Hyun edited comment on SPARK-37866 at 1/11/22, 7:53 PM: -

[jira] [Commented] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473139#comment-17473139 ] Dongjoon Hyun commented on SPARK-37866: --- Although this happens in all Java versions, Java 17 has a

[jira] [Updated] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37866: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Test) > Set file.encoding to UTF-8

[jira] [Assigned] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37866: - Assignee: Dongjoon Hyun > Set file.encoding to UTF-8 for SBT tests >

[jira] [Resolved] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37866. --- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37866: -- Fix Version/s: 3.2.2 (was: 3.2.1) > Set file.encoding to UTF-8 for SBT

[jira] [Commented] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472957#comment-17472957 ] Apache Spark commented on SPARK-37855: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37855: Assignee: (was: Apache Spark) > IllegalStateException when transforming an array

[jira] [Commented] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472954#comment-17472954 ] Apache Spark commented on SPARK-37855: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37855: Assignee: Apache Spark > IllegalStateException when transforming an array inside a

[jira] [Commented] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

2022-01-11 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472938#comment-17472938 ] XiDuo You commented on SPARK-37855: --- The regression seems from SPARK-35636, for the quick work around,

[jira] [Assigned] (SPARK-37869) Update pytest-mypy-plugins to 1.9.3

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37869: Assignee: (was: Apache Spark) > Update pytest-mypy-plugins to 1.9.3 >

[jira] [Assigned] (SPARK-37869) Update pytest-mypy-plugins to 1.9.3

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37869: Assignee: Apache Spark > Update pytest-mypy-plugins to 1.9.3 >

[jira] [Commented] (SPARK-37869) Update pytest-mypy-plugins to 1.9.3

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472862#comment-17472862 ] Apache Spark commented on SPARK-37869: -- User 'zero323' has created a pull request for this issue:

[jira] [Created] (SPARK-37869) Update pytest-mypy-plugins to 1.9.3

2022-01-11 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-37869: -- Summary: Update pytest-mypy-plugins to 1.9.3 Key: SPARK-37869 URL: https://issues.apache.org/jira/browse/SPARK-37869 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472833#comment-17472833 ] melin commented on SPARK-37840: --- If the JAR file update time changes, create a new classloader >

[jira] [Assigned] (SPARK-37256) Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix compilation warnings

2022-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37256: Assignee: Yang Jie > Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix

[jira] [Resolved] (SPARK-37256) Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix compilation warnings

2022-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37256. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34532

[jira] [Resolved] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37636. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35113

[jira] [Assigned] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default

2022-01-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37636: --- Assignee: Terry Kim > Migrate CREATE NAMESPACE to use v2 command by default >

[jira] [Commented] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472738#comment-17472738 ] Apache Spark commented on SPARK-37865: -- User 'chasingegg' has created a pull request for this

[jira] [Assigned] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37865: Assignee: (was: Apache Spark) > Spark should not dedup the groupingExpressions when

[jira] [Assigned] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37865: Assignee: Apache Spark > Spark should not dedup the groupingExpressions when the first

[jira] [Commented] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472736#comment-17472736 ] Apache Spark commented on SPARK-37865: -- User 'chasingegg' has created a pull request for this

[jira] [Commented] (SPARK-37868) Skip equal check in LocIndexer._select_cols_by_iterable if eager_check disable

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472722#comment-17472722 ] Apache Spark commented on SPARK-37868: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37868) Skip equal check in LocIndexer._select_cols_by_iterable if eager_check disable

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37868: Assignee: (was: Apache Spark) > Skip equal check in

[jira] [Commented] (SPARK-37868) Skip equal check in LocIndexer._select_cols_by_iterable if eager_check disable

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472721#comment-17472721 ] Apache Spark commented on SPARK-37868: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37868) Skip equal check in LocIndexer._select_cols_by_iterable if eager_check disable

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37868: Assignee: Apache Spark > Skip equal check in LocIndexer._select_cols_by_iterable if

[jira] [Created] (SPARK-37868) Skip equal check in LocIndexer._select_cols_by_iterable if eager_check disable

2022-01-11 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-37868: --- Summary: Skip equal check in LocIndexer._select_cols_by_iterable if eager_check disable Key: SPARK-37868 URL: https://issues.apache.org/jira/browse/SPARK-37868

[jira] [Comment Edited] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread Jinpeng Chi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472699#comment-17472699 ] Jinpeng Chi edited comment on SPARK-37840 at 1/11/22, 12:37 PM: Yes, but

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread Jinpeng Chi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472699#comment-17472699 ] Jinpeng Chi commented on SPARK-37840: - Yes, but url classloder does not support unload >

[jira] [Assigned] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37867: Assignee: Apache Spark > Compile aggregate functions of build-in JDBC dialect >

[jira] [Assigned] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37867: Assignee: (was: Apache Spark) > Compile aggregate functions of build-in JDBC dialect

[jira] [Commented] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472669#comment-17472669 ] Apache Spark commented on SPARK-37867: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

2022-01-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37867: -- Summary: Compile aggregate functions of build-in JDBC dialect Key: SPARK-37867 URL: https://issues.apache.org/jira/browse/SPARK-37867 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472635#comment-17472635 ] Apache Spark commented on SPARK-37866: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472633#comment-17472633 ] Apache Spark commented on SPARK-37866: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37866: Assignee: Apache Spark > Set file.encoding to UTF-8 for SBT tests >

[jira] [Assigned] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37866: Assignee: (was: Apache Spark) > Set file.encoding to UTF-8 for SBT tests >

[jira] [Updated] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests

2022-01-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37866: -- Summary: Set file.encoding to UTF-8 for SBT tests (was: Set file.encoding to UTF-8 for

[jira] [Created] (SPARK-37866) Set file.encoding to UTF-8 for testing

2022-01-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37866: - Summary: Set file.encoding to UTF-8 for testing Key: SPARK-37866 URL: https://issues.apache.org/jira/browse/SPARK-37866 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-37795) Add a scalastyle rule to ban `org.apache.log4j`

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472609#comment-17472609 ] Apache Spark commented on SPARK-37795: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-01-11 Thread Chao Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Gao updated SPARK-37865: - Description: When the first child of Union has duplicate columns like select a, a from t1 union select

[jira] [Created] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-01-11 Thread Chao Gao (Jira)
Chao Gao created SPARK-37865: Summary: Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns Key: SPARK-37865 URL: https://issues.apache.org/jira/browse/SPARK-37865

[jira] [Assigned] (SPARK-37841) BasicWriteTaskStatsTracker should not try get status for a skipped file

2022-01-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37841: Assignee: Kent Yao > BasicWriteTaskStatsTracker should not try get status for a skipped file >

[jira] [Resolved] (SPARK-37841) BasicWriteTaskStatsTracker should not try get status for a skipped file

2022-01-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37841. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35132

[jira] [Commented] (SPARK-37864) Support Parquet v2 data page RLE encoding (for Boolean Values) for the vectorized path

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472563#comment-17472563 ] Apache Spark commented on SPARK-37864: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37864) Support Parquet v2 data page RLE encoding (for Boolean Values) for the vectorized path

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37864: Assignee: (was: Apache Spark) > Support Parquet v2 data page RLE encoding (for

[jira] [Assigned] (SPARK-37864) Support Parquet v2 data page RLE encoding (for Boolean Values) for the vectorized path

2022-01-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37864: Assignee: Apache Spark > Support Parquet v2 data page RLE encoding (for Boolean Values)

[jira] [Created] (SPARK-37864) Support Parquet v2 data page RLE encoding (for Boolean Values) for the vectorized path

2022-01-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-37864: Summary: Support Parquet v2 data page RLE encoding (for Boolean Values) for the vectorized path Key: SPARK-37864 URL: https://issues.apache.org/jira/browse/SPARK-37864

[jira] [Comment Edited] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472537#comment-17472537 ] Rakesh Raushan edited comment on SPARK-37840 at 1/11/22, 8:08 AM: --

[jira] [Updated] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

2022-01-11 Thread Venk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venk updated SPARK-37857: - Description: The following example should return a value _abc_ but instead returns null {code:java}

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

2022-01-11 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472537#comment-17472537 ] Rakesh Raushan commented on SPARK-37840: The problem is with `jarClassLoader`. We need to update

[jira] [Updated] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

2022-01-11 Thread Venk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venk updated SPARK-37857: - Description: The following example should return a value _abc_ but instead returns null {code:java}

[jira] [Updated] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

2022-01-11 Thread Venk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venk updated SPARK-37857: - Description: The following example should return a value _abc_ but instead returns null I checked the [spark

[jira] [Updated] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

2022-01-11 Thread Venk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venk updated SPARK-37857: - Description: The following example should return a value _abc_ but instead returns null {code:java}