[jira] [Assigned] (SPARK-37915) Push down deterministic projection through SQL UNION

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37915: Assignee: (was: Apache Spark) > Push down deterministic projection through SQL UNION

[jira] [Assigned] (SPARK-37915) Push down deterministic projection through SQL UNION

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37915: Assignee: Apache Spark > Push down deterministic projection through SQL UNION >

[jira] [Commented] (SPARK-37915) Push down deterministic projection through SQL UNION

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476558#comment-17476558 ] Apache Spark commented on SPARK-37915: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-37915) Push down deterministic projection through SQL UNION

2022-01-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37915: --- Summary: Push down deterministic projection through SQL UNION Key: SPARK-37915 URL: https://issues.apache.org/jira/browse/SPARK-37915 Project: Spark Issue

[jira] [Commented] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476516#comment-17476516 ] Apache Spark commented on SPARK-37914: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37914: Assignee: (was: Apache Spark) > Make RuntimeReplaceable works for AggregateFunction

[jira] [Assigned] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37914: Assignee: Apache Spark > Make RuntimeReplaceable works for AggregateFunction >

[jira] [Commented] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476515#comment-17476515 ] Apache Spark commented on SPARK-37914: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-01-14 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37914: -- Summary: Make RuntimeReplaceable works for AggregateFunction Key: SPARK-37914 URL: https://issues.apache.org/jira/browse/SPARK-37914 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

2022-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37886: Assignee: Yikun Jiang (was: Apache Spark) > Use ComparisonTestBase to reduce redundant

[jira] [Resolved] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

2022-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37886. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35183

[jira] [Assigned] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

2022-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37886: Assignee: Apache Spark > Use ComparisonTestBase to reduce redundant test code >

[jira] [Assigned] (SPARK-37909) Restore F403 checks

2022-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37909: Assignee: Maciej Szymkiewicz > Restore F403 checks > --- > >

[jira] [Resolved] (SPARK-37909) Restore F403 checks

2022-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37909. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35210

[jira] [Commented] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476477#comment-17476477 ] Dongjoon Hyun commented on SPARK-37910: --- Could you provide more information, [~Silen]? - The

[jira] [Updated] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37910: -- Priority: Major (was: Blocker) > Spark executor self-exiting due to driver disassociated in

[jira] [Updated] (SPARK-37913) Null Pointer Exception when Loading ML Pipeline Model with Custom Transformer

2022-01-14 Thread Alana Young (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alana Young updated SPARK-37913: Description: I am trying to create and persist a ML pipeline model using a custom Spark

[jira] [Created] (SPARK-37913) Null Pointer Exception when Loading ML Pipeline Model with Custom Transformer

2022-01-14 Thread Alana Young (Jira)
Alana Young created SPARK-37913: --- Summary: Null Pointer Exception when Loading ML Pipeline Model with Custom Transformer Key: SPARK-37913 URL: https://issues.apache.org/jira/browse/SPARK-37913 Project:

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

2022-01-14 Thread Denis Krivenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476442#comment-17476442 ] Denis Krivenko commented on SPARK-32165: The issue is still reproducible on Spark 3.2.0

[jira] [Commented] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476437#comment-17476437 ] Apache Spark commented on SPARK-37912: -- User 'parthchandra' has created a pull request for this

[jira] [Assigned] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37912: Assignee: Apache Spark > Add benchmark for delta binary encoding >

[jira] [Assigned] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37912: Assignee: (was: Apache Spark) > Add benchmark for delta binary encoding >

[jira] [Commented] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476436#comment-17476436 ] Apache Spark commented on SPARK-37912: -- User 'parthchandra' has created a pull request for this

[jira] [Updated] (SPARK-37889) Log4j2 MarkerFilter can not filter unnecessary thrift errors

2022-01-14 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37889: Parent: SPARK-37814 Issue Type: Sub-task (was: Bug) > Log4j2 MarkerFilter can not filter

[jira] [Commented] (SPARK-37498) test_reuse_worker_of_parallelize_range is flaky

2022-01-14 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476385#comment-17476385 ] Maciej Szymkiewicz commented on SPARK-37498: ??maybe we should add eventually?? This might

[jira] [Assigned] (SPARK-37902) Update annotations to resolve issues detected with mypy==0.931

2022-01-14 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37902: -- Assignee: Maciej Szymkiewicz > Update annotations to resolve issues detected

[jira] [Resolved] (SPARK-37902) Update annotations to resolve issues detected with mypy==0.931

2022-01-14 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37902. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-14 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-37912: - Summary: Add benchmark for delta binary encoding Key: SPARK-37912 URL: https://issues.apache.org/jira/browse/SPARK-37912 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37911) Unify the output of spark.version and select version()

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37911. --- Fix Version/s: (was: 3.3.0) Resolution: Invalid This is closed as `Invalid`

[jira] [Closed] (SPARK-37911) Unify the output of spark.version and select version()

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-37911. - > Unify the output of spark.version and select version() >

[jira] [Commented] (SPARK-36879) Support Parquet v2 data page encodings for the vectorized path

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476343#comment-17476343 ] Apache Spark commented on SPARK-36879: -- User 'parthchandra' has created a pull request for this

[jira] [Resolved] (SPARK-37429) Inline type hints for python/pyspark/mllib/linalg/__init__.py

2022-01-14 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37429. Fix Version/s: 3.3.0 Assignee: Maciej Szymkiewicz Resolution:

[jira] [Updated] (SPARK-37372) Removing redundant label addition

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37372: -- Issue Type: Improvement (was: Bug) > Removing redundant label addition >

[jira] [Updated] (SPARK-37372) Removing redundant label addition

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37372: -- Priority: Minor (was: Major) > Removing redundant label addition >

[jira] [Updated] (SPARK-37372) Removing redundant label addition

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37372: -- Summary: Removing redundant label addition (was: Remove redundant Pod label editition) >

[jira] [Resolved] (SPARK-37372) Remove redundant Pod label editition

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37372. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34646

[jira] [Assigned] (SPARK-37372) Remove redundant Pod label editition

2022-01-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37372: - Assignee: Yikun Jiang > Remove redundant Pod label editition >

[jira] [Commented] (SPARK-37872) [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.x

2022-01-14 Thread Jin Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476285#comment-17476285 ] Jin Shen commented on SPARK-37872: -- the same for Spark 3+

[jira] [Updated] (SPARK-37872) [SQL] Some classes are move from org.codehaus.janino:janino to org.codehaus.janino:common-compiler after version 3.1.x

2022-01-14 Thread Jin Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Shen updated SPARK-37872: - Affects Version/s: 3.2.0 > [SQL] Some classes are move from org.codehaus.janino:janino to >

[jira] [Commented] (SPARK-18591) Replace hash-based aggregates with sort-based ones if inputs already sorted

2022-01-14 Thread F. H. (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476233#comment-17476233 ] F. H. commented on SPARK-18591: --- I just found the same behavior. Even if I directly put

[jira] [Assigned] (SPARK-37911) Unify the output of spark.version and select version()

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37911: Assignee: (was: Apache Spark) > Unify the output of spark.version and select

[jira] [Assigned] (SPARK-37911) Unify the output of spark.version and select version()

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37911: Assignee: Apache Spark > Unify the output of spark.version and select version() >

[jira] [Commented] (SPARK-37911) Unify the output of spark.version and select version()

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476177#comment-17476177 ] Apache Spark commented on SPARK-37911: -- User 'yikf' has created a pull request for this issue:

[jira] [Created] (SPARK-37911) Unify the output of spark.version and select version()

2022-01-14 Thread yikf (Jira)
yikf created SPARK-37911: Summary: Unify the output of spark.version and select version() Key: SPARK-37911 URL: https://issues.apache.org/jira/browse/SPARK-37911 Project: Spark Issue Type:

[jira] [Created] (SPARK-37910) Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode

2022-01-14 Thread Petri (Jira)
Petri created SPARK-37910: - Summary: Spark executor self-exiting due to driver disassociated in Kubernetes with client deploy-mode Key: SPARK-37910 URL: https://issues.apache.org/jira/browse/SPARK-37910

[jira] [Assigned] (SPARK-37909) Restore F403 checks

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37909: Assignee: Apache Spark > Restore F403 checks > --- > >

[jira] [Commented] (SPARK-37909) Restore F403 checks

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476097#comment-17476097 ] Apache Spark commented on SPARK-37909: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37909) Restore F403 checks

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37909: Assignee: (was: Apache Spark) > Restore F403 checks > --- > >

[jira] [Created] (SPARK-37909) Restore F401 checks

2022-01-14 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-37909: -- Summary: Restore F401 checks Key: SPARK-37909 URL: https://issues.apache.org/jira/browse/SPARK-37909 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37909) Restore F403 checks

2022-01-14 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37909: --- Summary: Restore F403 checks (was: Restore F401 checks) > Restore F403 checks >

[jira] [Commented] (SPARK-37908) Refactoring on pod label test in BasicFeatureStepSuite

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476033#comment-17476033 ] Apache Spark commented on SPARK-37908: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37908) Refactoring on pod label test in BasicFeatureStepSuite

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37908: Assignee: (was: Apache Spark) > Refactoring on pod label test in

[jira] [Assigned] (SPARK-37908) Refactoring on pod label test in BasicFeatureStepSuite

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37908: Assignee: Apache Spark > Refactoring on pod label test in BasicFeatureStepSuite >

[jira] [Commented] (SPARK-37908) Refactoring on pod label test in BasicFeatureStepSuite

2022-01-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476031#comment-17476031 ] Apache Spark commented on SPARK-37908: -- User 'Yikun' has created a pull request for this issue:

[jira] [Created] (SPARK-37908) Refactoring on pod label test in BasicFeatureStepSuite

2022-01-14 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-37908: --- Summary: Refactoring on pod label test in BasicFeatureStepSuite Key: SPARK-37908 URL: https://issues.apache.org/jira/browse/SPARK-37908 Project: Spark Issue