[jira] [Resolved] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37134. -- Fix Version/s: 3.3.0 3.2.1 Assignee: Hyukjin Kwon

[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37134: - Affects Version/s: (was: 1.6.2) 3.2.0 > documentation - unclear

[jira] [Commented] (SPARK-32268) Bloom Filter Join

2021-10-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435782#comment-17435782 ] Yuming Wang commented on SPARK-32268: - [~Penglei Shi] Please add my WeChat: yumwang666. We can

[jira] [Assigned] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37134: Assignee: (was: Apache Spark) > documentation - unclear "Using PySpark Native

[jira] [Commented] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435778#comment-17435778 ] Apache Spark commented on SPARK-37134: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37134: Assignee: Apache Spark > documentation - unclear "Using PySpark Native Features" >

[jira] [Assigned] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37107: Assignee: dch nguyen > Inline type hints for files in python/pyspark/status.py >

[jira] [Resolved] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37107. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34375

[jira] [Resolved] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37144. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34424

[jira] [Assigned] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37144: Assignee: dch nguyen > Inline type hints for python/pyspark/file.py >

[jira] [Assigned] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37042: Assignee: dch nguyen > Inline type hints for kinesis.py and listener.py in

[jira] [Resolved] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37042. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34323

[jira] [Assigned] (SPARK-37139) Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37139: Assignee: dch nguyen > Inline type hints for python/pyspark/taskcontext.py and >

[jira] [Resolved] (SPARK-37139) Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37139. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34414

[jira] [Commented] (SPARK-37157) Inline type hints for python/pyspark/util.py

2021-10-28 Thread Byron Hsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435761#comment-17435761 ] Byron Hsu commented on SPARK-37157: --- i am working on this > Inline type hints for

[jira] [Commented] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py

2021-10-28 Thread Byron Hsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435763#comment-17435763 ] Byron Hsu commented on SPARK-37155: --- i am working on this > Inline type hints for

[jira] [Commented] (SPARK-37156) Inline type hints for python/pyspark/storagelevel.py

2021-10-28 Thread Byron Hsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435762#comment-17435762 ] Byron Hsu commented on SPARK-37156: --- i am working on this > Inline type hints for

[jira] [Commented] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

2021-10-28 Thread Byron Hsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435760#comment-17435760 ] Byron Hsu commented on SPARK-37154: --- i am working on this > Inline type hints for

[jira] [Created] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py

2021-10-28 Thread Byron Hsu (Jira)
Byron Hsu created SPARK-37155: - Summary: Inline type hints for python/pyspark/statcounter.py Key: SPARK-37155 URL: https://issues.apache.org/jira/browse/SPARK-37155 Project: Spark Issue Type:

[jira] [Created] (SPARK-37157) Inline type hints for python/pyspark/util.py

2021-10-28 Thread Byron Hsu (Jira)
Byron Hsu created SPARK-37157: - Summary: Inline type hints for python/pyspark/util.py Key: SPARK-37157 URL: https://issues.apache.org/jira/browse/SPARK-37157 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37156) Inline type hints for python/pyspark/storagelevel.py

2021-10-28 Thread Byron Hsu (Jira)
Byron Hsu created SPARK-37156: - Summary: Inline type hints for python/pyspark/storagelevel.py Key: SPARK-37156 URL: https://issues.apache.org/jira/browse/SPARK-37156 Project: Spark Issue Type:

[jira] [Created] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

2021-10-28 Thread Byron Hsu (Jira)
Byron Hsu created SPARK-37154: - Summary: Inline type hints for python/pyspark/rdd.py Key: SPARK-37154 URL: https://issues.apache.org/jira/browse/SPARK-37154 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37153) Inline type hints for python/pyspark/profiler.py

2021-10-28 Thread Byron Hsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435758#comment-17435758 ] Byron Hsu commented on SPARK-37153: --- i am working on this > Inline type hints for

[jira] [Created] (SPARK-37153) Inline type hints for python/pyspark/profiler.py

2021-10-28 Thread Byron Hsu (Jira)
Byron Hsu created SPARK-37153: - Summary: Inline type hints for python/pyspark/profiler.py Key: SPARK-37153 URL: https://issues.apache.org/jira/browse/SPARK-37153 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37152) Inline type hints for python/pyspark/context.py

2021-10-28 Thread Byron Hsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435757#comment-17435757 ] Byron Hsu commented on SPARK-37152: --- i am working on this > Inline type hints for

[jira] [Created] (SPARK-37152) Inline type hints for python/pyspark/context.py

2021-10-28 Thread Byron Hsu (Jira)
Byron Hsu created SPARK-37152: - Summary: Inline type hints for python/pyspark/context.py Key: SPARK-37152 URL: https://issues.apache.org/jira/browse/SPARK-37152 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32268) Bloom Filter Join

2021-10-28 Thread Penglei Shi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435755#comment-17435755 ] Penglei Shi commented on SPARK-32268: - Hi [~yumwang], I have some problems about bloom filter in my

[jira] [Commented] (SPARK-35437) Use expressions to filter Hive partitions at client side

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435753#comment-17435753 ] Apache Spark commented on SPARK-35437: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2021-10-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-21187: - Attachment: (was: 0--1172099527-254246775-1412485878) > Complete support for remaining

[jira] [Assigned] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37131: Assignee: Apache Spark > Support use IN/EXISTS with subquery in Project/Aggregate >

[jira] [Commented] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435738#comment-17435738 ] Apache Spark commented on SPARK-37131: -- User 'TongWeii' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37131: Assignee: (was: Apache Spark) > Support use IN/EXISTS with subquery in

[jira] [Updated] (SPARK-36525) DS V2 Index Support

2021-10-28 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36525: --- Description: Many data sources support index to improvement query performance. In order to take

[jira] [Commented] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435736#comment-17435736 ] Apache Spark commented on SPARK-37150: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37150: Assignee: (was: Apache Spark) > Migrate DESCRIBE NAMESPACE to use V2 command by

[jira] [Commented] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435734#comment-17435734 ] Apache Spark commented on SPARK-37150: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37150: Assignee: Apache Spark > Migrate DESCRIBE NAMESPACE to use V2 command by default >

[jira] [Assigned] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37151: Assignee: Xingbo Jiang (was: Apache Spark) > Avoid executor state sync attempt fail

[jira] [Commented] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435732#comment-17435732 ] Apache Spark commented on SPARK-37151: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37151: Assignee: Apache Spark (was: Xingbo Jiang) > Avoid executor state sync attempt fail

[jira] [Updated] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

2021-10-28 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-37151: - Description: A worker would retry sending the ExecutorStateChanged message when the previous

[jira] [Created] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

2021-10-28 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-37151: Summary: Avoid executor state sync attempt fail continuously in a short timeframe Key: SPARK-37151 URL: https://issues.apache.org/jira/browse/SPARK-37151 Project:

[jira] [Assigned] (SPARK-34960) Aggregate (Min/Max/Count) push down for ORC

2021-10-28 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34960: --- Assignee: Cheng Su > Aggregate (Min/Max/Count) push down for ORC >

[jira] [Resolved] (SPARK-34960) Aggregate (Min/Max/Count) push down for ORC

2021-10-28 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34960. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34298

[jira] [Resolved] (SPARK-37020) Limit push down in DS V2

2021-10-28 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37020. Assignee: Huaxin Gao Resolution: Fixed > Limit push down in DS V2 >

[jira] [Resolved] (SPARK-36627) Tasks with Java proxy objects fail to deserialize

2021-10-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36627. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33879

[jira] [Assigned] (SPARK-36627) Tasks with Java proxy objects fail to deserialize

2021-10-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36627: Assignee: Samuel Souza > Tasks with Java proxy objects fail to deserialize >

[jira] [Created] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default

2021-10-28 Thread Terry Kim (Jira)
Terry Kim created SPARK-37150: - Summary: Migrate DESCRIBE NAMESPACE to use V2 command by default Key: SPARK-37150 URL: https://issues.apache.org/jira/browse/SPARK-37150 Project: Spark Issue

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

2021-10-28 Thread Arvin Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435637#comment-17435637 ] Arvin Zheng commented on SPARK-32165: - HiĀ [~advancedxy], any updates on this? > SessionState leaks

[jira] [Assigned] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37149: Assignee: (was: Apache Spark) > Improve error messages for arithmetic overflow under

[jira] [Commented] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435608#comment-17435608 ] Apache Spark commented on SPARK-37149: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37149: Assignee: Apache Spark > Improve error messages for arithmetic overflow under ANSI mode

[jira] [Commented] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435607#comment-17435607 ] Apache Spark commented on SPARK-37149: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-37143) Supplement the missing Java 11 benchmark result files

2021-10-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37143: - Assignee: Yang Jie > Supplement the missing Java 11 benchmark result files >

[jira] [Resolved] (SPARK-37143) Supplement the missing Java 11 benchmark result files

2021-10-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37143. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34423

[jira] [Assigned] (SPARK-37141) WorkerSuite cannot run on Mac OS

2021-10-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37141: - Assignee: Yazhi Wang > WorkerSuite cannot run on Mac OS >

[jira] [Resolved] (SPARK-37141) WorkerSuite cannot run on Mac OS

2021-10-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37141. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34420

[jira] [Updated] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37149: - Description: Improve error messages for arithmetic overflow exceptions. We can instruct users

[jira] [Updated] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37149: - Summary: Improve error messages for arithmetic overflow under ANSI mode (was: Improve error

[jira] [Updated] (SPARK-37149) Improve error messages for arithmetic overflow errors under ANSI mode

2021-10-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37149: - Summary: Improve error messages for arithmetic overflow errors under ANSI mode (was: Improve

[jira] [Updated] (SPARK-37149) Improve error messages for arithmetic overflow exception under ANSI mode

2021-10-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-37149: - Summary: Improve error messages for arithmetic overflow exception under ANSI mode (was:

[jira] [Created] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode

2021-10-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-37149: Summary: Improve error messages for arithmetic overflow under ANSI mode Key: SPARK-37149 URL: https://issues.apache.org/jira/browse/SPARK-37149 Project: Spark

[jira] [Created] (SPARK-37148) Improve error messages under ANSI mode

2021-10-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-37148: Summary: Improve error messages under ANSI mode Key: SPARK-37148 URL: https://issues.apache.org/jira/browse/SPARK-37148 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37147) MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[]

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37147: Assignee: Apache Spark > MetricsReporter producing NullPointerException when element >

[jira] [Assigned] (SPARK-37147) MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[]

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37147: Assignee: (was: Apache Spark) > MetricsReporter producing NullPointerException when

[jira] [Commented] (SPARK-37147) MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[]

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435567#comment-17435567 ] Apache Spark commented on SPARK-37147: -- User 'gitplaneta' has created a pull request for this

[jira] [Created] (SPARK-37147) MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[]

2021-10-28 Thread Radoslaw Busz (Jira)
Radoslaw Busz created SPARK-37147: - Summary: MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[] Key: SPARK-37147 URL:

[jira] [Resolved] (SPARK-37118) Add KMeans distanceMeasure param to PythonMLLibAPI

2021-10-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37118. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34394

[jira] [Assigned] (SPARK-37118) Add KMeans distanceMeasure param to PythonMLLibAPI

2021-10-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37118: Assignee: Raimi bin Karim > Add KMeans distanceMeasure param to PythonMLLibAPI >

[jira] [Updated] (SPARK-37118) Add KMeans distanceMeasure param to PythonMLLibAPI

2021-10-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37118: - Fix Version/s: (was: 3.2.1) > Add KMeans distanceMeasure param to PythonMLLibAPI >

[jira] [Updated] (SPARK-37118) Add KMeans distanceMeasure param to PythonMLLibAPI

2021-10-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37118: - Affects Version/s: (was: 3.2.1) 3.2.0 > Add KMeans distanceMeasure

[jira] [Commented] (SPARK-37105) Pass all UTs in `sql/hive` with Java 17

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435399#comment-17435399 ] Apache Spark commented on SPARK-37105: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-37105) Pass all UTs in `sql/hive` with Java 17

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435397#comment-17435397 ] Apache Spark commented on SPARK-37105: -- User 'sarutak' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37136) Remove code about hive build in functions

2021-10-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37136. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34410

[jira] [Assigned] (SPARK-37136) Remove code about hive build in functions

2021-10-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37136: --- Assignee: angerszhu > Remove code about hive build in functions >

[jira] [Resolved] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36928. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34421

[jira] [Assigned] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36928: Assignee: PengLei > Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray >

[jira] [Commented] (SPARK-37146) Inline type hints for python/pyspark/__init__.py

2021-10-28 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435341#comment-17435341 ] dch nguyen commented on SPARK-37146: I am working on this > Inline type hints for

[jira] [Created] (SPARK-37146) Inline type hints for python/pyspark/__init__.py

2021-10-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37146: -- Summary: Inline type hints for python/pyspark/__init__.py Key: SPARK-37146 URL: https://issues.apache.org/jira/browse/SPARK-37146 Project: Spark Issue Type:

[jira] [Created] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf

2021-10-28 Thread wangxin (Jira)
wangxin created SPARK-37145: --- Summary: Improvement for extending pod feature steps with KubernetesConf Key: SPARK-37145 URL: https://issues.apache.org/jira/browse/SPARK-37145 Project: Spark Issue

[jira] [Commented] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435311#comment-17435311 ] Apache Spark commented on SPARK-37144: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37144: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/file.py >

[jira] [Assigned] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37144: Assignee: Apache Spark > Inline type hints for python/pyspark/file.py >

[jira] [Created] (SPARK-37144) Inline type hints for python/pyspark/file.py

2021-10-28 Thread dch nguyen (Jira)
dch nguyen created SPARK-37144: -- Summary: Inline type hints for python/pyspark/file.py Key: SPARK-37144 URL: https://issues.apache.org/jira/browse/SPARK-37144 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37143) Supplement the missing Java 11 benchmark result files

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37143: Assignee: (was: Apache Spark) > Supplement the missing Java 11 benchmark result

[jira] [Assigned] (SPARK-37143) Supplement the missing Java 11 benchmark result files

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37143: Assignee: Apache Spark > Supplement the missing Java 11 benchmark result files >

[jira] [Commented] (SPARK-37143) Supplement the missing Java 11 benchmark result files

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435266#comment-17435266 ] Apache Spark commented on SPARK-37143: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-37143) Supplement the missing Java 11 benchmark result files

2021-10-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-37143: Summary: Supplement the missing Java 11 benchmark result files Key: SPARK-37143 URL: https://issues.apache.org/jira/browse/SPARK-37143 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36928: Assignee: Apache Spark > Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and

[jira] [Commented] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435247#comment-17435247 ] Apache Spark commented on SPARK-36928: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36928: Assignee: (was: Apache Spark) > Handle ANSI intervals in ColumnarRow,

[jira] [Assigned] (SPARK-37141) WorkerSuite cannot run on Mac OS

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37141: Assignee: Apache Spark > WorkerSuite cannot run on Mac OS >

[jira] [Assigned] (SPARK-37141) WorkerSuite cannot run on Mac OS

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37141: Assignee: (was: Apache Spark) > WorkerSuite cannot run on Mac OS >

[jira] [Commented] (SPARK-37141) WorkerSuite cannot run on Mac OS

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435235#comment-17435235 ] Apache Spark commented on SPARK-37141: -- User 'toujours33' has created a pull request for this

[jira] [Commented] (SPARK-37142) Add __all__ to pyspark/pandas/*/__init__.py

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435211#comment-17435211 ] Apache Spark commented on SPARK-37142: -- User 'dchvn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37135) Fix some mirco-benchmarks run failed

2021-10-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37135. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34409

[jira] [Assigned] (SPARK-37129) Supplement all micro benchmark results use to Java 17

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37129: Assignee: (was: Apache Spark) > Supplement all micro benchmark results use to Java

[jira] [Assigned] (SPARK-37129) Supplement all micro benchmark results use to Java 17

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37129: Assignee: Apache Spark > Supplement all micro benchmark results use to Java 17 >

[jira] [Commented] (SPARK-37129) Supplement all micro benchmark results use to Java 17

2021-10-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435200#comment-17435200 ] Apache Spark commented on SPARK-37129: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-37141) WorkerSuite cannot run on Mac OS

2021-10-28 Thread Yazhi Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435199#comment-17435199 ] Yazhi Wang commented on SPARK-37141: I'm working on it > WorkerSuite cannot run on Mac OS >

  1   2   >