[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC's char type

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Description: When I try the following sample SQL on  the TPCDS data, the filter operator returns an empty

[jira] [Created] (SPARK-37057) Fix wrong DocSearch facet filter in release-tag.sh

2021-10-18 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-37057: -- Summary: Fix wrong DocSearch facet filter in release-tag.sh Key: SPARK-37057 URL: https://issues.apache.org/jira/browse/SPARK-37057 Project: Spark Issue

[jira] [Assigned] (SPARK-37017) Reduce the scope of synchronized to prevent deadlock.

2021-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37017: --- Assignee: Zhixiong Chen > Reduce the scope of synchronized to prevent deadlock. > -

[jira] [Resolved] (SPARK-37017) Reduce the scope of synchronized to prevent deadlock.

2021-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37017. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34292 [https://gith

[jira] [Assigned] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37052: --- Assignee: angerszhu > Fix spark-3.2 can use --verbose with spark-shell > --

[jira] [Resolved] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37052. - Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by pull re

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC's char type

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Summary: The filter operator gets wrong results in ORC's char type (was: The filter operator gets wrong r

[jira] [Commented] (SPARK-37056) Fix unused code in test about history server & MetricsSystem

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430334#comment-17430334 ] Apache Spark commented on SPARK-37056: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37056) Fix unused code in test about history server & MetricsSystem

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37056: Assignee: (was: Apache Spark) > Fix unused code in test about history server & Metric

[jira] [Commented] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430333#comment-17430333 ] Apache Spark commented on SPARK-37042: -- User 'dchvn' has created a pull request for

[jira] [Assigned] (SPARK-37056) Fix unused code in test about history server & MetricsSystem

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37056: Assignee: Apache Spark > Fix unused code in test about history server & MetricsSystem > -

[jira] [Assigned] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37042: Assignee: (was: Apache Spark) > Inline type hints for kinesis.py and listener.py in p

[jira] [Commented] (SPARK-37056) Fix unused code in test about history server & MetricsSystem

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430332#comment-17430332 ] Apache Spark commented on SPARK-37056: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37053) Add metrics system for History server

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37053: Assignee: (was: Apache Spark) > Add metrics system for History server > -

[jira] [Assigned] (SPARK-37042) Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37042: Assignee: Apache Spark > Inline type hints for kinesis.py and listener.py in python/pyspa

[jira] [Commented] (SPARK-37053) Add metrics system for History server

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430331#comment-17430331 ] Apache Spark commented on SPARK-37053: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37053) Add metrics system for History server

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37053: Assignee: Apache Spark > Add metrics system for History server >

[jira] [Commented] (SPARK-37032) Remove unuseable link in spark-3.2.0's doc

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430330#comment-17430330 ] Apache Spark commented on SPARK-37032: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37015: Assignee: Apache Spark > Inline type hints for python/pyspark/streaming/dstream.py >

[jira] [Commented] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430329#comment-17430329 ] Apache Spark commented on SPARK-37015: -- User 'dchvn' has created a pull request for

[jira] [Assigned] (SPARK-37015) Inline type hints for python/pyspark/streaming/dstream.py

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37015: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/streaming/dstrea

[jira] [Commented] (SPARK-36913) Implement createIndex and IndexExists in JDBC (MySQL dialect)

2021-10-18 Thread Reynold Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430324#comment-17430324 ] Reynold Xin commented on SPARK-36913: - I'm actually a bit worried about adding stuff

[jira] [Created] (SPARK-37056) Fix unused code in test about history server & MetricsSystem

2021-10-18 Thread angerszhu (Jira)
angerszhu created SPARK-37056: - Summary: Fix unused code in test about history server & MetricsSystem Key: SPARK-37056 URL: https://issues.apache.org/jira/browse/SPARK-37056 Project: Spark Issue

[jira] [Created] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

2021-10-18 Thread dch nguyen (Jira)
dch nguyen created SPARK-37055: -- Summary: Apply 'compute.eager_check' across all the codebase Key: SPARK-37055 URL: https://issues.apache.org/jira/browse/SPARK-37055 Project: Spark Issue Type: U

[jira] [Created] (SPARK-37054) Porting "pandas API on Spark: Internals" to PySpark docs.

2021-10-18 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-37054: --- Summary: Porting "pandas API on Spark: Internals" to PySpark docs. Key: SPARK-37054 URL: https://issues.apache.org/jira/browse/SPARK-37054 Project: Spark Issue

[jira] [Commented] (SPARK-37054) Porting "pandas API on Spark: Internals" to PySpark docs.

2021-10-18 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430314#comment-17430314 ] Haejoon Lee commented on SPARK-37054: - I'm working on this > Porting "pandas API on

[jira] [Commented] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

2021-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430304#comment-17430304 ] Hyukjin Kwon commented on SPARK-37044: -- Agree! > Add Row to __all__ in pyspark.sql

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2021-10-18 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430303#comment-17430303 ] koert kuipers commented on SPARK-36681: --- hadoop Jira issue: https://issues.apache.

[jira] [Created] (SPARK-37053) Add metrics system for History server

2021-10-18 Thread angerszhu (Jira)
angerszhu created SPARK-37053: - Summary: Add metrics system for History server Key: SPARK-37053 URL: https://issues.apache.org/jira/browse/SPARK-37053 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430300#comment-17430300 ] Apache Spark commented on SPARK-37052: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430299#comment-17430299 ] Apache Spark commented on SPARK-37052: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37052: Assignee: (was: Apache Spark) > Fix spark-3.2 can use --verbose with spark-shell > --

[jira] [Assigned] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37052: Assignee: Apache Spark > Fix spark-3.2 can use --verbose with spark-shell > -

[jira] [Created] (SPARK-37052) Fix spark-3.2 can use --verbose with spark-shell

2021-10-18 Thread angerszhu (Jira)
angerszhu created SPARK-37052: - Summary: Fix spark-3.2 can use --verbose with spark-shell Key: SPARK-37052 URL: https://issues.apache.org/jira/browse/SPARK-37052 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC char/varchar types

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Description: When I try the following sample SQL on  the TPCDS data, the filter operator returns an empty

[jira] [Commented] (SPARK-37051) The filter operator gets wrong results in ORC char/varchar types

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430297#comment-17430297 ] frankli commented on SPARK-37051: - [~dongjoon] Can I trouble you to take a look. Thanks

[jira] [Assigned] (SPARK-37033) Inline type hints for python/pyspark/resource/requests.py

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37033: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/resource/request

[jira] [Assigned] (SPARK-37033) Inline type hints for python/pyspark/resource/requests.py

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37033: Assignee: Apache Spark > Inline type hints for python/pyspark/resource/requests.py >

[jira] [Commented] (SPARK-37033) Inline type hints for python/pyspark/resource/requests.py

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430296#comment-17430296 ] Apache Spark commented on SPARK-37033: -- User 'dchvn' has created a pull request for

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC char/varchar types

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Description: When I try the following sample SQL on  the TPCDS data, the filter operator returns an empty

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC char/varchar types

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Description: When I try the following sample SQL on  the TPCDS data, the filter operator returns an empty

[jira] [Updated] (SPARK-37051) The filter operator gets wrong results in ORC char/varchar types

2021-10-18 Thread frankli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frankli updated SPARK-37051: Description: When I try the following sample SQL on  the TPCDS data, the filter operator returns an empty

[jira] [Created] (SPARK-37051) The filter operator gets wrong results in ORC char/varchar types

2021-10-18 Thread frankli (Jira)
frankli created SPARK-37051: --- Summary: The filter operator gets wrong results in ORC char/varchar types Key: SPARK-37051 URL: https://issues.apache.org/jira/browse/SPARK-37051 Project: Spark Issue

[jira] [Resolved] (SPARK-36834) Namespace log lines in External Shuffle Service

2021-10-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36834. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 340

[jira] [Assigned] (SPARK-36834) Namespace log lines in External Shuffle Service

2021-10-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36834: --- Assignee: Thejdeep Gudivada > Namespace log lines in External Shuffle Servi

[jira] [Commented] (SPARK-18621) PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430284#comment-17430284 ] Apache Spark commented on SPARK-18621: -- User 'crflynn' has created a pull request f

[jira] [Assigned] (SPARK-36834) Namespace log lines in External Shuffle Service

2021-10-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36834: --- Assignee: (was: Thejdeep Gudivada) > Namespace log lines in External Sh

[jira] [Assigned] (SPARK-36834) Namespace log lines in External Shuffle Service

2021-10-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36834: --- Assignee: Thejdeep Gudivada > Namespace log lines in External Shuffle Servi

[jira] [Assigned] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32161: Assignee: pralabhkumar > Hide JVM traceback for SparkUpgradeException > -

[jira] [Resolved] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32161. -- Fix Version/s: 3.2.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/34

[jira] [Assigned] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37049: Assignee: Apache Spark > executorIdleTimeout is not working for pending pods on K8s > ---

[jira] [Commented] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430257#comment-17430257 ] Apache Spark commented on SPARK-37049: -- User 'yangwwei' has created a pull request

[jira] [Assigned] (SPARK-37048) Clean up inlining type hints under SQL module

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37048: Assignee: Apache Spark > Clean up inlining type hints under SQL module >

[jira] [Commented] (SPARK-37048) Clean up inlining type hints under SQL module

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430255#comment-17430255 ] Apache Spark commented on SPARK-37048: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-37048) Clean up inlining type hints under SQL module

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37048: Assignee: (was: Apache Spark) > Clean up inlining type hints under SQL module > -

[jira] [Commented] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430256#comment-17430256 ] Apache Spark commented on SPARK-37049: -- User 'yangwwei' has created a pull request

[jira] [Assigned] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37049: Assignee: (was: Apache Spark) > executorIdleTimeout is not working for pending pods o

[jira] [Commented] (SPARK-37050) Update conda installation instructions

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430254#comment-17430254 ] Apache Spark commented on SPARK-37050: -- User 'h-vetinari' has created a pull reques

[jira] [Assigned] (SPARK-37050) Update conda installation instructions

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37050: Assignee: Apache Spark > Update conda installation instructions > ---

[jira] [Assigned] (SPARK-37050) Update conda installation instructions

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37050: Assignee: (was: Apache Spark) > Update conda installation instructions >

[jira] [Created] (SPARK-37050) Update conda installation instructions

2021-10-18 Thread H. Vetinari (Jira)
H. Vetinari created SPARK-37050: --- Summary: Update conda installation instructions Key: SPARK-37050 URL: https://issues.apache.org/jira/browse/SPARK-37050 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-37049) executorIdleTimeout is not working for pending pods on K8s

2021-10-18 Thread Weiwei Yang (Jira)
Weiwei Yang created SPARK-37049: --- Summary: executorIdleTimeout is not working for pending pods on K8s Key: SPARK-37049 URL: https://issues.apache.org/jira/browse/SPARK-37049 Project: Spark Issu

[jira] [Resolved] (SPARK-36945) Inline type hints for python/pyspark/sql/udf.py

2021-10-18 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36945. --- Fix Version/s: 3.3.0 Assignee: dch nguyen Resolution: Fixed Issue resolved b

[jira] [Commented] (SPARK-37048) Clean up inlining type hints under SQL module

2021-10-18 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430245#comment-17430245 ] Takuya Ueshin commented on SPARK-37048: --- I'm working on this. > Clean up inlining

[jira] [Created] (SPARK-37048) Clean up inlining type hints under SQL module

2021-10-18 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-37048: - Summary: Clean up inlining type hints under SQL module Key: SPARK-37048 URL: https://issues.apache.org/jira/browse/SPARK-37048 Project: Spark Issue Type: S

[jira] [Assigned] (SPARK-36933) Reduce duplication in TaskMemoryManager.acquireExecutionMemory

2021-10-18 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-36933: -- Assignee: Tim Armstrong > Reduce duplication in TaskMemoryManager.acquireExecutionMemory > --

[jira] [Resolved] (SPARK-36933) Reduce duplication in TaskMemoryManager.acquireExecutionMemory

2021-10-18 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-36933. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34186 [https://github

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

2021-10-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430184#comment-17430184 ] Dongjoon Hyun commented on SPARK-33828: --- After 3.2.0 announcement, we will close t

[jira] [Commented] (SPARK-37047) Add overloads for lpad and rpad for BINARY strings

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430140#comment-17430140 ] Apache Spark commented on SPARK-37047: -- User 'mkaravel' has created a pull request

[jira] [Assigned] (SPARK-37047) Add overloads for lpad and rpad for BINARY strings

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37047: Assignee: Apache Spark > Add overloads for lpad and rpad for BINARY strings > ---

[jira] [Assigned] (SPARK-37047) Add overloads for lpad and rpad for BINARY strings

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37047: Assignee: (was: Apache Spark) > Add overloads for lpad and rpad for BINARY strings >

[jira] [Resolved] (SPARK-36886) Inline type hints for python/pyspark/sql/context.py

2021-10-18 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36886. --- Fix Version/s: 3.3.0 Assignee: dch nguyen Resolution: Fixed Issue resolved b

[jira] [Comment Edited] (SPARK-37027) Fix behavior inconsistent in Hive table when ‘path’ is provided in SERDEPROPERTIES

2021-10-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430125#comment-17430125 ] Erik Krogen edited comment on SPARK-37027 at 10/18/21, 6:10 PM: --

[jira] [Commented] (SPARK-37027) Fix behavior inconsistent in Hive table when ‘path’ is provided in SERDEPROPERTIES

2021-10-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430125#comment-17430125 ] Erik Krogen commented on SPARK-37027: - [~yuzhousun] actually this is already fixed b

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

2021-10-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430124#comment-17430124 ] Erik Krogen commented on SPARK-33828: - [~dongjoon] as you mentioned above, this epic

[jira] [Created] (SPARK-37047) Add overloads for lpad and rpad for BINARY strings

2021-10-18 Thread Menelais Karavelas (Jira)
Menelais Karavelas created SPARK-37047: -- Summary: Add overloads for lpad and rpad for BINARY strings Key: SPARK-37047 URL: https://issues.apache.org/jira/browse/SPARK-37047 Project: Spark

[jira] [Assigned] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37046: Assignee: (was: Apache Spark) > Alter view does not preserve column case > --

[jira] [Assigned] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37046: Assignee: (was: Apache Spark) > Alter view does not preserve column case > --

[jira] [Assigned] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37046: Assignee: Apache Spark > Alter view does not preserve column case > -

[jira] [Commented] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430114#comment-17430114 ] Apache Spark commented on SPARK-37046: -- User 'somani' has created a pull request fo

[jira] [Commented] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Abhishek Somani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430105#comment-17430105 ] Abhishek Somani commented on SPARK-37046: - I'll raise a PR soon > Alter view do

[jira] [Updated] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Abhishek Somani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated SPARK-37046: Shepherd: Wenchen Fan > Alter view does not preserve column case > ---

[jira] [Created] (SPARK-37046) Alter view does not preserve column case

2021-10-18 Thread Abhishek Somani (Jira)
Abhishek Somani created SPARK-37046: --- Summary: Alter view does not preserve column case Key: SPARK-37046 URL: https://issues.apache.org/jira/browse/SPARK-37046 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

2021-10-18 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430099#comment-17430099 ] pralabhkumar commented on SPARK-32161: -- [~hyukjin.kwon]    Since the PR is being

[jira] [Updated] (SPARK-37045) Unify v1 and v2 ALTER TABLE .. ADD COLUMNS tests

2021-10-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37045: - Description: Extract ALTER TABLE .. ADD COLUMNS tests to the common place to run them for V1 and v2 data

[jira] [Created] (SPARK-37045) Unify v1 and v2 ALTER TABLE .. ADD COLUMNS tests

2021-10-18 Thread Max Gekk (Jira)
Max Gekk created SPARK-37045: Summary: Unify v1 and v2 ALTER TABLE .. ADD COLUMNS tests Key: SPARK-37045 URL: https://issues.apache.org/jira/browse/SPARK-37045 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

2021-10-18 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430059#comment-17430059 ] Maciej Szymkiewicz commented on SPARK-37044: cc [~hyukjin.kwon] > Add Row t

[jira] [Created] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

2021-10-18 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-37044: -- Summary: Add Row to __all__ in pyspark.sql.types Key: SPARK-37044 URL: https://issues.apache.org/jira/browse/SPARK-37044 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-35925) Support DayTimeIntervalType in width-bucket function

2021-10-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35925: Assignee: PengLei > Support DayTimeIntervalType in width-bucket function > --

[jira] [Resolved] (SPARK-35925) Support DayTimeIntervalType in width-bucket function

2021-10-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35925. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34309 [https://github.com

[jira] [Issue Comment Deleted] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

2021-10-18 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-36231: Comment: was deleted (was: https://github.com/apache/spark/pull/34314) > Support arithmetic opera

[jira] [Commented] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429997#comment-17429997 ] Apache Spark commented on SPARK-36231: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36231: Assignee: (was: Apache Spark) > Support arithmetic operations of Series containing De

[jira] [Commented] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429996#comment-17429996 ] Apache Spark commented on SPARK-36231: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36231: Assignee: Apache Spark > Support arithmetic operations of Series containing Decimal(np.na

[jira] [Commented] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

2021-10-18 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429994#comment-17429994 ] Yikun Jiang commented on SPARK-36231: - https://github.com/apache/spark/pull/34314 >

[jira] [Assigned] (SPARK-37043) Cancel all running job after AQE plan finished

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37043: Assignee: (was: Apache Spark) > Cancel all running job after AQE plan finished >

[jira] [Assigned] (SPARK-37043) Cancel all running job after AQE plan finished

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37043: Assignee: Apache Spark > Cancel all running job after AQE plan finished > ---

[jira] [Commented] (SPARK-36337) decimal('Nan') is unsupported in net.razorvine.pickle

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429987#comment-17429987 ] Apache Spark commented on SPARK-36337: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-37043) Cancel all running job after AQE plan finished

2021-10-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429988#comment-17429988 ] Apache Spark commented on SPARK-37043: -- User 'ulysses-you' has created a pull reque

  1   2   >