[jira] [Updated] (SPARK-38623) Add more comments and tests for HashShuffleSpec

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-38623: Summary: Add more comments and tests for HashShuffleSpec (was: Simplify the compatibility check i

[jira] [Resolved] (SPARK-38063) Support SQL split_part function

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38063. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35352 [https://gith

[jira] [Assigned] (SPARK-38063) Support SQL split_part function

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38063: --- Assignee: Rui Wang > Support SQL split_part function > --- > >

[jira] [Assigned] (SPARK-38585) Simplify the code of TreeNode.clone()

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38585: --- Assignee: Yang Jie > Simplify the code of TreeNode.clone() > --

[jira] [Resolved] (SPARK-38585) Simplify the code of TreeNode.clone()

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38585. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35890 [https://gith

[jira] [Resolved] (SPARK-38631) Arbitrary shell command injection via Utils.unpack()

2022-03-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38631. -- Target Version/s: 3.2.1, 3.1.2, 3.3.0 Assignee: Hyukjin Kwon Resolution:

[jira] [Assigned] (SPARK-38641) Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38641: Assignee: Apache Spark > Get rid of invalid configuration elements in mvn_scalafmt in mai

[jira] [Assigned] (SPARK-38641) Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38641: Assignee: (was: Apache Spark) > Get rid of invalid configuration elements in mvn_scal

[jira] [Commented] (SPARK-38641) Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511565#comment-17511565 ] Apache Spark commented on SPARK-38641: -- User 'morvenhuang' has created a pull reque

[jira] [Commented] (SPARK-38641) Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511566#comment-17511566 ] Apache Spark commented on SPARK-38641: -- User 'morvenhuang' has created a pull reque

[jira] [Updated] (SPARK-38641) Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml

2022-03-23 Thread morvenhuang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] morvenhuang updated SPARK-38641: Attachment: mvn_scalafmt.jpg > Get rid of invalid configuration elements in mvn_scalafmt in main p

[jira] [Commented] (SPARK-28098) Native ORC reader doesn't support subdirectories with Hive tables

2022-03-23 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511562#comment-17511562 ] Zhen Wang commented on SPARK-28098: --- > set spark.sql.hive.convertMetastoreParquet=fals

[jira] [Created] (SPARK-38641) Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml

2022-03-23 Thread morvenhuang (Jira)
morvenhuang created SPARK-38641: --- Summary: Get rid of invalid configuration elements in mvn_scalafmt in main pom.xml Key: SPARK-38641 URL: https://issues.apache.org/jira/browse/SPARK-38641 Project: Spar

[jira] [Commented] (SPARK-38636) AttributeError: module 'pyspark.pandas' has no attribute 'Timestamp'

2022-03-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511556#comment-17511556 ] Hyukjin Kwon commented on SPARK-38636: -- Ditto w/ Timedelta. Pandas API on Spark doe

[jira] [Commented] (SPARK-38638) AttributeError: module 'pyspark.pandas' has no attribute 'Timedelta'

2022-03-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511554#comment-17511554 ] Hyukjin Kwon commented on SPARK-38638: -- For this, users should use `pd.Timedelta` i

[jira] [Commented] (SPARK-38637) pyspark.pandas.config.OptionError: "No such option: 'mode.chained_assignment'

2022-03-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511555#comment-17511555 ] Hyukjin Kwon commented on SPARK-38637: -- cc [~itholic] [~XinrongM] FYI > pyspark.pa

[jira] [Commented] (SPARK-38561) Add doc for "Customized Kubernetes Schedulers"

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511553#comment-17511553 ] Apache Spark commented on SPARK-38561: -- User 'Yikun' has created a pull request for

[jira] [Resolved] (SPARK-38625) DataSource V2: Add APIs for group-based row-level operations

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38625. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35940 [https://gith

[jira] [Assigned] (SPARK-38625) DataSource V2: Add APIs for group-based row-level operations

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38625: --- Assignee: Anton Okolnychyi > DataSource V2: Add APIs for group-based row-level operations >

[jira] [Commented] (SPARK-38627) TypeError: Datetime subtraction can only be applied to datetime series

2022-03-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511531#comment-17511531 ] Hyukjin Kwon commented on SPARK-38627: -- Just post a copy-and-pastable codes in the

[jira] [Created] (SPARK-38640) NPE with unpersisting memory-only RDD with RDD fetching from shuffle service enabled

2022-03-23 Thread Adam Binford (Jira)
Adam Binford created SPARK-38640: Summary: NPE with unpersisting memory-only RDD with RDD fetching from shuffle service enabled Key: SPARK-38640 URL: https://issues.apache.org/jira/browse/SPARK-38640

[jira] [Updated] (SPARK-38640) NPE with unpersisting memory-only RDD with RDD fetching from shuffle service enabled

2022-03-23 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Binford updated SPARK-38640: - Description: If you have RDD fetching from shuffle service enabled, memory-only cached RDDs wil

[jira] [Resolved] (SPARK-38611) Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite`

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38611. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35919 [https://gi

[jira] [Assigned] (SPARK-38611) Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite`

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38611: Assignee: Yang Jie > Use `assertThrows` instead of handwriting `intercept` method in > `

[jira] [Commented] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-23 Thread tonydoen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511484#comment-17511484 ] tonydoen commented on SPARK-38639: -- related pr : [https://github.com/apache/spark/pull/

[jira] [Commented] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511478#comment-17511478 ] Apache Spark commented on SPARK-38639: -- User 'TonyDoen' has created a pull request

[jira] [Assigned] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38639: Assignee: Apache Spark > Support ignoreCorruptRecord flag to ensure querying broken seque

[jira] [Assigned] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38639: Assignee: (was: Apache Spark) > Support ignoreCorruptRecord flag to ensure querying b

[jira] [Updated] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-23 Thread tonydoen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tonydoen updated SPARK-38639: - Summary: Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly (was:

[jira] [Created] (SPARK-38639) Support ignoreCorruptRecord flag parallel to ignoreCorruptFiles

2022-03-23 Thread tonydoen (Jira)
tonydoen created SPARK-38639: Summary: Support ignoreCorruptRecord flag parallel to ignoreCorruptFiles Key: SPARK-38639 URL: https://issues.apache.org/jira/browse/SPARK-38639 Project: Spark Issu

[jira] [Created] (SPARK-38638) AttributeError: module 'pyspark.pandas' has no attribute 'Timedelta'

2022-03-23 Thread Prakhar Sandhu (Jira)
Prakhar Sandhu created SPARK-38638: -- Summary: AttributeError: module 'pyspark.pandas' has no attribute 'Timedelta' Key: SPARK-38638 URL: https://issues.apache.org/jira/browse/SPARK-38638 Project: Spa

[jira] [Created] (SPARK-38637) pyspark.pandas.config.OptionError: "No such option: 'mode.chained_assignment'

2022-03-23 Thread Prakhar Sandhu (Jira)
Prakhar Sandhu created SPARK-38637: -- Summary: pyspark.pandas.config.OptionError: "No such option: 'mode.chained_assignment' Key: SPARK-38637 URL: https://issues.apache.org/jira/browse/SPARK-38637 Pro

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2022-03-23 Thread Stu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511358#comment-17511358 ] Stu commented on SPARK-26639: - Here's another example of this happening, in Spark 3.1.2. I'm

[jira] [Updated] (SPARK-38601) AttributeError: module 'pyspark.pandas' has no attribute 'DateOffset'

2022-03-23 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Sandhu updated SPARK-38601: --- Summary: AttributeError: module 'pyspark.pandas' has no attribute 'DateOffset' (was: Attrib

[jira] [Created] (SPARK-38636) AttributeError: module 'pyspark.pandas' has no attribute 'Timestamp'

2022-03-23 Thread Prakhar Sandhu (Jira)
Prakhar Sandhu created SPARK-38636: -- Summary: AttributeError: module 'pyspark.pandas' has no attribute 'Timestamp' Key: SPARK-38636 URL: https://issues.apache.org/jira/browse/SPARK-38636 Project: Spa

[jira] [Updated] (SPARK-38601) AttributeError: module 'databricks.koalas' has no attribute 'DateOffset'

2022-03-23 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Sandhu updated SPARK-38601: --- Description: I am working on replacing Pandas library to Koalas Library in my python repo in

[jira] [Commented] (SPARK-32268) Bloom Filter Join

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511329#comment-17511329 ] Apache Spark commented on SPARK-32268: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-32268) Bloom Filter Join

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511328#comment-17511328 ] Apache Spark commented on SPARK-32268: -- User 'LuciferYang' has created a pull reque

[jira] [Updated] (SPARK-38627) TypeError: Datetime subtraction can only be applied to datetime series

2022-03-23 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Sandhu updated SPARK-38627: --- Affects Version/s: 3.2.1 (was: 3.0.0) > TypeError: Datetime subtr

[jira] [Updated] (SPARK-38601) AttributeError: module 'databricks.koalas' has no attribute 'DateOffset'

2022-03-23 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Sandhu updated SPARK-38601: --- Affects Version/s: 3.2.1 (was: 3.0.0) > AttributeError: module 'd

[jira] [Commented] (SPARK-38601) AttributeError: module 'databricks.koalas' has no attribute 'DateOffset'

2022-03-23 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511319#comment-17511319 ] Prakhar Sandhu commented on SPARK-38601: Hi [~hyukjin.kwon] ,  Has this DateOff

[jira] [Commented] (SPARK-38627) TypeError: Datetime subtraction can only be applied to datetime series

2022-03-23 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511318#comment-17511318 ] Prakhar Sandhu commented on SPARK-38627: Hi [~hyukjin.kwon] , Thanks for your re

[jira] [Assigned] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38613: Assignee: Yang Jie > Fix > RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedI

[jira] [Resolved] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38613. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35923 [https://gi

[jira] [Resolved] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38635. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35952 [https://gi

[jira] [Assigned] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38635: Assignee: wangshengjie > Remove duplicate log for spark ApplicationMaster > -

[jira] [Updated] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38635: - Priority: Trivial (was: Major) > Remove duplicate log for spark ApplicationMaster > ---

[jira] [Resolved] (SPARK-18621) PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-18621. -- Fix Version/s: 3.3.0 Resolution: Fixed Resolved by https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-18621) PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-18621: - Labels: (was: bulk-closed) > PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala

[jira] [Reopened] (SPARK-18621) PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation

2022-03-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reopened SPARK-18621: -- Assignee: Romi Kuntsman > PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala

[jira] [Commented] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511222#comment-17511222 ] Apache Spark commented on SPARK-38635: -- User 'wangshengjie123' has created a pull r

[jira] [Assigned] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38635: Assignee: (was: Apache Spark) > Remove duplicate log for spark ApplicationMaster > --

[jira] [Assigned] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38635: Assignee: Apache Spark > Remove duplicate log for spark ApplicationMaster > -

[jira] [Created] (SPARK-38635) Remove duplicate log for spark ApplicationMaster

2022-03-23 Thread wangshengjie (Jira)
wangshengjie created SPARK-38635: Summary: Remove duplicate log for spark ApplicationMaster Key: SPARK-38635 URL: https://issues.apache.org/jira/browse/SPARK-38635 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37568) Support 2-arguments by the convert_timezone() function

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511218#comment-17511218 ] Apache Spark commented on SPARK-37568: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-38419) Remove tab character and trailing space in script

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511187#comment-17511187 ] Apache Spark commented on SPARK-38419: -- User 'jackylee-ch' has created a pull reque

[jira] [Commented] (SPARK-38419) Remove tab character and trailing space in script

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511188#comment-17511188 ] Apache Spark commented on SPARK-38419: -- User 'jackylee-ch' has created a pull reque

[jira] [Resolved] (SPARK-38628) Complete the copy method in subclasses of InternalRow, ArrayData, and MapData to safely copy their instances.

2022-03-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38628. -- Fix Version/s: 3.3.0 Assignee: Takuya Ueshin Resolution: Fixed Fixed in https:

[jira] [Commented] (SPARK-38587) Validating new location for rename command should use formatted names

2022-03-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511152#comment-17511152 ] Kent Yao commented on SPARK-38587: -- resolved by https://github.com/apache/spark/pull/35

[jira] [Resolved] (SPARK-38587) Validating new location for rename command should use formatted names

2022-03-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-38587. -- Fix Version/s: 3.1.3 3.0.4 3.3.0 3.2.2

[jira] [Resolved] (SPARK-38624) Reduce UnsafeProjection.create call times when Percentile function serializes the aggregation buffer object

2022-03-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38624. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35938 [https://gith

[jira] [Assigned] (SPARK-38624) Reduce UnsafeProjection.create call times when Percentile function serializes the aggregation buffer object

2022-03-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38624: --- Assignee: w l > Reduce UnsafeProjection.create call times when Percentile function serializ

[jira] [Commented] (SPARK-38634) Upgrade hive-service-rpc to 4.0.0

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511074#comment-17511074 ] Apache Spark commented on SPARK-38634: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-38634) Upgrade hive-service-rpc to 4.0.0

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511071#comment-17511071 ] Apache Spark commented on SPARK-38634: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-38634) Upgrade hive-service-rpc to 4.0.0

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38634: Assignee: (was: Apache Spark) > Upgrade hive-service-rpc to 4.0.0 > -

[jira] [Assigned] (SPARK-38634) Upgrade hive-service-rpc to 4.0.0

2022-03-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38634: Assignee: Apache Spark > Upgrade hive-service-rpc to 4.0.0 >

[jira] [Created] (SPARK-38634) Upgrade hive-service-rpc to 4.0.0

2022-03-23 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38634: --- Summary: Upgrade hive-service-rpc to 4.0.0 Key: SPARK-38634 URL: https://issues.apache.org/jira/browse/SPARK-38634 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-38533) DS V2 aggregate push-down supports project with alias

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38533. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35932 [https://gith

[jira] [Assigned] (SPARK-38533) DS V2 aggregate push-down supports project with alias

2022-03-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38533: --- Assignee: jiaan.geng > DS V2 aggregate push-down supports project with alias >