[jira] [Commented] (SPARK-38523) Failure on referring to the corrupt record from CSV

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506024#comment-17506024 ] Apache Spark commented on SPARK-38523: -- User 'MaxGekk' has created a pull request f

[jira] [Resolved] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38415. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35735 [https://gith

[jira] [Assigned] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38415: --- Assignee: Daniel > Update histogram_numeric (x, y) result type to make x == input type > -

[jira] [Assigned] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38504: --- Assignee: jiaan.geng > Can't read TimestampNTZ as TimestampLTZ > --

[jira] [Resolved] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38504. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35803 [https://gith

[jira] [Assigned] (SPARK-38103) Use error classes in the parsing errors of transform

2022-03-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38103: Assignee: Yuto Akutsu > Use error classes in the parsing errors of transform > --

[jira] [Resolved] (SPARK-38103) Use error classes in the parsing errors of transform

2022-03-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38103. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35759 [https://github.com

[jira] [Resolved] (SPARK-38523) Failure on referring to the corrupt record from CSV

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38523. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35817 [https://gith

[jira] [Assigned] (SPARK-38410) Support specify initial partition number for rebalance

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38410: --- Assignee: XiDuo You > Support specify initial partition number for rebalance >

[jira] [Resolved] (SPARK-38410) Support specify initial partition number for rebalance

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38410. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35729 [https://gith

[jira] [Assigned] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38519: --- Assignee: XiDuo You > AQE throw exception should respect SparkFatalException >

[jira] [Resolved] (SPARK-38519) AQE throw exception should respect SparkFatalException

2022-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38519. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35814 [https://gith

[jira] [Commented] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-03-13 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505993#comment-17505993 ] L. C. Hsieh commented on SPARK-38531: - Oh, I think I get your point. The optimizer r

[jira] [Commented] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505980#comment-17505980 ] Apache Spark commented on SPARK-38521: -- User 'jackylee-ch' has created a pull reque

[jira] [Commented] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505979#comment-17505979 ] Apache Spark commented on SPARK-37865: -- User 'karenfeng' has created a pull request

[jira] [Resolved] (SPARK-38532) Add test case for invalid gapDuration of sessionwindow

2022-03-13 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38532. -- Fix Version/s: 3.3.0 Assignee: nyingping Resolution: Fixed Issue resolved via

[jira] [Assigned] (SPARK-38545) Upgarde scala-maven-plugin from 4.4.0 to 4.5.6

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38545: Assignee: Apache Spark > Upgarde scala-maven-plugin from 4.4.0 to 4.5.6 > ---

[jira] [Assigned] (SPARK-38545) Upgarde scala-maven-plugin from 4.4.0 to 4.5.6

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38545: Assignee: (was: Apache Spark) > Upgarde scala-maven-plugin from 4.4.0 to 4.5.6 >

[jira] [Commented] (SPARK-38545) Upgarde scala-maven-plugin from 4.4.0 to 4.5.6

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505975#comment-17505975 ] Apache Spark commented on SPARK-38545: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-38545) Upgarde scala-maven-plugin from 4.4.0 to 4.5.6

2022-03-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-38545: Summary: Upgarde scala-maven-plugin from 4.4.0 to 4.5.6 Key: SPARK-38545 URL: https://issues.apache.org/jira/browse/SPARK-38545 Project: Spark Issue Type: Improvemen

[jira] [Assigned] (SPARK-38544) Upgrade log4j2 to 2.17.2

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38544: Assignee: (was: Apache Spark) > Upgrade log4j2 to 2.17.2 > >

[jira] [Commented] (SPARK-38544) Upgrade log4j2 to 2.17.2

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505972#comment-17505972 ] Apache Spark commented on SPARK-38544: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38544) Upgrade log4j2 to 2.17.2

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38544: Assignee: Apache Spark > Upgrade log4j2 to 2.17.2 > > >

[jira] [Created] (SPARK-38544) Upgrade log4j2 to 2.17.2

2022-03-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-38544: Summary: Upgrade log4j2 to 2.17.2 Key: SPARK-38544 URL: https://issues.apache.org/jira/browse/SPARK-38544 Project: Spark Issue Type: Improvement Components

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505966#comment-17505966 ] Hyukjin Kwon commented on SPARK-38536: -- cc [~Deegue] > Spark 3 can not read mixed

[jira] [Comment Edited] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Huicheng Song (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505964#comment-17505964 ] Huicheng Song edited comment on SPARK-38536 at 3/14/22, 2:53 AM: -

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Huicheng Song (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505964#comment-17505964 ] Huicheng Song commented on SPARK-38536: --- The PR was closed 3 years ago, and Github

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505961#comment-17505961 ] Hyukjin Kwon commented on SPARK-38536: -- Do you mind adding a comment in that PR on

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Huicheng Song (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505960#comment-17505960 ] Huicheng Song commented on SPARK-38536: --- In the PR I linked above, it dropped the

[jira] [Resolved] (SPARK-38528) NullPointerException when selecting a generator in a Stream of aggregate expressions

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38528. -- Fix Version/s: 3.3.0 Assignee: Bruce Robbins Resolution: Fixed Fixed in https:

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505952#comment-17505952 ] Hyukjin Kwon commented on SPARK-38536: -- im trying to understand the problem. {quot

[jira] [Resolved] (SPARK-38507) DataFrame withColumn method not adding or replacing columns when alias is used

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38507. -- Resolution: Not A Problem > DataFrame withColumn method not adding or replacing columns when a

[jira] [Commented] (SPARK-38507) DataFrame withColumn method not adding or replacing columns when alias is used

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505951#comment-17505951 ] Hyukjin Kwon commented on SPARK-38507: -- To add a new field into the nested column,

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Huicheng Song (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505950#comment-17505950 ] Huicheng Song commented on SPARK-38536: --- It would be great if this can be fixed so

[jira] [Updated] (SPARK-38524) [TEST] Fix Volcano weight to be positive integer and use cpu capability instead

2022-03-13 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38524: Summary: [TEST] Fix Volcano weight to be positive integer and use cpu capability instead (was: [T

[jira] [Updated] (SPARK-38524) Fix Volcano weight to be positive integer and use cpu capability instead

2022-03-13 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38524: Summary: Fix Volcano weight to be positive integer and use cpu capability instead (was: [TEST] Fi

[jira] [Commented] (SPARK-38520) Overflow occurs when reading ANSI day time interval from CSV file

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505949#comment-17505949 ] Hyukjin Kwon commented on SPARK-38520: -- [~chongg@nvidia] can you see if it fails wi

[jira] [Updated] (SPARK-38524) [TEST] Change disable queue to capability limit way

2022-03-13 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38524: Component/s: Tests > [TEST] Change disable queue to capability limit way > ---

[jira] [Updated] (SPARK-38520) Overflow occurs when reading ANSI day time interval from CSV file

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38520: - Description: *Problem:* Overflow occurs when reading the following positive intervals, the resu

[jira] [Closed] (SPARK-38525) Check resource after resource creation

2022-03-13 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang closed SPARK-38525. --- > Check resource after resource creation > -- > > Ke

[jira] [Resolved] (SPARK-38525) Check resource after resource creation

2022-03-13 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-38525. - Resolution: Won't Fix > Check resource after resource creation > ---

[jira] [Updated] (SPARK-38525) Check resource after resource creation

2022-03-13 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38525: Summary: Check resource after resource creation (was: [TEST] Check resource after resource creati

[jira] [Created] (SPARK-38543) [CI] Introduce Spark on Kubernetes CI into Volcano community

2022-03-13 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-38543: --- Summary: [CI] Introduce Spark on Kubernetes CI into Volcano community Key: SPARK-38543 URL: https://issues.apache.org/jira/browse/SPARK-38543 Project: Spark I

[jira] [Resolved] (SPARK-38514) Download link on spark 3.2.1 for hadoop 3.2 is wrong

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38514. -- Resolution: Duplicate This is a dup of SPARK-37445 > Download link on spark 3.2.1 for hadoop

[jira] [Commented] (SPARK-38529) GeneratorNestedColumnAliasing works incorrectly for non-Explode generators

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505947#comment-17505947 ] Hyukjin Kwon commented on SPARK-38529: -- cc [~viirya] FYI. [~miny] mind providing a

[jira] [Commented] (SPARK-38530) GeneratorNestedColumnAliasing does not work correctly for some expressions

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505946#comment-17505946 ] Hyukjin Kwon commented on SPARK-38530: -- cc [~viirya] FYI. [~miny]mind providing a s

[jira] [Commented] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505945#comment-17505945 ] Hyukjin Kwon commented on SPARK-38531: -- cc [~viirya] FYI. [~miny]do you have a self

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

2022-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505944#comment-17505944 ] Hyukjin Kwon commented on SPARK-38536: -- [~songhuicheng] are you suggesting to make

[jira] [Commented] (SPARK-38528) NullPointerException when selecting a generator in a Stream of aggregate expressions

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505936#comment-17505936 ] Apache Spark commented on SPARK-38528: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-38528) NullPointerException when selecting a generator in a Stream of aggregate expressions

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38528: Assignee: (was: Apache Spark) > NullPointerException when selecting a generator in a

[jira] [Assigned] (SPARK-38528) NullPointerException when selecting a generator in a Stream of aggregate expressions

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38528: Assignee: Apache Spark > NullPointerException when selecting a generator in a Stream of a

[jira] [Resolved] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38540. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35834 [https://gith

[jira] [Assigned] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38540: --- Assignee: Yang Jie > Upgrade compress-lzf from 1.0.3 to 1.1.0 > ---

[jira] [Assigned] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38542: Assignee: (was: Apache Spark) > UnsafeHashedRelation should serialize numKeys out > -

[jira] [Commented] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505444#comment-17505444 ] Apache Spark commented on SPARK-38542: -- User 'mcdull-zhang' has created a pull requ

[jira] [Assigned] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38542: Assignee: Apache Spark > UnsafeHashedRelation should serialize numKeys out >

[jira] [Updated] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-03-13 Thread mcdull_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-38542: - Description: At present, UnsafeHashedRelation does not write out numKeys during serialization,

[jira] [Updated] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-03-13 Thread mcdull_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-38542: - Description: At present, UnsafeHashedRelation does not write out numKeys during serialization,

[jira] [Created] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-03-13 Thread mcdull_zhang (Jira)
mcdull_zhang created SPARK-38542: Summary: UnsafeHashedRelation should serialize numKeys out Key: SPARK-38542 URL: https://issues.apache.org/jira/browse/SPARK-38542 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38541) Upgrade netty to 4.1.75

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505424#comment-17505424 ] Apache Spark commented on SPARK-38541: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-38541) Upgrade netty to 4.1.75

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505423#comment-17505423 ] Apache Spark commented on SPARK-38541: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38541) Upgrade netty to 4.1.75

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38541: Assignee: (was: Apache Spark) > Upgrade netty to 4.1.75 > --- > >

[jira] [Assigned] (SPARK-38541) Upgrade netty to 4.1.75

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38541: Assignee: Apache Spark > Upgrade netty to 4.1.75 > --- > >

[jira] [Created] (SPARK-38541) Upgrade netty to 4.1.75

2022-03-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-38541: Summary: Upgrade netty to 4.1.75 Key: SPARK-38541 URL: https://issues.apache.org/jira/browse/SPARK-38541 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505415#comment-17505415 ] Apache Spark commented on SPARK-38540: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38540: Assignee: (was: Apache Spark) > Upgrade compress-lzf from 1.0.3 to 1.1.0 > --

[jira] [Assigned] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38540: Assignee: Apache Spark > Upgrade compress-lzf from 1.0.3 to 1.1.0 > -

[jira] [Created] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-38540: Summary: Upgrade compress-lzf from 1.0.3 to 1.1.0 Key: SPARK-38540 URL: https://issues.apache.org/jira/browse/SPARK-38540 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38360) Introduce a `exists` function for `TreeNode` to eliminate duplicate code pattern

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505412#comment-17505412 ] Apache Spark commented on SPARK-38360: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-38360) Introduce a `exists` function for `TreeNode` to eliminate duplicate code pattern

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505413#comment-17505413 ] Apache Spark commented on SPARK-38360: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-38511) Remove priorityClassName propagation in favor of explicit settings

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505411#comment-17505411 ] Apache Spark commented on SPARK-38511: -- User 'williamhyun' has created a pull reque

[jira] [Commented] (SPARK-38511) Remove priorityClassName propagation in favor of explicit settings

2022-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505410#comment-17505410 ] Apache Spark commented on SPARK-38511: -- User 'williamhyun' has created a pull reque