[jira] [Resolved] (SPARK-42335) Pass the comment option through to univocity if users set it explicitly in CSV dataSource

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42335. -- Fix Version/s: 3.5.0 (was: 3.4.0) Resolution: Fixed Issue

[jira] [Assigned] (SPARK-42335) Pass the comment option through to univocity if users set it explicitly in CSV dataSource

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42335: Assignee: Wei Guo > Pass the comment option through to univocity if users set it

[jira] [Resolved] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42336. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39879

[jira] [Assigned] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42336: Assignee: jingxiong zhong > Use getOrElse() instead of contains() in ResourceAllocator

[jira] [Updated] (SPARK-42336) Use getOrElse() instead of contains() in ResourceAllocator

2023-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42336: - Priority: Trivial (was: Minor) > Use getOrElse() instead of contains() in ResourceAllocator >

[jira] [Resolved] (SPARK-41554) Decimal.changePrecision produces ArrayIndexOutOfBoundsException

2023-02-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41554. -- Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Assigned] (SPARK-41554) Decimal.changePrecision produces ArrayIndexOutOfBoundsException

2023-02-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41554: Assignee: Oleksiy Dyagilev > Decimal.changePrecision produces

[jira] [Resolved] (SPARK-42257) Remove unused variable in ExternalSorter

2023-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42257. -- Fix Version/s: 3.5.0 Assignee: Khalid Mammadov Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-42245) Upgrade scalafmt from 3.6.1 to 3.7.1

2023-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42245: Assignee: BingKun Pan > Upgrade scalafmt from 3.6.1 to 3.7.1 >

[jira] [Resolved] (SPARK-42245) Upgrade scalafmt from 3.6.1 to 3.7.1

2023-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42245. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39816

[jira] [Updated] (SPARK-42245) Upgrade scalafmt from 3.6.1 to 3.7.1

2023-01-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42245: - Priority: Trivial (was: Minor) > Upgrade scalafmt from 3.6.1 to 3.7.1 >

[jira] [Updated] (SPARK-42146) Refactor `Utils#setStringField` to make maven build pass when sql module use this method

2023-01-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42146: - Priority: Trivial (was: Major) > Refactor `Utils#setStringField` to make maven build pass when

[jira] [Resolved] (SPARK-41683) Spark UI: In jobs API, numActiveStages can be negative in some cases

2023-01-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41683. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39190

[jira] [Assigned] (SPARK-41683) Spark UI: In jobs API, numActiveStages can be negative in some cases

2023-01-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41683: Assignee: wy > Spark UI: In jobs API, numActiveStages can be negative in some cases >

[jira] [Assigned] (SPARK-42092) Upgrade RoaringBitmap to 0.9.38

2023-01-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42092: Assignee: Yang Jie > Upgrade RoaringBitmap to 0.9.38 > --- >

[jira] [Resolved] (SPARK-42092) Upgrade RoaringBitmap to 0.9.38

2023-01-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42092. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39613

[jira] [Updated] (SPARK-41047) Remove legacy example of round function with negative scale

2023-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41047: - Priority: Trivial (was: Major) > Remove legacy example of round function with negative scale

[jira] [Updated] (SPARK-41047) Remove legacy example of round function with negative scale

2023-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41047: - Summary: Remove legacy example of round function with negative scale (was: round function

[jira] [Updated] (SPARK-41047) Remove legacy example of round function with negative scale

2023-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41047: - Component/s: Documentation > Remove legacy example of round function with negative scale >

[jira] [Resolved] (SPARK-41047) round function with negative scale value runs failed

2023-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41047. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39511

[jira] [Assigned] (SPARK-41047) round function with negative scale value runs failed

2023-01-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41047: Assignee: BingKun Pan > round function with negative scale value runs failed >

[jira] [Resolved] (SPARK-41890) Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/SparkPlanGraphWrapperSerializer` for Scala 2.13

2023-01-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41890. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39399

[jira] [Assigned] (SPARK-41800) Upgrade commons-compress to 1.22

2023-01-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41800: Assignee: BingKun Pan > Upgrade commons-compress to 1.22 >

[jira] [Resolved] (SPARK-41800) Upgrade commons-compress to 1.22

2023-01-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41800. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39326

[jira] [Assigned] (SPARK-41890) Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/SparkPlanGraphWrapperSerializer` for Scala 2.13

2023-01-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41890: Assignee: Yang Jie > Reduce `toSeq` in >

[jira] [Resolved] (SPARK-41883) Upgrade dropwizard metrics 4.2.15

2023-01-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41883. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39391

[jira] [Assigned] (SPARK-41883) Upgrade dropwizard metrics 4.2.15

2023-01-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41883: Assignee: Yang Jie > Upgrade dropwizard metrics 4.2.15 >

[jira] [Updated] (SPARK-41883) Upgrade dropwizard metrics 4.2.15

2023-01-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41883: - Priority: Trivial (was: Minor) > Upgrade dropwizard metrics 4.2.15 >

[jira] [Assigned] (SPARK-41853) Use Map in place of SortedMap for ErrorClassesJsonReader

2023-01-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41853: Assignee: Ted Yu > Use Map in place of SortedMap for ErrorClassesJsonReader >

[jira] [Resolved] (SPARK-41853) Use Map in place of SortedMap for ErrorClassesJsonReader

2023-01-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41853. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39351

[jira] [Resolved] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41709. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39215

[jira] [Assigned] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41709: Assignee: Yang Jie > Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when

[jira] [Updated] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41709: - Priority: Minor (was: Major) > Explicitly define `Seq` as `collection.Seq` to reduce `toSeq`

[jira] [Assigned] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0

2022-12-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41714: Assignee: BingKun Pan > Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 >

[jira] [Resolved] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0

2022-12-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41714. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39218

[jira] [Updated] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0

2022-12-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41714: - Priority: Trivial (was: Minor) > Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 >

[jira] [Updated] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41458: - Priority: Minor (was: Major) > Correctly transform the SPI services for Yarn Shuffle Service >

[jira] [Resolved] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41458. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41458: Assignee: Cheng Pan > Correctly transform the SPI services for Yarn Shuffle Service >

[jira] [Assigned] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41008: Assignee: Ahmed Mahran > Isotonic regression result differs from sklearn implementation

[jira] [Resolved] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41008. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38966

[jira] [Resolved] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41408. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38936

[jira] [Assigned] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41408: Assignee: Yang Jie > Upgrade scala-maven-plugin to 4.8.0 >

[jira] [Updated] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

2022-12-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41376: - Priority: Minor (was: Major) > Executor netty direct memory check should respect >

[jira] [Resolved] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

2022-12-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41376. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38901

[jira] [Assigned] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

2022-12-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41376: Assignee: Cheng Pan > Executor netty direct memory check should respect >

[jira] [Resolved] (SPARK-40642) wrong doc on memory tuning regarding String object memory size, changed since version>=9

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40642. -- Resolution: Won't Fix > wrong doc on memory tuning regarding String object memory size,

[jira] [Updated] (SPARK-40141) Task listener overloads no longer needed with JDK 8+

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40141: - Priority: Minor (was: Major) > Task listener overloads no longer needed with JDK 8+ >

[jira] [Resolved] (SPARK-39948) exclude velocity 1.5 jar

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39948. -- Resolution: Not A Problem > exclude velocity 1.5 jar > > >

[jira] [Resolved] (SPARK-40141) Task listener overloads no longer needed with JDK 8+

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40141. -- Resolution: Won't Fix > Task listener overloads no longer needed with JDK 8+ >

[jira] [Resolved] (SPARK-40284) spark concurrent overwrite mode writes data to files in HDFS format, all request data write success

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40284. -- Resolution: Not A Problem > spark concurrent overwrite mode writes data to files in HDFS

[jira] [Resolved] (SPARK-40253) Data read exception in orc format

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40253. -- Resolution: Won't Fix > Data read exception in orc format >

[jira] [Resolved] (SPARK-40286) Load Data from S3 deletes data source file

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40286. -- Resolution: Not A Problem > Load Data from S3 deletes data source file >

[jira] [Resolved] (SPARK-36853) Code failing on checkstyle

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36853. -- Resolution: Won't Fix > Code failing on checkstyle > -- > >

[jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17643373#comment-17643373 ] Sean R. Owen commented on SPARK-41008: -- No need for an option, this seems like a bug fix. Yes if

[jira] [Resolved] (SPARK-41313) AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence of SPARK-3900)

2022-12-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41313. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38832

[jira] [Assigned] (SPARK-41313) AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence of SPARK-3900)

2022-12-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41313: Assignee: Xing Lin > AM shutdown hook fails with IllegalStateException if AM crashes on

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41313: - Priority: Minor (was: Major) > Combine fixes for SPARK-3900 and SPARK-21138 >

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41313: - Target Version/s: (was: 3.2.4, 3.3.2, 3.4.0) > Combine fixes for SPARK-3900 and SPARK-21138 >

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41008: - Priority: Minor (was: Major) > Isotonic regression result differs from sklearn implementation

[jira] [Commented] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642001#comment-17642001 ] Sean R. Owen commented on SPARK-41013: -- Can you clarify the issue? this doesn't look like it

[jira] [Resolved] (SPARK-41087) Make `build/mvn` use the same JAVA_OPTS as `dev/make-distribution.sh`

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41087. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641994#comment-17641994 ] Sean R. Owen commented on SPARK-41219: -- Is this the same as

[jira] [Updated] (SPARK-41253) Make K8s volcano IT work in Github Action

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41253: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Make K8s volcano IT

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641992#comment-17641992 ] Sean R. Owen commented on SPARK-41324: -- Or isn't this a dupe of

[jira] [Commented] (SPARK-41319) when-otherwise support

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641993#comment-17641993 ] Sean R. Owen commented on SPARK-41319: -- Can we get a little more detail in these sub-tasks? >

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641990#comment-17641990 ] Sean R. Owen commented on SPARK-41324: -- Can we get a little more detail in here / update the title?

[jira] [Commented] (SPARK-41342) Add support for distributed deep learning framework

2022-12-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641989#comment-17641989 ] Sean R. Owen commented on SPARK-41342: -- Why not Horovod? it works with Spark and Pytorch. > Add

[jira] [Resolved] (SPARK-41276) Optimize constructor use of `StructType`

2022-11-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41276. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38811

[jira] [Assigned] (SPARK-41276) Optimize constructor use of `StructType`

2022-11-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41276: Assignee: Yang Jie > Optimize constructor use of `StructType` >

[jira] [Assigned] (SPARK-41254) YarnAllocator.rpIdToYarnResource map is not properly updated

2022-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41254: Assignee: Zhang Liang > YarnAllocator.rpIdToYarnResource map is not properly updated >

[jira] [Resolved] (SPARK-41254) YarnAllocator.rpIdToYarnResource map is not properly updated

2022-11-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41254. -- Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Updated] (SPARK-41097) Remove redundant collection conversion for Scala 2.13

2022-11-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41097: - Priority: Minor (was: Major) > Remove redundant collection conversion for Scala 2.13 >

[jira] [Assigned] (SPARK-41097) Remove redundant collection conversion for Scala 2.13

2022-11-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41097: Assignee: Yang Jie > Remove redundant collection conversion for Scala 2.13 >

[jira] [Resolved] (SPARK-41097) Remove redundant collection conversion for Scala 2.13

2022-11-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41097. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38598

[jira] [Resolved] (SPARK-41239) Upgrade Jackson to 2.14.1

2022-11-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41239. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38771

[jira] [Assigned] (SPARK-41239) Upgrade Jackson to 2.14.1

2022-11-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41239: Assignee: Yang Jie > Upgrade Jackson to 2.14.1 > - > >

[jira] [Updated] (SPARK-40633) Upgrade janino to 3.1.9

2022-11-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40633: - Priority: Minor (was: Major) > Upgrade janino to 3.1.9 > --- > >

[jira] [Resolved] (SPARK-41223) Upgrade slf4j to 2.0.4

2022-11-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41223. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38758

[jira] [Resolved] (SPARK-40633) Upgrade janino to 3.1.9

2022-11-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40633. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38075

[jira] [Assigned] (SPARK-40633) Upgrade janino to 3.1.9

2022-11-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40633: Assignee: Yang Jie > Upgrade janino to 3.1.9 > --- > >

[jira] [Assigned] (SPARK-41106) Reduce collection conversion when create AttributeMap

2022-11-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41106: Assignee: Yang Jie > Reduce collection conversion when create AttributeMap >

[jira] [Resolved] (SPARK-41106) Reduce collection conversion when create AttributeMap

2022-11-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41106. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38610

[jira] [Updated] (SPARK-41093) Remove netty-tcnative-classes from Spark dependencyList

2022-11-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41093: - Priority: Minor (was: Major) > Remove netty-tcnative-classes from Spark dependencyList >

[jira] [Resolved] (SPARK-41093) Remove netty-tcnative-classes from Spark dependencyList

2022-11-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41093. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38596

[jira] [Assigned] (SPARK-41093) Remove netty-tcnative-classes from Spark dependencyList

2022-11-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41093: Assignee: Cheng Pan > Remove netty-tcnative-classes from Spark dependencyList >

[jira] [Updated] (SPARK-41089) Relocate Netty native arm64 libs

2022-11-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41089: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Relocate Netty native

[jira] [Resolved] (SPARK-41089) Relocate Netty native arm64 libs

2022-11-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41089. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-41089) Relocate Netty native arm64 libs

2022-11-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41089: Assignee: Cheng Pan > Relocate Netty native arm64 libs >

[jira] [Resolved] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41039. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38550

[jira] [Assigned] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41039: Assignee: Yang Jie > Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13 >

[jira] [Updated] (SPARK-41039) Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41039: - Priority: Trivial (was: Major) > Upgrade `scala-parallel-collections` to 1.0.4 for Scala 2.13

[jira] [Updated] (SPARK-41050) Upgrade scalafmt from 3.5.9 to 3.6.1

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41050: - Priority: Trivial (was: Minor) > Upgrade scalafmt from 3.5.9 to 3.6.1 >

[jira] [Assigned] (SPARK-41050) Upgrade scalafmt from 3.5.9 to 3.6.1

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41050: Assignee: BingKun Pan > Upgrade scalafmt from 3.5.9 to 3.6.1 >

[jira] [Resolved] (SPARK-41050) Upgrade scalafmt from 3.5.9 to 3.6.1

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41050. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38559

[jira] [Resolved] (SPARK-41029) Optimize the use of `GenericArrayData` constructor for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41029. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38533

[jira] [Assigned] (SPARK-41029) Optimize the use of `GenericArrayData` constructor for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41029: Assignee: Yang Jie > Optimize the use of `GenericArrayData` constructor for Scala 2.13 >

[jira] [Updated] (SPARK-41029) Optimize the use of `GenericArrayData` constructor for Scala 2.13

2022-11-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41029: - Priority: Minor (was: Major) > Optimize the use of `GenericArrayData` constructor for Scala

[jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630143#comment-17630143 ] Sean R. Owen commented on SPARK-41008: -- Yeah that doesn't look right. I tried understanding the

[jira] [Resolved] (SPARK-41031) Upgrade `org.tukaani:xz` to 1.9

2022-11-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41031. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

<    1   2   3   4   5   6   7   8   9   10   >