[jira] [Resolved] (SPARK-39256) Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO

[ https://issues.apache.org/jira/browse/SPARK-39256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39256. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36636

[jira] [Assigned] (SPARK-39256) Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO

[ https://issues.apache.org/jira/browse/SPARK-39256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39256: Assignee: Yang Jie > Reduce multiple file attribute calls of

[jira] [Resolved] (SPARK-37956) Add Java and Python examples to the Parquet encryption feature documentation

[ https://issues.apache.org/jira/browse/SPARK-37956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37956. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36523

[jira] [Assigned] (SPARK-37956) Add Java and Python examples to the Parquet encryption feature documentation

[ https://issues.apache.org/jira/browse/SPARK-37956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37956: Assignee: Maya Anderson > Add Java and Python examples to the Parquet encryption feature

[jira] [Assigned] (SPARK-39244) Use `--no-echo` instead of `--slave` in R 4.0

[ https://issues.apache.org/jira/browse/SPARK-39244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39244: Assignee: William Hyun > Use `--no-echo` instead of `--slave` in R 4.0 >

[jira] [Updated] (SPARK-39244) Use `--no-echo` instead of `--slave` in R 4.0

[ https://issues.apache.org/jira/browse/SPARK-39244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39244: - Priority: Trivial (was: Major) > Use `--no-echo` instead of `--slave` in R 4.0 >

[jira] [Resolved] (SPARK-39244) Use `--no-echo` instead of `--slave` in R 4.0

[ https://issues.apache.org/jira/browse/SPARK-39244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39244. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36622

[jira] [Updated] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39204: - Priority: Trivial (was: Minor) > Replace `Utils.createTempDir` related methods with JavaUtils

[jira] [Assigned] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39204: Assignee: Yang Jie > Replace `Utils.createTempDir` related methods with JavaUtils >

[jira] [Resolved] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39204. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36611

[jira] [Resolved] (SPARK-39240) Source and binary releases using different tool to generates hashes for integrity

[ https://issues.apache.org/jira/browse/SPARK-39240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39240. -- Fix Version/s: 3.3.1 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-39240) Source and binary releases using different tool to generates hashes for integrity

[ https://issues.apache.org/jira/browse/SPARK-39240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39240: Assignee: Kent Yao > Source and binary releases using different tool to generates hashes

[jira] [Updated] (SPARK-39240) Source and binary releases using different tool to generates hashes for integrity

[ https://issues.apache.org/jira/browse/SPARK-39240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39240: - Issue Type: Improvement (was: Bug) Priority: Trivial (was: Major) > Source and binary

[jira] [Assigned] (SPARK-38681) Support nested generic case classes

[ https://issues.apache.org/jira/browse/SPARK-38681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38681: Assignee: Emil Ejbyfeldt > Support nested generic case classes >

[jira] [Resolved] (SPARK-38681) Support nested generic case classes

[ https://issues.apache.org/jira/browse/SPARK-38681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38681. -- Fix Version/s: 3.3.1 Resolution: Fixed Issue resolved by pull request 36004

[jira] [Resolved] (SPARK-39104) Null Pointer Exeption on unpersist call

[ https://issues.apache.org/jira/browse/SPARK-39104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39104. -- Fix Version/s: 3.3.1 3.2.2 3.4.0 Resolution:

[jira] [Assigned] (SPARK-39104) Null Pointer Exeption on unpersist call

[ https://issues.apache.org/jira/browse/SPARK-39104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39104: Assignee: Cheng Pan > Null Pointer Exeption on unpersist call >

[jira] [Updated] (SPARK-39102) Replace the usage of guava's Files.createTempDir() with java.nio.file.Files.createTempDirectory()

[ https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39102: - Issue Type: Improvement (was: Bug) > Replace the usage of guava's Files.createTempDir() with

[jira] [Assigned] (SPARK-39102) Replace the usage of guava's Files.createTempDir() with java.nio.file.Files.createTempDirectory()

[ https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39102: Assignee: Yang Jie > Replace the usage of guava's Files.createTempDir() with >

[jira] [Resolved] (SPARK-39102) Replace the usage of guava's Files.createTempDir() with java.nio.file.Files.createTempDirectory()

[ https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39102. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36529

[jira] [Assigned] (SPARK-39196) Replace getOrElse(null) with orNull

[ https://issues.apache.org/jira/browse/SPARK-39196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39196: Assignee: qian > Replace getOrElse(null) with orNull >

[jira] [Resolved] (SPARK-39196) Replace getOrElse(null) with orNull

[ https://issues.apache.org/jira/browse/SPARK-39196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39196. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36567

[jira] [Updated] (SPARK-39196) Replace getOrElse(null) with orNull

[ https://issues.apache.org/jira/browse/SPARK-39196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39196: - Priority: Trivial (was: Major) > Replace getOrElse(null) with orNull >

[jira] [Resolved] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

[ https://issues.apache.org/jira/browse/SPARK-39183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39183. -- Assignee: Bjørn Jørgensen Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

[ https://issues.apache.org/jira/browse/SPARK-39183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39183: - Fix Version/s: 3.2.2 3.4.0 3.3.1 Affects

[jira] [Resolved] (SPARK-39147) Code simplification, use count() instead of filter().size, etc.

[ https://issues.apache.org/jira/browse/SPARK-39147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39147. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36507

[jira] [Assigned] (SPARK-39147) Code simplification, use count() instead of filter().size, etc.

[ https://issues.apache.org/jira/browse/SPARK-39147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39147: Assignee: morvenhuang > Code simplification, use count() instead of filter().size, etc.

[jira] [Resolved] (SPARK-39137) Use slice instead of take and drop

[ https://issues.apache.org/jira/browse/SPARK-39137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39137. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36494

[jira] [Assigned] (SPARK-39137) Use slice instead of take and drop

[ https://issues.apache.org/jira/browse/SPARK-39137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39137: Assignee: Yang Jie > Use slice instead of take and drop >

[jira] [Updated] (SPARK-39107) Silent change in regexp_replace's handling of empty strings

[ https://issues.apache.org/jira/browse/SPARK-39107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39107: - Labels: correctness release-notes (was: correctness) > Silent change in regexp_replace's

[jira] [Assigned] (SPARK-39107) Silent change in regexp_replace's handling of empty strings

[ https://issues.apache.org/jira/browse/SPARK-39107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39107: Assignee: Lorenzo Martini > Silent change in regexp_replace's handling of empty strings

[jira] [Resolved] (SPARK-39107) Silent change in regexp_replace's handling of empty strings

[ https://issues.apache.org/jira/browse/SPARK-39107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39107. -- Fix Version/s: 3.3.0 3.2.2 3.1.3 Resolution:

[jira] [Resolved] (SPARK-39110) Add metrics properties to Environment page

[ https://issues.apache.org/jira/browse/SPARK-39110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39110. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36462

[jira] [Assigned] (SPARK-39110) Add metrics properties to Environment page

[ https://issues.apache.org/jira/browse/SPARK-39110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39110: Assignee: angerszhu > Add metrics properties to Environment page >

[jira] [Assigned] (SPARK-39083) Fix FsHistoryProvider race condition between update and clean app data

[ https://issues.apache.org/jira/browse/SPARK-39083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39083: Assignee: Vu Tan > Fix FsHistoryProvider race condition between update and clean app

[jira] [Resolved] (SPARK-39083) Fix FsHistoryProvider race condition between update and clean app data

[ https://issues.apache.org/jira/browse/SPARK-39083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39083. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-39113) rename self to cls in python/pyspark/mllib/clustering.py

[ https://issues.apache.org/jira/browse/SPARK-39113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39113: - Priority: Trivial (was: Major) > rename self to cls in python/pyspark/mllib/clustering.py >

[jira] [Resolved] (SPARK-39113) rename self to cls in python/pyspark/mllib/clustering.py

[ https://issues.apache.org/jira/browse/SPARK-39113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39113. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36465

[jira] [Resolved] (SPARK-39111) Mark overriden methods with `@override` annotation

[ https://issues.apache.org/jira/browse/SPARK-39111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39111. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36461

[jira] [Assigned] (SPARK-39111) Mark overriden methods with `@override` annotation

[ https://issues.apache.org/jira/browse/SPARK-39111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39111: Assignee: qian > Mark overriden methods with `@override` annotation >

[jira] [Resolved] (SPARK-30661) KMeans blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30661. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36437

[jira] [Resolved] (SPARK-39067) Upgrade scala-maven-plugin to 4.6.1

[ https://issues.apache.org/jira/browse/SPARK-39067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39067. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36406

[jira] [Assigned] (SPARK-39067) Upgrade scala-maven-plugin to 4.6.1

[ https://issues.apache.org/jira/browse/SPARK-39067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39067: Assignee: Yang Jie > Upgrade scala-maven-plugin to 4.6.1 >

[jira] [Updated] (SPARK-39067) Upgrade scala-maven-plugin to 4.6.1

[ https://issues.apache.org/jira/browse/SPARK-39067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39067: - Priority: Trivial (was: Minor) > Upgrade scala-maven-plugin to 4.6.1 >

[jira] [Resolved] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35739. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36343

[jira] [Assigned] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-35739: Assignee: Brandon Dahler > [Spark Sql] Add Java-comptable Dataset.join overloads >

[jira] [Resolved] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38896. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36237

[jira] [Assigned] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38896: Assignee: Yang Jie > Use tryWithResource to recycling KVStoreIterator >

[jira] [Assigned] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39042: Assignee: Yang Jie > Use `Map.values()` instead of `Map.entrySet()` in scenarios that do

[jira] [Updated] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39042: - Priority: Trivial (was: Minor) > Use `Map.values()` instead of `Map.entrySet()` in scenarios

[jira] [Resolved] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39042. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36372

[jira] [Resolved] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39056. -- Resolution: Won't Fix > Use `Collections.singletonList` instead of `Arrays.asList` when

[jira] [Assigned] (SPARK-38979) Improve error log readability in OrcUtils.requestedColumnIds

[ https://issues.apache.org/jira/browse/SPARK-38979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38979: Assignee: dzcxzl > Improve error log readability in OrcUtils.requestedColumnIds >

[jira] [Resolved] (SPARK-38979) Improve error log readability in OrcUtils.requestedColumnIds

[ https://issues.apache.org/jira/browse/SPARK-38979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38979. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36296

[jira] [Resolved] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39016. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36349

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39016: Assignee: Yang Jie > Fix compilation warnings related to "`enum` will become a keyword

[jira] [Resolved] (SPARK-38944) Close `NioBufferedFileInputStream` opened by `ExternalAppendOnlyUnsafeRowArraySuite`

[ https://issues.apache.org/jira/browse/SPARK-38944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38944. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36262

[jira] [Assigned] (SPARK-38944) Close `NioBufferedFileInputStream` opened by `ExternalAppendOnlyUnsafeRowArraySuite`

[ https://issues.apache.org/jira/browse/SPARK-38944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38944: Assignee: Yang Jie > Close `NioBufferedFileInputStream` opened by >

[jira] [Resolved] (SPARK-39009) Spark Log4j vul - CVE-2021-44228

[ https://issues.apache.org/jira/browse/SPARK-39009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39009. -- Resolution: Duplicate https://issues.apache.org/jira/browse/SPARK-6305 But this is not how to

[jira] [Assigned] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38968: Assignee: qian > remove hadoopConf from KerberosConfDriverFeatureStep >

[jira] [Updated] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38968: - Priority: Trivial (was: Minor) > remove hadoopConf from KerberosConfDriverFeatureStep >

[jira] [Resolved] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38968. -- Resolution: Fixed Issue resolved by pull request 36283

[jira] [Assigned] (SPARK-38910) Clean sparkStaging dir should before unregister()

[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38910: Assignee: angerszhu > Clean sparkStaging dir should before unregister() >

[jira] [Updated] (SPARK-38910) Clean sparkStaging dir should before unregister()

[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38910: - Priority: Minor (was: Major) > Clean sparkStaging dir should before unregister() >

[jira] [Resolved] (SPARK-38910) Clean sparkStaging dir should before unregister()

[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38910. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36207

[jira] [Resolved] (SPARK-38885) Upgrade netty to 4.1.76

[ https://issues.apache.org/jira/browse/SPARK-38885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38885. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36173

[jira] [Assigned] (SPARK-38885) Upgrade netty to 4.1.76

[ https://issues.apache.org/jira/browse/SPARK-38885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38885: Assignee: Yang Jie > Upgrade netty to 4.1.76 > --- > >

[jira] [Commented] (SPARK-38816) Wrong comment in random matrix generator in spark-als algorithm

[ https://issues.apache.org/jira/browse/SPARK-38816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523711#comment-17523711 ] Sean R. Owen commented on SPARK-38816: -- Hm, you're right, I didn't see that before. The blocks are

[jira] [Commented] (SPARK-38816) Wrong comment in random matrix generator in spark-als algorithm

[ https://issues.apache.org/jira/browse/SPARK-38816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523669#comment-17523669 ] Sean R. Owen commented on SPARK-38816: -- I don't think so - ALS doesn't need nonnegative weights. It

[jira] [Assigned] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38826: Assignee: morvenhuang > dropFieldIfAllNull option does not work for empty JSON struct >

[jira] [Resolved] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38826. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36111

[jira] [Commented] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523358#comment-17523358 ] Sean R. Owen commented on SPARK-38826: -- Yeah I guess we can at least update the docs; I'm unclear

[jira] [Resolved] (SPARK-38640) NPE with unpersisting memory-only RDD with RDD fetching from shuffle service enabled

[ https://issues.apache.org/jira/browse/SPARK-38640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38640. -- Fix Version/s: 3.3.0 Assignee: Adam Binford Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-38881) PySpark Kinesis Streaming should expose metricsLevel CloudWatch config that is already supported in the Scala/Java APIs

[ https://issues.apache.org/jira/browse/SPARK-38881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38881. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36201

[jira] [Assigned] (SPARK-38881) PySpark Kinesis Streaming should expose metricsLevel CloudWatch config that is already supported in the Scala/Java APIs

[ https://issues.apache.org/jira/browse/SPARK-38881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38881: Assignee: Mark Khaitman > PySpark Kinesis Streaming should expose metricsLevel

[jira] [Commented] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523261#comment-17523261 ] Sean R. Owen commented on SPARK-38826: -- Ah right it was there inline in the code. I think there is

[jira] [Resolved] (SPARK-38077) Spark 3.2.1 breaks binary compatibility with Spark 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-38077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38077. -- Resolution: Won't Fix > Spark 3.2.1 breaks binary compatibility with Spark 3.2.0 >

[jira] [Commented] (SPARK-38077) Spark 3.2.1 breaks binary compatibility with Spark 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-38077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523227#comment-17523227 ] Sean R. Owen commented on SPARK-38077: -- Binary and source compatibility for public APIs should be

[jira] [Resolved] (SPARK-38152) Upgrade Jetty version from 9.4.40 to 9.4.44

[ https://issues.apache.org/jira/browse/SPARK-38152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38152. -- Resolution: Duplicate We already have a ticket for 9.4.46 > Upgrade Jetty version from

[jira] [Resolved] (SPARK-38262) Upgrade Google guava to version 30.0-jre

[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38262. -- Resolution: Duplicate yes, this is a duplicate. Been discussed many times. > Upgrade Google

[jira] [Resolved] (SPARK-38248) Add @nowarn to suppress warnings related to Serializable interface

[ https://issues.apache.org/jira/browse/SPARK-38248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38248. -- Resolution: Not A Problem > Add @nowarn to suppress warnings related to Serializable

[jira] [Resolved] (SPARK-38263) StructType explode

[ https://issues.apache.org/jira/browse/SPARK-38263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38263. -- Resolution: Not A Problem You can already use 'select mystruct.*' to turn the fields into

[jira] [Resolved] (SPARK-38313) Remove deprecated logic in SortMergeJoinExec

[ https://issues.apache.org/jira/browse/SPARK-38313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38313. -- Resolution: Not A Problem > Remove deprecated logic in SortMergeJoinExec >

[jira] [Resolved] (SPARK-38329) High I/O wait when Spark Structured Streaming checkpoint changed to EFS

[ https://issues.apache.org/jira/browse/SPARK-38329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38329. -- Resolution: Not A Problem > High I/O wait when Spark Structured Streaming checkpoint changed

[jira] [Resolved] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38330. -- Resolution: Not A Problem > Certificate doesn't match any of the subject alternative names:

[jira] [Commented] (SPARK-38409) PrometheusServlet exports gauges with null values

[ https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523222#comment-17523222 ] Sean R. Owen commented on SPARK-38409: -- Yep, can you open a PR? > PrometheusServlet exports gauges

[jira] [Resolved] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

[ https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38340. -- Resolution: Won't Fix > Upgrade protobuf-java from 2.5.0 to 3.16.1 >

[jira] [Resolved] (SPARK-38421) Cipher Block Chaining IVs should be unpredictable

[ https://issues.apache.org/jira/browse/SPARK-38421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38421. -- Resolution: Not A Problem Just not clear you've argued there is a problem here w.r.t Spark's

[jira] [Commented] (SPARK-38422) Encryption algorithms should be used with secure mode and padding scheme

[ https://issues.apache.org/jira/browse/SPARK-38422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523220#comment-17523220 ] Sean R. Owen commented on SPARK-38422: -- This may be a good argument in general, but we're talking

[jira] [Resolved] (SPARK-38439) Add Braces with if,else,for,do and while statements

[ https://issues.apache.org/jira/browse/SPARK-38439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38439. -- Resolution: Won't Fix > Add Braces with if,else,for,do and while statements >

[jira] [Commented] (SPARK-38485) Non-deterministic UDF executed multiple times when combined with withField

[ https://issues.apache.org/jira/browse/SPARK-38485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523209#comment-17523209 ] Sean R. Owen commented on SPARK-38485: -- I don't think there are guarantees about the number of

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523208#comment-17523208 ] Sean R. Owen commented on SPARK-38536: -- 3.0.x is EOL; 3.1.x is not, but I'm not clear whether it's

[jira] [Resolved] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38536. -- Resolution: Duplicate > Spark 3 can not read mixed format partitions >

[jira] [Commented] (SPARK-38649) Fix SECURITY.md

[ https://issues.apache.org/jira/browse/SPARK-38649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523207#comment-17523207 ] Sean R. Owen commented on SPARK-38649: -- That is documentation for Spark, about securing Spark. The

[jira] [Resolved] (SPARK-38649) Fix SECURITY.md

[ https://issues.apache.org/jira/browse/SPARK-38649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38649. -- Resolution: Not A Problem > Fix SECURITY.md > --- > > Key:

[jira] [Commented] (SPARK-38693) Spark does not use SessionManager

[ https://issues.apache.org/jira/browse/SPARK-38693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523206#comment-17523206 ] Sean R. Owen commented on SPARK-38693: -- Just to back up - what is keycloak and why should it be

[jira] [Resolved] (SPARK-38703) High GC and memory footprint after switch to ZSTD

[ https://issues.apache.org/jira/browse/SPARK-38703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38703. -- Resolution: Invalid I'd put questions on the mailing list. Desipte the "Question" type here,

[jira] [Resolved] (SPARK-38712) Fix perf regression in ScanOperation

[ https://issues.apache.org/jira/browse/SPARK-38712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38712. -- Resolution: Duplicate > Fix perf regression in ScanOperation >

[jira] [Updated] (SPARK-38784) Upgrade Jetty to 9.4.46

[ https://issues.apache.org/jira/browse/SPARK-38784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38784: - Summary: Upgrade Jetty to 9.4.46 (was: Upgrade Jetty to 9.4.45) > Upgrade Jetty to 9.4.46 >

[jira] [Updated] (SPARK-38784) Upgrade Jetty to 9.4.45

[ https://issues.apache.org/jira/browse/SPARK-38784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38784: - Issue Type: Task (was: Bug) Priority: Minor (was: Major) > Upgrade Jetty to 9.4.45 >

<    4   5   6   7   8   9   10   11   12   13   >