[jira] [Resolved] (SPARK-38433) Add Shell Code Style Check Action

[ https://issues.apache.org/jira/browse/SPARK-38433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38433. -- Resolution: Won't Fix > Add Shell Code Style Check Action > -

[jira] [Updated] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40552: - Priority: Minor (was: Major) > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Resolved] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40552. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37991

[jira] [Updated] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40552: - Component/s: Build > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Assigned] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40552: Assignee: Bjørn Jørgensen > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Resolved] (SPARK-40478) Add create datasource table options docs

[ https://issues.apache.org/jira/browse/SPARK-40478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40478. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37919

[jira] [Assigned] (SPARK-40478) Add create datasource table options docs

[ https://issues.apache.org/jira/browse/SPARK-40478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40478: Assignee: XiDuo You > Add create datasource table options docs >

[jira] [Updated] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40142: - Priority: Minor (was: Major) > Make pyspark.sql.functions examples self-contained >

[jira] [Resolved] (SPARK-40476) Reduce the shuffle size of ALS

[ https://issues.apache.org/jira/browse/SPARK-40476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40476. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37918

[jira] [Assigned] (SPARK-40476) Reduce the shuffle size of ALS

[ https://issues.apache.org/jira/browse/SPARK-40476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40476: Assignee: Ruifeng Zheng > Reduce the shuffle size of ALS >

[jira] [Updated] (SPARK-40175) Converting Tuple2 to Scala Map via `.toMap` is slow

[ https://issues.apache.org/jira/browse/SPARK-40175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40175: - Priority: Minor (was: Major) > Converting Tuple2 to Scala Map via `.toMap` is slow >

[jira] [Updated] (SPARK-40491) Remove too old TODO for JdbcRDD

[ https://issues.apache.org/jira/browse/SPARK-40491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40491: - Issue Type: Task (was: New Feature) Priority: Trivial (was: Major) This didn't need a

[jira] [Updated] (SPARK-40456) PartitionIterator.hasNext should be cheap to call repeatedly

[ https://issues.apache.org/jira/browse/SPARK-40456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40456: - Priority: Minor (was: Major) > PartitionIterator.hasNext should be cheap to call repeatedly >

[jira] [Resolved] (SPARK-40294) Repeat calls to `PartitionIterator.hasNext` can timeout

[ https://issues.apache.org/jira/browse/SPARK-40294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40294. -- Resolution: Duplicate > Repeat calls to `PartitionIterator.hasNext` can timeout >

[jira] [Resolved] (SPARK-40398) Use Loop instead of Arrays.stream api

[ https://issues.apache.org/jira/browse/SPARK-40398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40398. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37843

[jira] [Assigned] (SPARK-40398) Use Loop instead of Arrays.stream api

[ https://issues.apache.org/jira/browse/SPARK-40398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40398: Assignee: Yang Jie > Use Loop instead of Arrays.stream api >

[jira] [Assigned] (SPARK-40376) `np.bool` will be deprecated

[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40376: Assignee: Elhoussine Talab > `np.bool` will be deprecated >

[jira] [Resolved] (SPARK-40376) `np.bool` will be deprecated

[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40376. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37817

[jira] [Resolved] (SPARK-40331) Java 11 should be used as the recommended running environment

[ https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40331. -- Resolution: Won't Fix > Java 11 should be used as the recommended running environment >

[jira] [Updated] (SPARK-40376) `np.bool` will be deprecated

[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40376: - Issue Type: Improvement (was: Bug) Priority: Trivial (was: Major) This is not a bug >

[jira] [Resolved] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

[ https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40326. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

[ https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40326: - Priority: Minor (was: Major) > upgrade

[jira] [Assigned] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

[ https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40326: Assignee: Bjørn Jørgensen > upgrade

[jira] [Assigned] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40321: Assignee: Yang Jie > Upgrade rocksdbjni to 7.5.3 > --- > >

[jira] [Resolved] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40321. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37783

[jira] [Assigned] (SPARK-39996) Upgrade postgresql to 42.5.0

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39996: Assignee: Bjørn Jørgensen > Upgrade postgresql to 42.5.0 >

[jira] [Resolved] (SPARK-39996) Upgrade postgresql to 42.5.0

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39996. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37762

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.5.0

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39996: - Component/s: Tests > Upgrade postgresql to 42.5.0 > > >

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.5.0

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39996: - Priority: Minor (was: Major) > Upgrade postgresql to 42.5.0 > > >

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599960#comment-17599960 ] Sean R. Owen commented on SPARK-40316: -- It's possible this was handled differently in earlier

[jira] [Resolved] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40316. -- Resolution: Not A Problem > Upgrading to Spark 3 is giving NullPointerException >

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599930#comment-17599930 ] Sean R. Owen commented on SPARK-40316: -- This says your UDF returns a Seq containing null, but the

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599629#comment-17599629 ] Sean R. Owen commented on SPARK-40316: -- There's no info about what you're doing that triggers this,

[jira] [Resolved] (SPARK-40251) Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2

[ https://issues.apache.org/jira/browse/SPARK-40251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40251. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37700

[jira] [Assigned] (SPARK-40251) Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2

[ https://issues.apache.org/jira/browse/SPARK-40251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40251: Assignee: BingKun Pan > Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2 >

[jira] [Assigned] (SPARK-40279) Document spark.yarn.report.interval

[ https://issues.apache.org/jira/browse/SPARK-40279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40279: Assignee: Luca Canali > Document spark.yarn.report.interval >

[jira] [Resolved] (SPARK-40279) Document spark.yarn.report.interval

[ https://issues.apache.org/jira/browse/SPARK-40279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40279. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37731

[jira] [Commented] (SPARK-40286) Load Data from S3 deletes data source file

[ https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598574#comment-17598574 ] Sean R. Owen commented on SPARK-40286: -- I could be completely wrong, but then I'd be quite as

[jira] [Commented] (SPARK-40286) Load Data from S3 deletes data source file

[ https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598568#comment-17598568 ] Sean R. Owen commented on SPARK-40286: -- No, LOAD DATA does not delete source data. I'm not sure

[jira] [Resolved] (SPARK-39916) Merge SchemaUtils from mlib to SQL

[ https://issues.apache.org/jira/browse/SPARK-39916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39916. -- Resolution: Won't Fix > Merge SchemaUtils from mlib to SQL >

[jira] [Resolved] (SPARK-39269) spark3.2.0 commit tmp file is not found when rename

[ https://issues.apache.org/jira/browse/SPARK-39269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39269. -- Resolution: Invalid > spark3.2.0 commit tmp file is not found when rename >

[jira] [Commented] (SPARK-40233) Unable to load large pandas dataframe to pyspark

[ https://issues.apache.org/jira/browse/SPARK-40233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598550#comment-17598550 ] Sean R. Owen commented on SPARK-40233: -- That's what happens, right? Spark is of course meant to

[jira] [Commented] (SPARK-39895) pyspark drop doesn't accept *cols

[ https://issues.apache.org/jira/browse/SPARK-39895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598545#comment-17598545 ] Sean R. Owen commented on SPARK-39895: -- Not a big deal, but the example doesn't make sense to me.

[jira] [Commented] (SPARK-40286) Load Data from S3 deletes data source file

[ https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598542#comment-17598542 ] Sean R. Owen commented on SPARK-40286: -- Where is src stored? LOAD DATA should not affect the

[jira] [Commented] (SPARK-39948) exclude velocity 1.5 jar

[ https://issues.apache.org/jira/browse/SPARK-39948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598540#comment-17598540 ] Sean R. Owen commented on SPARK-39948: -- Do any of them affect Spark? > exclude velocity 1.5 jar >

[jira] [Commented] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

[ https://issues.apache.org/jira/browse/SPARK-39995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598539#comment-17598539 ] Sean R. Owen commented on SPARK-39995: -- Would scala version generally matter to python users who

[jira] [Resolved] (SPARK-40023) Issue with Spark Core version 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-40023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40023. -- Resolution: Invalid > Issue with Spark Core version 3.3.0 >

[jira] [Resolved] (SPARK-40122) py4j-0.10.9.5 often produces "Connection reset by peer" in Spark 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-40122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40122. -- Resolution: Invalid This itself doesn't mean anything - means the Python process died. It'd

[jira] [Commented] (SPARK-40123) Security Vulnerability CVE-2018-11793 due to mesos-1.4.3-shaded-protobuf.jar

[ https://issues.apache.org/jira/browse/SPARK-40123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598536#comment-17598536 ] Sean R. Owen commented on SPARK-40123: -- Mesos is deprecated, but, if you want you can open a PR to

[jira] [Resolved] (SPARK-40126) Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

[ https://issues.apache.org/jira/browse/SPARK-40126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40126. -- Resolution: Invalid > Security scanning spark v3.3.0 docker image results in DSA-5169-1

[jira] [Commented] (SPARK-40126) Security scanning spark v3.3.0 docker image results in DSA-5169-1 critical vulnerability

[ https://issues.apache.org/jira/browse/SPARK-40126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598534#comment-17598534 ] Sean R. Owen commented on SPARK-40126: -- This isn't part of Spark. You're looking at some

[jira] [Resolved] (SPARK-40170) StringCoding UTF8 decode slowly

[ https://issues.apache.org/jira/browse/SPARK-40170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40170. -- Resolution: Invalid > StringCoding UTF8 decode slowly > --- > >

[jira] [Commented] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598532#comment-17598532 ] Sean R. Owen commented on SPARK-40200: -- I can't make out what this is reporting, please start over

[jira] [Resolved] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40200. -- Resolution: Invalid > unpersist cascades with Kryo, MEMORY_AND_DISK_SER and >

[jira] [Resolved] (SPARK-40232) KMeans: high variability in results despite high initSteps parameter value

[ https://issues.apache.org/jira/browse/SPARK-40232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40232. -- Resolution: Not A Problem No, initSteps controls an aspect of the initialization. I don't

[jira] [Resolved] (SPARK-40233) Unable to load large pandas dataframe to pyspark

[ https://issues.apache.org/jira/browse/SPARK-40233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40233. -- Resolution: Not A Problem > Unable to load large pandas dataframe to pyspark >

[jira] [Commented] (SPARK-40233) Unable to load large pandas dataframe to pyspark

[ https://issues.apache.org/jira/browse/SPARK-40233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598524#comment-17598524 ] Sean R. Owen commented on SPARK-40233: -- This is more a problem with trying send a huge amount of

[jira] [Updated] (SPARK-40237) Can't get JDBC type for map in Spark 3.3.0 and PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-40237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40237: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Can't get JDBC type

[jira] [Commented] (SPARK-40274) ArrayIndexOutOfBoundsException in BytecodeReadingParanamer

[ https://issues.apache.org/jira/browse/SPARK-40274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598522#comment-17598522 ] Sean R. Owen commented on SPARK-40274: -- Yes, it is at least not clear it's due to you using a

[jira] [Resolved] (SPARK-40277) Use DataFrame's column for referring to DDL schema for from_csv() and from_json()

[ https://issues.apache.org/jira/browse/SPARK-40277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40277. -- Resolution: Invalid This doesn't state any problem or specific change > Use DataFrame's

[jira] [Resolved] (SPARK-40282) DataType argument in StructType.add is incorrectly throwing scala.MatchError

[ https://issues.apache.org/jira/browse/SPARK-40282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40282. -- Resolution: Not A Problem > DataType argument in StructType.add is incorrectly throwing

[jira] [Commented] (SPARK-40282) DataType argument in StructType.add is incorrectly throwing scala.MatchError

[ https://issues.apache.org/jira/browse/SPARK-40282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598515#comment-17598515 ] Sean R. Owen commented on SPARK-40282: -- Try just IntegerType (no parens) as in Scala; otherwise

[jira] [Commented] (SPARK-40284) spark concurrent overwrite mode writes data to files in HDFS format, all request data write success

[ https://issues.apache.org/jira/browse/SPARK-40284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598511#comment-17598511 ] Sean R. Owen commented on SPARK-40284: -- You have a race condition where two requests try to delete

[jira] [Updated] (SPARK-40285) Simplify the roundTo[Numeric] for Decimal

[ https://issues.apache.org/jira/browse/SPARK-40285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40285: - Priority: Minor (was: Major) > Simplify the roundTo[Numeric] for Decimal >

[jira] [Commented] (SPARK-40286) Load Data from S3 deletes data source file

[ https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598510#comment-17598510 ] Sean R. Owen commented on SPARK-40286: -- There is no delete here. Why do you think Spark is deleting

[jira] [Resolved] (SPARK-40290) Uncatchable exceptions in SparkSession Java API

[ https://issues.apache.org/jira/browse/SPARK-40290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40290. -- Resolution: Won't Fix > Uncatchable exceptions in SparkSession Java API >

[jira] [Commented] (SPARK-40290) Uncatchable exceptions in SparkSession Java API

[ https://issues.apache.org/jira/browse/SPARK-40290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598506#comment-17598506 ] Sean R. Owen commented on SPARK-40290: -- It doesn't make sense to consider it a RuntimeException.

[jira] [Resolved] (SPARK-39708) ALS Model Loading

[ https://issues.apache.org/jira/browse/SPARK-39708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39708. -- Resolution: Not A Problem > ALS Model Loading > - > > Key:

[jira] [Assigned] (SPARK-40252) Replace `Stream.collect(Collectors.joining(delimiter))` with `StringJoiner` Api

[ https://issues.apache.org/jira/browse/SPARK-40252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40252: Assignee: Yang Jie > Replace `Stream.collect(Collectors.joining(delimiter))` with

[jira] [Resolved] (SPARK-40252) Replace `Stream.collect(Collectors.joining(delimiter))` with `StringJoiner` Api

[ https://issues.apache.org/jira/browse/SPARK-40252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40252. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37701

[jira] [Resolved] (SPARK-40192) Remove redundant groupby

[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40192. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37628

[jira] [Assigned] (SPARK-40192) Remove redundant groupby

[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40192: Assignee: deshanxiao > Remove redundant groupby > > >

[jira] [Updated] (SPARK-40192) Remove redundant groupby

[ https://issues.apache.org/jira/browse/SPARK-40192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40192: - Priority: Trivial (was: Minor) > Remove redundant groupby > > >

[jira] [Resolved] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40152. -- Fix Version/s: 3.4.0 3.3.1 Assignee: Yuming Wang

[jira] [Resolved] (SPARK-40163) [SPARK][SQL] feat: SparkSession.confing(Map)

[ https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40163. -- Fix Version/s: 3.4.0 Assignee: seunggabi Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40162) Upgrade RoaringBitmap from 0.9.30 to 0.9.31

[ https://issues.apache.org/jira/browse/SPARK-40162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40162. -- Assignee: BingKun Pan Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40165) Update test plugins to latest versions

[ https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40165. -- Assignee: BingKun Pan Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-40165) Update test plugins to latest versions

[ https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40165: - Priority: Trivial (was: Minor) > Update test plugins to latest versions >

[jira] [Resolved] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39975. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

[ https://issues.apache.org/jira/browse/SPARK-40132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40132. -- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Resolved by

[jira] [Created] (SPARK-40132) MultilayerPerceptronClassifier rawPredictionCol param missing from setParams

Sean R. Owen created SPARK-40132: Summary: MultilayerPerceptronClassifier rawPredictionCol param missing from setParams Key: SPARK-40132 URL: https://issues.apache.org/jira/browse/SPARK-40132

[jira] [Resolved] (SPARK-36511) Remove ColumnIO once PARQUET-2050 is released in Parquet 1.13

[ https://issues.apache.org/jira/browse/SPARK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36511. -- Fix Version/s: 3.4.0 Assignee: BingKun Pan Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40036) LevelDB/RocksDBIterator.next should return false after iterator or db close

[ https://issues.apache.org/jira/browse/SPARK-40036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40036. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40042) Make pyspark.sql.streaming.query examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40042. -- Fix Version/s: 3.4.0 Assignee: Qian Sun Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-40042) Make pyspark.sql.streaming.query examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40042: - Priority: Minor (was: Major) > Make pyspark.sql.streaming.query examples self-contained >

[jira] [Resolved] (SPARK-40009) Add missing doc string info to DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40009. -- Fix Version/s: 3.4.0 Assignee: Khalid Mammadov Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-40058) Avoid filter twice in HadoopFSUtils

[ https://issues.apache.org/jira/browse/SPARK-40058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40058: Assignee: ZiyueGuan > Avoid filter twice in HadoopFSUtils >

[jira] [Resolved] (SPARK-40058) Avoid filter twice in HadoopFSUtils

[ https://issues.apache.org/jira/browse/SPARK-40058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40058. -- Fix Version/s: 3.4.0 Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40035) Avoid apply filter twice when listing files

[ https://issues.apache.org/jira/browse/SPARK-40035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40035. -- Resolution: Duplicate > Avoid apply filter twice when listing files >

[jira] [Resolved] (SPARK-39982) StructType.fromJson method missing documentation

[ https://issues.apache.org/jira/browse/SPARK-39982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39982. -- Fix Version/s: 3.4.0 Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-39982) StructType.fromJson method missing documentation

[ https://issues.apache.org/jira/browse/SPARK-39982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39982: Assignee: Khalid Mammadov > StructType.fromJson method missing documentation >

[jira] [Assigned] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40072: Assignee: YUBI LEE Issue Type: Improvement (was: Bug) > MAVEN_OPTS in

[jira] [Resolved] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40072. -- Fix Version/s: 3.4.0 Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40071) Update plugins to latest versions

[ https://issues.apache.org/jira/browse/SPARK-40071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40071. -- Assignee: BingKun Pan Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40037) Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40037. -- Fix Version/s: 3.4.0 Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-40037) Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40037: - Priority: Minor (was: Major) > Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0 >

[jira] [Assigned] (SPARK-40037) Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-40037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40037: Assignee: Bjørn Jørgensen > Upgrade com.google.crypto.tink:tink from 1.6.1 to 1.7.0 >

[jira] [Assigned] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40056: Assignee: BingKun Pan > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9 >

[jira] [Updated] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40056: - Priority: Trivial (was: Minor) > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9 >

[jira] [Resolved] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40056. -- Resolution: Fixed Issue resolved by pull request 37489

<    2   3   4   5   6   7   8   9   10   11   >