[jira] [Assigned] (SPARK-39767) Remove UnresolvedDBObjectName and add UnresolvedIdentifier

[ https://issues.apache.org/jira/browse/SPARK-39767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39767: --- Assignee: Wenchen Fan > Remove UnresolvedDBObjectName and add UnresolvedIdentifier >

[jira] [Resolved] (SPARK-39767) Remove UnresolvedDBObjectName and add UnresolvedIdentifier

[ https://issues.apache.org/jira/browse/SPARK-39767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39767. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37178

[jira] [Resolved] (SPARK-39672) NotExists subquery failed with conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-39672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39672. - Fix Version/s: 3.3.1 3.2.2 3.1.4 3.4.0

[jira] [Assigned] (SPARK-39672) NotExists subquery failed with conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-39672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39672: --- Assignee: Manu Zhang > NotExists subquery failed with conflicting attributes >

[jira] [Commented] (SPARK-39748) Include the origin logical plan for LogicalRDD if it comes from DataFrame

[ https://issues.apache.org/jira/browse/SPARK-39748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566625#comment-17566625 ] Apache Spark commented on SPARK-39748: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-39773) Update document of JDBC options for pushDownOffset

[ https://issues.apache.org/jira/browse/SPARK-39773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39773: Assignee: (was: Apache Spark) > Update document of JDBC options for pushDownOffset >

[jira] [Assigned] (SPARK-39773) Update document of JDBC options for pushDownOffset

[ https://issues.apache.org/jira/browse/SPARK-39773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39773: Assignee: Apache Spark > Update document of JDBC options for pushDownOffset >

[jira] [Commented] (SPARK-39773) Update document of JDBC options for pushDownOffset

[ https://issues.apache.org/jira/browse/SPARK-39773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566623#comment-17566623 ] Apache Spark commented on SPARK-39773: -- User 'beliefer' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-39774) [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion

[ https://issues.apache.org/jira/browse/SPARK-39774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566622#comment-17566622 ] melin edited comment on SPARK-39774 at 7/14/22 3:26 AM: {code:java} create table

[jira] [Commented] (SPARK-39774) [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion

[ https://issues.apache.org/jira/browse/SPARK-39774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566622#comment-17566622 ] melin commented on SPARK-39774: --- {code:java} create table tpcds_2g_parquet.reason; CREATE TABLE

[jira] [Updated] (SPARK-39774) [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion

[ https://issues.apache.org/jira/browse/SPARK-39774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-39774: -- Attachment: image-2022-07-14-11-24-24-247.png > [BUG] char(n) type cannot be directly compared with string

[jira] [Updated] (SPARK-39774) [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion

[ https://issues.apache.org/jira/browse/SPARK-39774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-39774: -- Attachment: image-2022-07-14-11-23-15-606.png > [BUG] char(n) type cannot be directly compared with string

[jira] [Created] (SPARK-39774) [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion

melin created SPARK-39774: - Summary: [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion Key: SPARK-39774 URL:

[jira] [Assigned] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39766: Assignee: Apache Spark > For the `arrayOfAnyAsSeq` scenario in

[jira] [Commented] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566592#comment-17566592 ] Apache Spark commented on SPARK-39766: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566591#comment-17566591 ] Apache Spark commented on SPARK-39766: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39766: Assignee: (was: Apache Spark) > For the `arrayOfAnyAsSeq` scenario in

[jira] [Created] (SPARK-39773) Update document of JDBC options for pushDownOffset

jiaan.geng created SPARK-39773: -- Summary: Update document of JDBC options for pushDownOffset Key: SPARK-39773 URL: https://issues.apache.org/jira/browse/SPARK-39773 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39772) namespace should not conatin null to avoid potential serde problem

[ https://issues.apache.org/jira/browse/SPARK-39772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39772: Assignee: Apache Spark > namespace should not conatin null to avoid potential serde

[jira] [Assigned] (SPARK-39772) namespace should not conatin null to avoid potential serde problem

[ https://issues.apache.org/jira/browse/SPARK-39772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39772: Assignee: (was: Apache Spark) > namespace should not conatin null to avoid potential

[jira] [Commented] (SPARK-39772) namespace should not conatin null to avoid potential serde problem

[ https://issues.apache.org/jira/browse/SPARK-39772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566570#comment-17566570 ] Apache Spark commented on SPARK-39772: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-39772) namespace should not conatin null to avoid potential serde problem

Ruifeng Zheng created SPARK-39772: - Summary: namespace should not conatin null to avoid potential serde problem Key: SPARK-39772 URL: https://issues.apache.org/jira/browse/SPARK-39772 Project: Spark

[jira] [Updated] (SPARK-39771) If spark.default.parallelism is unset, RDD defaultPartitioner may pick a value that is too large to successfully run

[ https://issues.apache.org/jira/browse/SPARK-39771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39771: --- Description: [According to its

[jira] [Created] (SPARK-39771) If spark.default.parallelism is unset, RDD defaultPartitioner may pick a value that is too large to successfully run

Josh Rosen created SPARK-39771: -- Summary: If spark.default.parallelism is unset, RDD defaultPartitioner may pick a value that is too large to successfully run Key: SPARK-39771 URL:

[jira] [Commented] (SPARK-39747) pandas and pandas on Spark API parameter naming difference

[ https://issues.apache.org/jira/browse/SPARK-39747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566562#comment-17566562 ] Hyukjin Kwon commented on SPARK-39747: -- the reason is that we don't support buffer for now (since

[jira] [Assigned] (SPARK-39770) Support Avro schema evolution

[ https://issues.apache.org/jira/browse/SPARK-39770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39770: Assignee: Apache Spark > Support Avro schema evolution > - >

[jira] [Assigned] (SPARK-39770) Support Avro schema evolution

[ https://issues.apache.org/jira/browse/SPARK-39770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39770: Assignee: (was: Apache Spark) > Support Avro schema evolution >

[jira] [Commented] (SPARK-39770) Support Avro schema evolution

[ https://issues.apache.org/jira/browse/SPARK-39770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566502#comment-17566502 ] Apache Spark commented on SPARK-39770: -- User 'koertkuipers' has created a pull request for this

[jira] [Created] (SPARK-39770) Support Avro schema evolution

koert kuipers created SPARK-39770: - Summary: Support Avro schema evolution Key: SPARK-39770 URL: https://issues.apache.org/jira/browse/SPARK-39770 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566497#comment-17566497 ] Apache Spark commented on SPARK-39758: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566496#comment-17566496 ] Apache Spark commented on SPARK-39758: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566483#comment-17566483 ] Apache Spark commented on SPARK-39758: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566482#comment-17566482 ] Apache Spark commented on SPARK-39758: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39768) Strip any CRLF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566452#comment-17566452 ] Apache Spark commented on SPARK-39768: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Commented] (SPARK-39768) Strip any CRLF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566451#comment-17566451 ] Apache Spark commented on SPARK-39768: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39768) Strip any CRLF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39768: Assignee: Apache Spark > Strip any CRLF character if lineSep is not set in CSV data

[jira] [Assigned] (SPARK-39768) Strip any CRLF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39768: Assignee: (was: Apache Spark) > Strip any CRLF character if lineSep is not set in

[jira] [Created] (SPARK-39769) Rename trait Unevaluable

Ted Yu created SPARK-39769: -- Summary: Rename trait Unevaluable Key: SPARK-39769 URL: https://issues.apache.org/jira/browse/SPARK-39769 Project: Spark Issue Type: Bug Components: Spark

[jira] [Updated] (SPARK-39768) Strip any CRLF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaohua Zhao updated SPARK-39768: Summary: Strip any CRLF character if lineSep is not set in CSV data source (was: Strip any CLRF

[jira] [Updated] (SPARK-39768) Strip any CRLF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaohua Zhao updated SPARK-39768: Description: If `lineSep` is not set, the line separator is automatically detected. To be safe,

[jira] [Commented] (SPARK-39755) SPARK_LOCAL_DIRS locations are not randomized in K8s

[ https://issues.apache.org/jira/browse/SPARK-39755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566430#comment-17566430 ] pralabhkumar commented on SPARK-39755: -- [~hyukjin.kwon]  , please let me know if the above

[jira] [Commented] (SPARK-39768) Strip any CLRF character if lineSep is not set in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-39768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566417#comment-17566417 ] Yaohua Zhao commented on SPARK-39768: - cc @[~hyukjin.kwon]  > Strip any CLRF character if lineSep

[jira] [Created] (SPARK-39768) Strip any CLRF character if lineSep is not set in CSV data source

Yaohua Zhao created SPARK-39768: --- Summary: Strip any CLRF character if lineSep is not set in CSV data source Key: SPARK-39768 URL: https://issues.apache.org/jira/browse/SPARK-39768 Project: Spark

[jira] [Commented] (SPARK-39767) Remove UnresolvedDBObjectName and add UnresolvedIdentifier

[ https://issues.apache.org/jira/browse/SPARK-39767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566396#comment-17566396 ] Apache Spark commented on SPARK-39767: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39767) Remove UnresolvedDBObjectName and add UnresolvedIdentifier

[ https://issues.apache.org/jira/browse/SPARK-39767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39767: Assignee: (was: Apache Spark) > Remove UnresolvedDBObjectName and add

[jira] [Assigned] (SPARK-39767) Remove UnresolvedDBObjectName and add UnresolvedIdentifier

[ https://issues.apache.org/jira/browse/SPARK-39767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39767: Assignee: Apache Spark > Remove UnresolvedDBObjectName and add UnresolvedIdentifier >

[jira] [Created] (SPARK-39767) Remove UnresolvedDBObjectName and add UnresolvedIdentifier

Wenchen Fan created SPARK-39767: --- Summary: Remove UnresolvedDBObjectName and add UnresolvedIdentifier Key: SPARK-39767 URL: https://issues.apache.org/jira/browse/SPARK-39767 Project: Spark

[jira] [Commented] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566367#comment-17566367 ] Yang Jie commented on SPARK-39766: -- Ok, let me try to fix this. I'm also going to submit an issue to

[jira] [Commented] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566364#comment-17566364 ] Sean R. Owen commented on SPARK-39766: -- How would you rewrite Scala's toArray? you mean write a

[jira] [Updated] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39766: - Priority: Minor (was: Major) > For the `arrayOfAnyAsSeq` scenario in

[jira] [Commented] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566360#comment-17566360 ] Yang Jie commented on SPARK-39766: -- Or should we rewrite `toArray` method in Scala 2.13.x? [~srowen] 

[jira] [Resolved] (SPARK-39751) Better naming for hash aggregate key probing metric

[ https://issues.apache.org/jira/browse/SPARK-39751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39751. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37164

[jira] [Assigned] (SPARK-39751) Better naming for hash aggregate key probing metric

[ https://issues.apache.org/jira/browse/SPARK-39751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39751: --- Assignee: Cheng Su > Better naming for hash aggregate key probing metric >

[jira] [Commented] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566355#comment-17566355 ] Yang Jie commented on SPARK-39766: -- Should we add a new  GenericArrayData for Scala 2.13? Then we can

[jira] [Comment Edited] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566355#comment-17566355 ] Yang Jie edited comment on SPARK-39766 at 7/13/22 2:44 PM: --- Should we add a

[jira] [Commented] (SPARK-39765) Logging the exception of detect jdbc table exist

[ https://issues.apache.org/jira/browse/SPARK-39765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566342#comment-17566342 ] Apache Spark commented on SPARK-39765: -- User 'yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39765) Logging the exception of detect jdbc table exist

[ https://issues.apache.org/jira/browse/SPARK-39765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39765: Assignee: (was: Apache Spark) > Logging the exception of detect jdbc table exist >

[jira] [Assigned] (SPARK-39765) Logging the exception of detect jdbc table exist

[ https://issues.apache.org/jira/browse/SPARK-39765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39765: Assignee: Apache Spark > Logging the exception of detect jdbc table exist >

[jira] [Commented] (SPARK-39765) Logging the exception of detect jdbc table exist

[ https://issues.apache.org/jira/browse/SPARK-39765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566340#comment-17566340 ] Apache Spark commented on SPARK-39765: -- User 'yikf' has created a pull request for this issue:

[jira] [Updated] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39766: - Description: Run `GenericArrayDataBenchmark` with Scala 2.13 and 2.12, for the `arrayOfAnyAsSeq`

[jira] [Created] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

Yang Jie created SPARK-39766: Summary: For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12 Key: SPARK-39766 URL:

[jira] [Updated] (SPARK-39765) Logging the exception of detect jdbc table exist

[ https://issues.apache.org/jira/browse/SPARK-39765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-39765: -- Description: Logging the exception of detect jdbc table exist in `JdbcUtils.tableExists` (was: This

[jira] [Created] (SPARK-39765) Logging the exception of detect jdbc table exist

Yi kaifei created SPARK-39765: - Summary: Logging the exception of detect jdbc table exist Key: SPARK-39765 URL: https://issues.apache.org/jira/browse/SPARK-39765 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39758. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37171

[jira] [Commented] (SPARK-39764) Make PhysicalOperation the same as ScanOperation

[ https://issues.apache.org/jira/browse/SPARK-39764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566302#comment-17566302 ] Apache Spark commented on SPARK-39764: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39764) Make PhysicalOperation the same as ScanOperation

[ https://issues.apache.org/jira/browse/SPARK-39764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39764: Assignee: Apache Spark > Make PhysicalOperation the same as ScanOperation >

[jira] [Assigned] (SPARK-39764) Make PhysicalOperation the same as ScanOperation

[ https://issues.apache.org/jira/browse/SPARK-39764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39764: Assignee: (was: Apache Spark) > Make PhysicalOperation the same as ScanOperation >

[jira] [Created] (SPARK-39764) Make PhysicalOperation the same as ScanOperation

Wenchen Fan created SPARK-39764: --- Summary: Make PhysicalOperation the same as ScanOperation Key: SPARK-39764 URL: https://issues.apache.org/jira/browse/SPARK-39764 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39763) Executor memory footprint substantially increases while reading zstd compressed parquet files

[ https://issues.apache.org/jira/browse/SPARK-39763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-39763: - Description: Hi all,   While transitioning from the default snappy compression to zstd, we

[jira] [Updated] (SPARK-39763) Executor memory footprint substantially increases while reading zstd compressed parquet files

[ https://issues.apache.org/jira/browse/SPARK-39763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-39763: - Description: Hi all,   While transitioning from the default snappy compression to zstd, we

[jira] [Created] (SPARK-39763) Executor memory footprint substantially increases while reading zstd compressed parquet files

Yeachan Park created SPARK-39763: Summary: Executor memory footprint substantially increases while reading zstd compressed parquet files Key: SPARK-39763 URL: https://issues.apache.org/jira/browse/SPARK-39763

[jira] [Resolved] (SPARK-39762) Support numpy 1.23.0 (Remove numpy<1.23.0 version limit)

[ https://issues.apache.org/jira/browse/SPARK-39762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39762. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37175

[jira] [Assigned] (SPARK-39762) Support numpy 1.23.0 (Remove numpy<1.23.0 version limit)

[ https://issues.apache.org/jira/browse/SPARK-39762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39762: Assignee: Yikun Jiang > Support numpy 1.23.0 (Remove numpy<1.23.0 version limit) >

[jira] [Commented] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation

[ https://issues.apache.org/jira/browse/SPARK-39753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566271#comment-17566271 ] Victor Delépine commented on SPARK-39753: - [~yumwang] I'm not too familiar with build side and

[jira] [Commented] (SPARK-39762) Support numpy 1.23.0 (Remove numpy<1.23.0 version limit)

[ https://issues.apache.org/jira/browse/SPARK-39762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566270#comment-17566270 ] Apache Spark commented on SPARK-39762: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39762) Support numpy 1.23.0 (Remove numpy<1.23.0 version limit)

[ https://issues.apache.org/jira/browse/SPARK-39762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39762: Assignee: (was: Apache Spark) > Support numpy 1.23.0 (Remove numpy<1.23.0 version

[jira] [Assigned] (SPARK-39762) Support numpy 1.23.0 (Remove numpy<1.23.0 version limit)

[ https://issues.apache.org/jira/browse/SPARK-39762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39762: Assignee: Apache Spark > Support numpy 1.23.0 (Remove numpy<1.23.0 version limit) >

[jira] [Created] (SPARK-39762) Support numpy 1.23.0 (Remove numpy<1.23.0 version limit)

Yikun Jiang created SPARK-39762: --- Summary: Support numpy 1.23.0 (Remove numpy<1.23.0 version limit) Key: SPARK-39762 URL: https://issues.apache.org/jira/browse/SPARK-39762 Project: Spark Issue

[jira] [Resolved] (SPARK-39757) Upgrade sbt from 1.7.0 to 1.7.1

[ https://issues.apache.org/jira/browse/SPARK-39757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39757. -- Resolution: Fixed Issue resolved by pull request 37170

[jira] [Assigned] (SPARK-39757) Upgrade sbt from 1.7.0 to 1.7.1

[ https://issues.apache.org/jira/browse/SPARK-39757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39757: Assignee: BingKun Pan > Upgrade sbt from 1.7.0 to 1.7.1 >

[jira] [Commented] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566259#comment-17566259 ] Apache Spark commented on SPARK-39761: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566257#comment-17566257 ] Apache Spark commented on SPARK-39761: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39761: Assignee: Apache Spark > Add Apache Spark images info in running-on-kubernetes doc >

[jira] [Assigned] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39761: Assignee: (was: Apache Spark) > Add Apache Spark images info in

[jira] [Created] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

Yikun Jiang created SPARK-39761: --- Summary: Add Apache Spark images info in running-on-kubernetes doc Key: SPARK-39761 URL: https://issues.apache.org/jira/browse/SPARK-39761 Project: Spark

[jira] [Commented] (SPARK-39760) Support Varchar in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566235#comment-17566235 ] Apache Spark commented on SPARK-39760: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39760) Support Varchar in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39760: Assignee: (was: Apache Spark) > Support Varchar in PySpark >

[jira] [Assigned] (SPARK-39760) Support Varchar in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39760: Assignee: Apache Spark > Support Varchar in PySpark > -- > >

[jira] [Commented] (SPARK-39760) Support Varchar in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566234#comment-17566234 ] Apache Spark commented on SPARK-39760: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-39760) Support Varchar in PySpark

Ruifeng Zheng created SPARK-39760: - Summary: Support Varchar in PySpark Key: SPARK-39760 URL: https://issues.apache.org/jira/browse/SPARK-39760 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18127) Add hooks and extension points to Spark

[ https://issues.apache.org/jira/browse/SPARK-18127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566221#comment-17566221 ] Badrul Chowdhury commented on SPARK-18127: -- Here is another resource where they use this

[jira] [Assigned] (SPARK-39759) Implement listIndexes in JDBC (H2 dialect)

[ https://issues.apache.org/jira/browse/SPARK-39759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39759: Assignee: Apache Spark > Implement listIndexes in JDBC (H2 dialect) >

[jira] [Assigned] (SPARK-39759) Implement listIndexes in JDBC (H2 dialect)

[ https://issues.apache.org/jira/browse/SPARK-39759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39759: Assignee: (was: Apache Spark) > Implement listIndexes in JDBC (H2 dialect) >

[jira] [Commented] (SPARK-39759) Implement listIndexes in JDBC (H2 dialect)

[ https://issues.apache.org/jira/browse/SPARK-39759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566219#comment-17566219 ] Apache Spark commented on SPARK-39759: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-39759) Implement listIndexes in JDBC (H2 dialect)

BingKun Pan created SPARK-39759: --- Summary: Implement listIndexes in JDBC (H2 dialect) Key: SPARK-39759 URL: https://issues.apache.org/jira/browse/SPARK-39759 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39758: Assignee: Max Gekk (was: Apache Spark) > NPE on invalid patterns from the regexp

[jira] [Commented] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566206#comment-17566206 ] Apache Spark commented on SPARK-39758: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39758: Assignee: Apache Spark (was: Max Gekk) > NPE on invalid patterns from the regexp

[jira] [Resolved] (SPARK-39749) Always use plain string representation on casting Decimal to String

[ https://issues.apache.org/jira/browse/SPARK-39749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39749. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37160

[jira] [Updated] (SPARK-39757) Upgrade sbt from 1.7.0 to 1.7.1

[ https://issues.apache.org/jira/browse/SPARK-39757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-39757: Description: release notes: [https://github.com/sbt/sbt/releases]

  1   2   >