[jira] [Assigned] (SPARK-42496) Introduction Spark Connect at main page

2023-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42496: Assignee: Haejoon Lee > Introduction Spark Connect at main page > ---

[jira] [Resolved] (SPARK-42496) Introduction Spark Connect at main page

2023-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42496. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40324 [https://gi

[jira] [Assigned] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42778: Assignee: (was: Apache Spark) > QueryStageExec should respect supportsRowBased >

[jira] [Commented] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699974#comment-17699974 ] Apache Spark commented on SPARK-42778: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699973#comment-17699973 ] Apache Spark commented on SPARK-42778: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42778: Assignee: Apache Spark > QueryStageExec should respect supportsRowBased > ---

[jira] [Created] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-13 Thread XiDuo You (Jira)
XiDuo You created SPARK-42778: - Summary: QueryStageExec should respect supportsRowBased Key: SPARK-42778 URL: https://issues.apache.org/jira/browse/SPARK-42778 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699937#comment-17699937 ] Apache Spark commented on SPARK-42101: -- User 'ulysses-you' has created a pull reque

[jira] [Resolved] (SPARK-42777) Support converting TimestampNTZ catalog stats to plan stats

2023-03-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42777. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40404 [https:

[jira] [Commented] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699924#comment-17699924 ] Apache Spark commented on SPARK-42340: -- User 'xinrong-meng' has created a pull requ

[jira] [Commented] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699922#comment-17699922 ] Apache Spark commented on SPARK-42340: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42340: Assignee: Apache Spark > Implement GroupedData.applyInPandas > --

[jira] [Assigned] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42340: Assignee: (was: Apache Spark) > Implement GroupedData.applyInPandas > ---

[jira] [Resolved] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42773. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40401 [https://

[jira] [Assigned] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42773: - Assignee: Allan Folting > Minor grammatical change to "Supports Spark Connect" message

[jira] [Resolved] (SPARK-42702) Support parameterized CTE

2023-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42702. - Assignee: Wenchen Fan (was: Max Gekk) Resolution: Fixed > Support parameterized CTE > ---

[jira] [Updated] (SPARK-42597) Support unwrap date type to timestamp type

2023-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42597: Summary: Support unwrap date type to timestamp type (was: UnwrapCastInBinaryComparison support un

[jira] [Resolved] (SPARK-42597) UnwrapCastInBinaryComparison support unwrap timestamp type

2023-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42597. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40190 [https://gith

[jira] [Assigned] (SPARK-42597) UnwrapCastInBinaryComparison support unwrap timestamp type

2023-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42597: --- Assignee: Yuming Wang > UnwrapCastInBinaryComparison support unwrap timestamp type > --

[jira] [Resolved] (SPARK-42711) build/sbt usage error messages and shellcheck warn/error

2023-03-13 Thread Liang Yan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Yan resolved SPARK-42711. --- Resolution: Not A Problem The original codes are just a copy of upstream. And the changes not fix ac

[jira] [Closed] (SPARK-42711) build/sbt usage error messages and shellcheck warn/error

2023-03-13 Thread Liang Yan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Yan closed SPARK-42711. - > build/sbt usage error messages and shellcheck warn/error > ---

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699874#comment-17699874 ] Apache Spark commented on SPARK-21782: -- User 'megaserg' has created a pull request

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699875#comment-17699875 ] Apache Spark commented on SPARK-21782: -- User 'megaserg' has created a pull request

[jira] [Commented] (SPARK-42777) Support converting TimestampNTZ catalog stats to plan stats

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699873#comment-17699873 ] Apache Spark commented on SPARK-42777: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-42777) Support converting TimestampNTZ catalog stats to plan stats

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42777: Assignee: Gengliang Wang (was: Apache Spark) > Support converting TimestampNTZ catalog s

[jira] [Commented] (SPARK-42777) Support converting TimestampNTZ catalog stats to plan stats

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699872#comment-17699872 ] Apache Spark commented on SPARK-42777: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-42777) Support converting TimestampNTZ catalog stats to plan stats

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42777: Assignee: Apache Spark (was: Gengliang Wang) > Support converting TimestampNTZ catalog s

[jira] [Created] (SPARK-42777) Support converting TimestampNTZ catalog stats to plan stats

2023-03-13 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-42777: -- Summary: Support converting TimestampNTZ catalog stats to plan stats Key: SPARK-42777 URL: https://issues.apache.org/jira/browse/SPARK-42777 Project: Spark

[jira] [Assigned] (SPARK-42754) Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42754: Assignee: Apache Spark > Spark 3.4 history server's SQL tab incorrectly groups SQL execut

[jira] [Commented] (SPARK-42754) Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699852#comment-17699852 ] Apache Spark commented on SPARK-42754: -- User 'linhongliu-db' has created a pull req

[jira] [Assigned] (SPARK-42754) Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42754: Assignee: (was: Apache Spark) > Spark 3.4 history server's SQL tab incorrectly groups

[jira] [Created] (SPARK-42776) BroadcastHashJoinExec.requiredChildDistribution called before columnar replacement rules

2023-03-13 Thread Timothy Miller (Jira)
Timothy Miller created SPARK-42776: -- Summary: BroadcastHashJoinExec.requiredChildDistribution called before columnar replacement rules Key: SPARK-42776 URL: https://issues.apache.org/jira/browse/SPARK-42776

[jira] [Updated] (SPARK-42775) approx_percentile produces wrong results for large decimals.

2023-03-13 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42775: --- Description: In the {{approx_percentile}} expression, Spark casts decimal to double to update the a

[jira] [Updated] (SPARK-42775) approx_percentile produces wrong results for large decimals.

2023-03-13 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42775: --- Description: In the {{approx_percentile}} expression, Spark casts decimal to double to update the a

[jira] [Created] (SPARK-42775) approx_percentile produces wrong results for large decimals.

2023-03-13 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-42775: -- Summary: approx_percentile produces wrong results for large decimals. Key: SPARK-42775 URL: https://issues.apache.org/jira/browse/SPARK-42775 Project: Spark Iss

[jira] [Assigned] (SPARK-42020) createDataFrame with UDT

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42020: Assignee: (was: Apache Spark) > createDataFrame with UDT > >

[jira] [Assigned] (SPARK-42020) createDataFrame with UDT

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42020: Assignee: Apache Spark > createDataFrame with UDT > > >

[jira] [Commented] (SPARK-42020) createDataFrame with UDT

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699825#comment-17699825 ] Apache Spark commented on SPARK-42020: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-42774) Expose VectorTypes API for DataSourceV2 Batch Scans

2023-03-13 Thread Micah Kornfield (Jira)
Micah Kornfield created SPARK-42774: --- Summary: Expose VectorTypes API for DataSourceV2 Batch Scans Key: SPARK-42774 URL: https://issues.apache.org/jira/browse/SPARK-42774 Project: Spark Iss

[jira] [Assigned] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42773: Assignee: Apache Spark > Minor grammatical change to "Supports Spark Connect" message > -

[jira] [Assigned] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42773: Assignee: (was: Apache Spark) > Minor grammatical change to "Supports Spark Connect"

[jira] [Commented] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699781#comment-17699781 ] Apache Spark commented on SPARK-42773: -- User 'allanf-db' has created a pull request

[jira] [Resolved] (SPARK-42769) Add SPARK_DRIVER_POD_IP env variable to executor pods

2023-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42769. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40392 [https://

[jira] [Assigned] (SPARK-42769) Add SPARK_DRIVER_POD_IP env variable to executor pods

2023-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42769: - Assignee: Dongjoon Hyun > Add SPARK_DRIVER_POD_IP env variable to executor pods > -

[jira] [Updated] (SPARK-34637) Support DPP in AQE when the broadcast exchange can be reused

2023-03-13 Thread Eugene Koifman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated SPARK-34637: --- Summary: Support DPP in AQE when the broadcast exchange can be reused (was: Support DPP in

[jira] [Assigned] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41359: Assignee: Apache Spark > Use `PhysicalDataType` instead of DataType in UnsafeRow > --

[jira] [Commented] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699720#comment-17699720 ] Apache Spark commented on SPARK-41359: -- User 'ClownXC' has created a pull request f

[jira] [Assigned] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41359: Assignee: (was: Apache Spark) > Use `PhysicalDataType` instead of DataType in UnsafeR

[jira] [Created] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-13 Thread Allan Folting (Jira)
Allan Folting created SPARK-42773: - Summary: Minor grammatical change to "Supports Spark Connect" message Key: SPARK-42773 URL: https://issues.apache.org/jira/browse/SPARK-42773 Project: Spark

[jira] [Updated] (SPARK-38992) Avoid using bash -c in ShellBasedGroupsMappingProvider

2023-03-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38992: - Fix Version/s: (was: 3.1.3) > Avoid using bash -c in ShellBasedGroupsMappingProvider > -

[jira] [Commented] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699610#comment-17699610 ] Apache Spark commented on SPARK-42101: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699611#comment-17699611 ] Apache Spark commented on SPARK-42101: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699595#comment-17699595 ] Apache Spark commented on SPARK-42052: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42772: Assignee: (was: Apache Spark) > Change the default value of JDBC options about push d

[jira] [Commented] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699571#comment-17699571 ] Apache Spark commented on SPARK-42772: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42772: Assignee: Apache Spark > Change the default value of JDBC options about push down to true

[jira] [Created] (SPARK-42772) Adjust the default value of JDBC options about push down to true

2023-03-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42772: -- Summary: Adjust the default value of JDBC options about push down to true Key: SPARK-42772 URL: https://issues.apache.org/jira/browse/SPARK-42772 Project: Spark

[jira] [Updated] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42772: --- Summary: Change the default value of JDBC options about push down to true (was: Adjust the default

[jira] [Assigned] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42770: Assignee: (was: Apache Spark) > SQLImplicitsTestSuite test failed with Java 17 >

[jira] [Assigned] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42770: Assignee: Apache Spark > SQLImplicitsTestSuite test failed with Java 17 > ---

[jira] [Commented] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699542#comment-17699542 ] Apache Spark commented on SPARK-42770: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-42771) Refactor HiveGenericUDF

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699527#comment-17699527 ] Apache Spark commented on SPARK-42771: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-42771) Refactor HiveGenericUDF

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42771: Assignee: (was: Apache Spark) > Refactor HiveGenericUDF > --- > >

[jira] [Assigned] (SPARK-42771) Refactor HiveGenericUDF

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42771: Assignee: Apache Spark > Refactor HiveGenericUDF > --- > >

[jira] [Updated] (SPARK-42769) Add SPARK_DRIVER_POD_IP env variable to executor pods

2023-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42769: -- Summary: Add SPARK_DRIVER_POD_IP env variable to executor pods (was: Add ENV_DRIVER_POD_IP en

[jira] [Created] (SPARK-42771) Refactor HiveGenericUDF

2023-03-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42771: --- Summary: Refactor HiveGenericUDF Key: SPARK-42771 URL: https://issues.apache.org/jira/browse/SPARK-42771 Project: Spark Issue Type: Sub-task Componen

[jira] [Commented] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699516#comment-17699516 ] Apache Spark commented on SPARK-40082: -- User 'Stove-hust' has created a pull reques

[jira] [Assigned] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40082: Assignee: (was: Apache Spark) > DAGScheduler may not schduler new stage in condition

[jira] [Assigned] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40082: Assignee: Apache Spark > DAGScheduler may not schduler new stage in condition of push-bas

[jira] [Commented] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699515#comment-17699515 ] Apache Spark commented on SPARK-40082: -- User 'Stove-hust' has created a pull reques

[jira] [Assigned] (SPARK-42508) Extract the common .ml classes to `mllib-common`

2023-03-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42508: - Assignee: Ruifeng Zheng > Extract the common .ml classes to `mllib-common` > --

[jira] [Resolved] (SPARK-42749) CAST(x as int) does not generate error with overflow

2023-03-13 Thread Tjomme Vergauwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tjomme Vergauwen resolved SPARK-42749. -- Resolution: Fixed Additional settings required to get the intended behaviour. Documen

[jira] [Commented] (SPARK-42749) CAST(x as int) does not generate error with overflow

2023-03-13 Thread Tjomme Vergauwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699503#comment-17699503 ] Tjomme Vergauwen commented on SPARK-42749: -- Just checked the documentation agai

[jira] [Commented] (SPARK-42749) CAST(x as int) does not generate error with overflow

2023-03-13 Thread Tjomme Vergauwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699497#comment-17699497 ] Tjomme Vergauwen commented on SPARK-42749: -- Hi, This does indeed solve the pro

[jira] [Resolved] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

2023-03-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39235. - Fix Version/s: 3.4.0 Resolution: Fixed > Make Catalog API be compatible with 3-layer-name

[jira] [Resolved] (SPARK-42577) A large stage could run indefinitely due to executor lost

2023-03-13 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42577. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 402

[jira] [Assigned] (SPARK-42577) A large stage could run indefinitely due to executor lost

2023-03-13 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42577: --- Assignee: Tengfei Huang > A large stage could run indefinitely due to execu

[jira] [Commented] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699490#comment-17699490 ] Yang Jie commented on SPARK-42770: -- Maybe it can only be reproduced on Linux   > SQLI

[jira] [Created] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-42770: Summary: SQLImplicitsTestSuite test failed with Java 17 Key: SPARK-42770 URL: https://issues.apache.org/jira/browse/SPARK-42770 Project: Spark Issue Type: Bug