[jira] [Resolved] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42429. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40004

[jira] [Assigned] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42429: Assignee: Zhen Li > IntelliJ Build issue: value getArgument is not a member of >

[jira] [Created] (SPARK-42432) Support setting location for creating external in DataFrameWriterV2

Zach Kull created SPARK-42432: - Summary: Support setting location for creating external in DataFrameWriterV2 Key: SPARK-42432 URL: https://issues.apache.org/jira/browse/SPARK-42432 Project: Spark

[jira] [Commented] (SPARK-42374) User-facing documentaiton

[ https://issues.apache.org/jira/browse/SPARK-42374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688347#comment-17688347 ] Hyukjin Kwon commented on SPARK-42374: -- ^ [~grundprinzip-db] FYI > User-facing documentaiton >

[jira] [Assigned] (SPARK-42431) Union avoid calling `output` before analysis

[ https://issues.apache.org/jira/browse/SPARK-42431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42431: Assignee: (was: Apache Spark) > Union avoid calling `output` before analysis >

[jira] [Commented] (SPARK-42431) Union avoid calling `output` before analysis

[ https://issues.apache.org/jira/browse/SPARK-42431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688340#comment-17688340 ] Apache Spark commented on SPARK-42431: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42431) Union avoid calling `output` before analysis

Ruifeng Zheng created SPARK-42431: - Summary: Union avoid calling `output` before analysis Key: SPARK-42431 URL: https://issues.apache.org/jira/browse/SPARK-42431 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688330#comment-17688330 ] Apache Spark commented on SPARK-42000: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688329#comment-17688329 ] Apache Spark commented on SPARK-42000: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688328#comment-17688328 ] Apache Spark commented on SPARK-41818: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688325#comment-17688325 ] Apache Spark commented on SPARK-42324: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688320#comment-17688320 ] Apache Spark commented on SPARK-42000: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688321#comment-17688321 ] Apache Spark commented on SPARK-42000: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688319#comment-17688319 ] Apache Spark commented on SPARK-41818: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-42430) Add documentation for TimestampNTZ type

[ https://issues.apache.org/jira/browse/SPARK-42430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688315#comment-17688315 ] Apache Spark commented on SPARK-42430: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42430) Add documentation for TimestampNTZ type

[ https://issues.apache.org/jira/browse/SPARK-42430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42430: Assignee: Gengliang Wang (was: Apache Spark) > Add documentation for TimestampNTZ type

[jira] [Assigned] (SPARK-42430) Add documentation for TimestampNTZ type

[ https://issues.apache.org/jira/browse/SPARK-42430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42430: Assignee: Apache Spark (was: Gengliang Wang) > Add documentation for TimestampNTZ type

[jira] [Updated] (SPARK-42430) Add documentation for TimestampNTZ type

[ https://issues.apache.org/jira/browse/SPARK-42430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-42430: --- Summary: Add documentation for TimestampNTZ type (was: Add doc for TimestampNTZ type) >

[jira] [Created] (SPARK-42430) Add doc for TimestampNTZ type

Gengliang Wang created SPARK-42430: -- Summary: Add doc for TimestampNTZ type Key: SPARK-42430 URL: https://issues.apache.org/jira/browse/SPARK-42430 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42263) Implement `spark.catalog.registerFunction`

[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-42263: Assignee: Xinrong Meng > Implement `spark.catalog.registerFunction` >

[jira] [Resolved] (SPARK-42263) Implement `spark.catalog.registerFunction`

[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42263. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39984

[jira] [Commented] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688280#comment-17688280 ] Apache Spark commented on SPARK-42429: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42429: Assignee: (was: Apache Spark) > IntelliJ Build issue: value getArgument is not a

[jira] [Assigned] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42429: Assignee: Apache Spark > IntelliJ Build issue: value getArgument is not a member of >

[jira] [Commented] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688281#comment-17688281 ] Apache Spark commented on SPARK-42429: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Updated] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42429: Description: When running the tests with IntelliJ, sometime the error pops out:  

[jira] [Updated] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42429: Description: When running the tests with IntelliJ, sometime the error pops out:   {{

[jira] [Updated] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42429: Description: When running the tests with IntelliJ, sometime the error pops out:    

[jira] [Created] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

Zhen Li created SPARK-42429: --- Summary: IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock Key: SPARK-42429 URL: https://issues.apache.org/jira/browse/SPARK-42429

[jira] [Resolved] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42324. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39963

[jira] [Assigned] (SPARK-42324) Assign name to _LEGACY_ERROR_TEMP_1001

[ https://issues.apache.org/jira/browse/SPARK-42324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42324: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1001 >

[jira] [Resolved] (SPARK-41999) NPE for bucketed write (ReadwriterTests.test_bucketed_write)

[ https://issues.apache.org/jira/browse/SPARK-41999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41999. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40002

[jira] [Assigned] (SPARK-41999) NPE for bucketed write (ReadwriterTests.test_bucketed_write)

[ https://issues.apache.org/jira/browse/SPARK-41999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41999: Assignee: Takuya Ueshin (was: Hyukjin Kwon) > NPE for bucketed write

[jira] [Assigned] (SPARK-41999) NPE for bucketed write (ReadwriterTests.test_bucketed_write)

[ https://issues.apache.org/jira/browse/SPARK-41999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41999: Assignee: Hyukjin Kwon > NPE for bucketed write (ReadwriterTests.test_bucketed_write) >

[jira] [Commented] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688260#comment-17688260 ] Apache Spark commented on SPARK-42428: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42428: Assignee: (was: Apache Spark) > Standardize __repr__ of

[jira] [Commented] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688258#comment-17688258 ] Apache Spark commented on SPARK-42428: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42428: Assignee: Apache Spark > Standardize __repr__ of CommonInlineUserDefinedFunction >

[jira] [Created] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

Xinrong Meng created SPARK-42428: Summary: Standardize __repr__ of CommonInlineUserDefinedFunction Key: SPARK-42428 URL: https://issues.apache.org/jira/browse/SPARK-42428 Project: Spark

[jira] [Commented] (SPARK-41999) NPE for bucketed write (ReadwriterTests.test_bucketed_write)

[ https://issues.apache.org/jira/browse/SPARK-41999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688212#comment-17688212 ] Apache Spark commented on SPARK-41999: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41999) NPE for bucketed write (ReadwriterTests.test_bucketed_write)

[ https://issues.apache.org/jira/browse/SPARK-41999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41999: Assignee: Apache Spark > NPE for bucketed write (ReadwriterTests.test_bucketed_write) >

[jira] [Assigned] (SPARK-41999) NPE for bucketed write (ReadwriterTests.test_bucketed_write)

[ https://issues.apache.org/jira/browse/SPARK-41999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41999: Assignee: (was: Apache Spark) > NPE for bucketed write

[jira] [Assigned] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42000: Assignee: Takuya Ueshin > saveAsTable fail to find the default source

[jira] [Resolved] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42000. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 4

[jira] [Assigned] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41818: Assignee: Takuya Ueshin > Support DataFrameWriter.saveAsTable >

[jira] [Resolved] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41818. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 4

[jira] [Commented] (SPARK-42258) pyspark.sql.functions should not expose typing.cast

[ https://issues.apache.org/jira/browse/SPARK-42258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688191#comment-17688191 ] Hyukjin Kwon commented on SPARK-42258: -- either way is fine to me > pyspark.sql.functions should

[jira] [Commented] (SPARK-42427) Conv should return an error if the internal conversion overflows

[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688185#comment-17688185 ] Apache Spark commented on SPARK-42427: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42427) Conv should return an error if the internal conversion overflows

[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42427: Assignee: Apache Spark (was: Gengliang Wang) > Conv should return an error if the

[jira] [Assigned] (SPARK-42427) Conv should return an error if the internal conversion overflows

[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42427: Assignee: Gengliang Wang (was: Apache Spark) > Conv should return an error if the

[jira] [Commented] (SPARK-42427) Conv should return an error if the internal conversion overflows

[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688184#comment-17688184 ] Apache Spark commented on SPARK-42427: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-42427) Conv should return an error if the internal conversion overflows

Gengliang Wang created SPARK-42427: -- Summary: Conv should return an error if the internal conversion overflows Key: SPARK-42427 URL: https://issues.apache.org/jira/browse/SPARK-42427 Project: Spark

[jira] [Assigned] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42000: Assignee: (was: Apache Spark) > saveAsTable fail to find the default source

[jira] [Commented] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688175#comment-17688175 ] Apache Spark commented on SPARK-42000: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42000) saveAsTable fail to find the default source (ReadwriterTests.test_insert_into)

[ https://issues.apache.org/jira/browse/SPARK-42000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42000: Assignee: Apache Spark > saveAsTable fail to find the default source

[jira] [Assigned] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41818: Assignee: Apache Spark > Support DataFrameWriter.saveAsTable >

[jira] [Assigned] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41818: Assignee: (was: Apache Spark) > Support DataFrameWriter.saveAsTable >

[jira] [Commented] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688174#comment-17688174 ] Apache Spark commented on SPARK-41818: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42426: -- Summary: insertInto fails when the column names are different from the table columns (was:

[jira] [Created] (SPARK-42426) insertInto doesn't insert when the column names are different from the table columns

Takuya Ueshin created SPARK-42426: - Summary: insertInto doesn't insert when the column names are different from the table columns Key: SPARK-42426 URL: https://issues.apache.org/jira/browse/SPARK-42426

[jira] [Updated] (SPARK-42426) insertInto doesn't insert when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42426: -- Description: {noformat} File "/.../python/pyspark/sql/connect/readwriter.py", line 518, in

[jira] [Created] (SPARK-42425) spark-hadoop-cloud is not provided in the default Spark distribution

Arseniy Tashoyan created SPARK-42425: Summary: spark-hadoop-cloud is not provided in the default Spark distribution Key: SPARK-42425 URL: https://issues.apache.org/jira/browse/SPARK-42425

[jira] [Commented] (SPARK-42258) pyspark.sql.functions should not expose typing.cast

[ https://issues.apache.org/jira/browse/SPARK-42258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688120#comment-17688120 ] Furcy Pin commented on SPARK-42258: --- Sure, I can do that. Do you have any preference between option 1

[jira] [Updated] (SPARK-41870) Handle duplicate columns in `createDataFrame`

[ https://issues.apache.org/jira/browse/SPARK-41870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-41870: -- Attachment: (was: session.py) > Handle duplicate columns in `createDataFrame` >

[jira] [Updated] (SPARK-41870) Handle duplicate columns in `createDataFrame`

[ https://issues.apache.org/jira/browse/SPARK-41870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-41870: -- Attachment: session.py > Handle duplicate columns in `createDataFrame` >

[jira] [Resolved] (SPARK-42416) Dateset operations should not resolve the analyzed logical plan again

[ https://issues.apache.org/jira/browse/SPARK-42416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42416. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39988

[jira] [Commented] (SPARK-42421) Use the utils to get the switch for dynamic allocation used in local checkpoint

[ https://issues.apache.org/jira/browse/SPARK-42421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688080#comment-17688080 ] Apache Spark commented on SPARK-42421: -- User 'jiwq' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42421) Use the utils to get the switch for dynamic allocation used in local checkpoint

[ https://issues.apache.org/jira/browse/SPARK-42421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42421: Assignee: (was: Apache Spark) > Use the utils to get the switch for dynamic

[jira] [Assigned] (SPARK-42421) Use the utils to get the switch for dynamic allocation used in local checkpoint

[ https://issues.apache.org/jira/browse/SPARK-42421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42421: Assignee: Apache Spark > Use the utils to get the switch for dynamic allocation used in

[jira] [Resolved] (SPARK-42265) DataFrame.createTempView - SparkConnectGrpcException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-42265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-42265. --- Assignee: Takuya Ueshin Resolution: Fixed Issue resolved by pull request 39968

[jira] [Resolved] (SPARK-41820) DataFrame.createOrReplaceGlobalTempView - SparkConnectException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-41820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-41820. --- Assignee: Takuya Ueshin Resolution: Fixed Issue resolved by pull request 39968

[jira] [Commented] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688033#comment-17688033 ] Raghu Angadi commented on SPARK-42406: -- I am working on a fix. > [PROTOBUF] Recursive field

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688026#comment-17688026 ] Herman van Hövell commented on SPARK-39375: --- [~tgraves] python will just use the current

[jira] [Resolved] (SPARK-42327) Assign name to_LEGACY_ERROR_TEMP_2177

[ https://issues.apache.org/jira/browse/SPARK-42327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42327. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39980

[jira] [Assigned] (SPARK-42327) Assign name to_LEGACY_ERROR_TEMP_2177

[ https://issues.apache.org/jira/browse/SPARK-42327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42327: Assignee: Haejoon Lee > Assign name to_LEGACY_ERROR_TEMP_2177 >

[jira] [Commented] (SPARK-42424) Remove unused method `setEnvFromInputString` from YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-42424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688017#comment-17688017 ] Apache Spark commented on SPARK-42424: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688016#comment-17688016 ] Thomas Graves commented on SPARK-39375: --- So regarding UDFs, its not clear to me how that is

[jira] [Assigned] (SPARK-42424) Remove unused method `setEnvFromInputString` from YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-42424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42424: Assignee: Apache Spark > Remove unused method `setEnvFromInputString` from

[jira] [Commented] (SPARK-42424) Remove unused method `setEnvFromInputString` from YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-42424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688018#comment-17688018 ] Apache Spark commented on SPARK-42424: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42424) Remove unused method `setEnvFromInputString` from YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-42424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42424: Assignee: (was: Apache Spark) > Remove unused method `setEnvFromInputString` from

[jira] [Created] (SPARK-42424) Remove unused method `setEnvFromInputString` from YarnSparkHadoopUtil

Yang Jie created SPARK-42424: Summary: Remove unused method `setEnvFromInputString` from YarnSparkHadoopUtil Key: SPARK-42424 URL: https://issues.apache.org/jira/browse/SPARK-42424 Project: Spark

[jira] [Updated] (SPARK-42420) Register WriteTaskResult, BasicWriteTaskStats, and ExecutedWriteSummary to KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-42420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42420: -- Parent: SPARK-42339 Issue Type: Sub-task (was: Improvement) > Register

[jira] [Assigned] (SPARK-42420) Register WriteTaskResult, BasicWriteTaskStats, and ExecutedWriteSummary to KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-42420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42420: - Assignee: William Hyun > Register WriteTaskResult, BasicWriteTaskStats, and

[jira] [Resolved] (SPARK-42420) Register WriteTaskResult, BasicWriteTaskStats, and ExecutedWriteSummary to KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-42420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42420. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39993

[jira] [Commented] (SPARK-42374) User-facing documentaiton

[ https://issues.apache.org/jira/browse/SPARK-42374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687978#comment-17687978 ] Thomas Graves commented on SPARK-42374: --- Just a note that we should make sure to document that

[jira] [Resolved] (SPARK-42422) Upgrade `maven-shade-plugin` to 3.4.1

[ https://issues.apache.org/jira/browse/SPARK-42422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42422. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39994

[jira] [Assigned] (SPARK-42422) Upgrade `maven-shade-plugin` to 3.4.1

[ https://issues.apache.org/jira/browse/SPARK-42422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42422: Assignee: Yang Jie > Upgrade `maven-shade-plugin` to 3.4.1 >

[jira] [Assigned] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42423: Assignee: (was: Apache Spark) > Add metadata column file block start and length >

[jira] [Commented] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687895#comment-17687895 ] Apache Spark commented on SPARK-42423: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42423: Assignee: Apache Spark > Add metadata column file block start and length >

[jira] [Comment Edited] (SPARK-42227) Use approx_percentile function running slower in spark3 than spark2

[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687889#comment-17687889 ] xuanzhiang edited comment on SPARK-42227 at 2/13/23 11:16 AM: -- spark

[jira] [Comment Edited] (SPARK-42227) Use approx_percentile function running slower in spark3 than spark2

[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687889#comment-17687889 ] xuanzhiang edited comment on SPARK-42227 at 2/13/23 11:16 AM: -- spark

[jira] [Updated] (SPARK-42227) Use approx_percentile function running slower in spark3 than spark2

[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuanzhiang updated SPARK-42227: --- Attachment: percentile_approx+objectHashAggregateExec_shuffle_task.png

[jira] [Updated] (SPARK-42227) Use approx_percentile function running slower in spark3 than spark2

[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuanzhiang updated SPARK-42227: --- Attachment: percentile_approx+objectHashAggregateExec.png

[jira] [Commented] (SPARK-42227) Use approx_percentile function running slower in spark3 than spark2

[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687889#comment-17687889 ] xuanzhiang commented on SPARK-42227: spark version : 3.2.1 hadoop version : 3.0.0 job info:

[jira] [Resolved] (SPARK-42313) Assign name to _LEGACY_ERROR_TEMP_1152

[ https://issues.apache.org/jira/browse/SPARK-42313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42313. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39953

[jira] [Assigned] (SPARK-42313) Assign name to _LEGACY_ERROR_TEMP_1152

[ https://issues.apache.org/jira/browse/SPARK-42313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42313: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1152 >

[jira] [Assigned] (SPARK-42417) Upgrade `netty` to version 4.1.88.Final

[ https://issues.apache.org/jira/browse/SPARK-42417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42417: Assignee: BingKun Pan > Upgrade `netty` to version 4.1.88.Final >

[jira] [Resolved] (SPARK-42417) Upgrade `netty` to version 4.1.88.Final

[ https://issues.apache.org/jira/browse/SPARK-42417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42417. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39989

[jira] [Updated] (SPARK-42423) Add metadata column file block start and length

[ https://issues.apache.org/jira/browse/SPARK-42423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42423: -- Summary: Add metadata column file block start and length (was: Add metadata column file block start

  1   2   >