Xinrong Meng created SPARK-42211:
Summary: Python UDFs with inconsistent client and server versions
Key: SPARK-42211
URL: https://issues.apache.org/jira/browse/SPARK-42211
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-41661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-41661:
-
Summary: Support for User-defined Functions in Python (was: Support for
Python UDFs)
> Support
[
https://issues.apache.org/jira/browse/SPARK-41661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681221#comment-17681221
]
Xinrong Meng commented on SPARK-41661:
--
Hi [~grundprinzip-db], I renamed the ticket
[
https://issues.apache.org/jira/browse/SPARK-42190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681234#comment-17681234
]
Apache Spark commented on SPARK-42190:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-42206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681238#comment-17681238
]
Apache Spark commented on SPARK-42206:
--
User 'JoshRosen' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-42206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681240#comment-17681240
]
Apache Spark commented on SPARK-42206:
--
User 'JoshRosen' has created a pull request
Dongjoon Hyun created SPARK-42212:
-
Summary: Skip `Python/R/SQL` doc generation if unchanged
Key: SPARK-42212
URL: https://issues.apache.org/jira/browse/SPARK-42212
Project: Spark
Issue Type:
Yang Jie created SPARK-42213:
Summary: Failed to test ClientE2ETestSuite with maven
Key: SPARK-42213
URL: https://issues.apache.org/jira/browse/SPARK-42213
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42213:
-
Description:
run the following commands
{code:java}
build/mvn clean
build/mvn clean install -pl connecto
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42213:
Assignee: Apache Spark
> Failed to test ClientE2ETestSuite with maven
> -
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681344#comment-17681344
]
Apache Spark commented on SPARK-42213:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681346#comment-17681346
]
Apache Spark commented on SPARK-42213:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42213:
Assignee: (was: Apache Spark)
> Failed to test ClientE2ETestSuite with maven
> --
Yang Jie created SPARK-42214:
Summary: Branch-3.4 daily test failed
Key: SPARK-42214
URL: https://issues.apache.org/jira/browse/SPARK-42214
Project: Spark
Issue Type: Bug
Components: Pr
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42214:
-
Description:
https://github.com/apache/spark/actions/runs/4023012095/jobs/6913400923
> Branch-3.4 daily
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681359#comment-17681359
]
Yang Jie commented on SPARK-42214:
--
It seems that the environment of the daily test is
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681370#comment-17681370
]
Yang Jie commented on SPARK-42214:
--
{code:java}
WARNING: You are using pip version 22.0
[
https://issues.apache.org/jira/browse/SPARK-41931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-41931:
Assignee: Max Gekk
> Improve UNSUPPORTED_DATA_TYPE message for complex types
> --
[
https://issues.apache.org/jira/browse/SPARK-41931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-41931.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 39711
[https://github.com
Zhen Li created SPARK-42215:
---
Summary: Better Scala Client Integration test
Key: SPARK-42215
URL: https://issues.apache.org/jira/browse/SPARK-42215
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhen Li updated SPARK-42215:
Description:
The current Scala client has a few integration tests that requires a build
first before runn
[
https://issues.apache.org/jira/browse/SPARK-42215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681401#comment-17681401
]
Zhen Li commented on SPARK-42215:
-
Marking the tests as ITs in maven may cause the tests
Yang Jie created SPARK-42216:
Summary: Use `immutable.Map` by default and fix two check
conditions in util.JsonProtocolSuite
Key: SPARK-42216
URL: https://issues.apache.org/jira/browse/SPARK-42216
Project
[
https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681406#comment-17681406
]
Apache Spark commented on SPARK-42216:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42216:
Assignee: Apache Spark
> Use `immutable.Map` by default and fix two check conditions in
[
https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42216:
Assignee: (was: Apache Spark)
> Use `immutable.Map` by default and fix two check cond
[
https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681407#comment-17681407
]
Apache Spark commented on SPARK-42216:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42213:
-
Assignee: Yang Jie
> Failed to test ClientE2ETestSuite with maven
> ---
[
https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42213.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39771
[https://
[
https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Roczei updated SPARK-38230:
-
Affects Version/s: 3.3.0
3.4.0
3.5.0
> InsertIntoH
Xinyi Yu created SPARK-42217:
Summary: Support lateral column alias in queries with Window
Key: SPARK-42217
URL: https://issues.apache.org/jira/browse/SPARK-42217
Project: Spark
Issue Type: Sub-t
[
https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42217:
Assignee: Apache Spark
> Support lateral column alias in queries with Window
> --
[
https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681440#comment-17681440
]
Apache Spark commented on SPARK-42217:
--
User 'anchovYu' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42217:
Assignee: (was: Apache Spark)
> Support lateral column alias in queries with Window
>
[
https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681441#comment-17681441
]
Apache Spark commented on SPARK-42217:
--
User 'anchovYu' has created a pull request
Bjørn Jørgensen created SPARK-42218:
---
Summary: Upgrade netty to version 4.1.87.Final
Key: SPARK-42218
URL: https://issues.apache.org/jira/browse/SPARK-42218
Project: Spark
Issue Type: Impro
[
https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42218:
Assignee: Apache Spark
> Upgrade netty to version 4.1.87.Final
>
[
https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42218:
Assignee: (was: Apache Spark)
> Upgrade netty to version 4.1.87.Final
> -
[
https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681450#comment-17681450
]
Apache Spark commented on SPARK-42218:
--
User 'bjornjorgensen' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681451#comment-17681451
]
Apache Spark commented on SPARK-42218:
--
User 'bjornjorgensen' has created a pull re
Attila Zsolt Piros created SPARK-42219:
--
Summary: Make "SPARK-34674: Close SparkContext after the Main
method has finished" configurable
Key: SPARK-42219
URL: https://issues.apache.org/jira/browse/SPARK-42219
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros reassigned SPARK-42219:
--
Assignee: Attila Zsolt Piros
> Make "SPARK-34674: Close SparkContext after th
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-42219:
---
Description:
We run into an error after an upgrade from Spark 3.1 to Spark 3.2 cased
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681454#comment-17681454
]
Attila Zsolt Piros commented on SPARK-42219:
I will open a PR regarding this
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-42219:
---
Description:
We run into an error after an upgrade from Spark 3.1 to Spark 3.2 cased
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681463#comment-17681463
]
Apache Spark commented on SPARK-42219:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42219:
Assignee: Attila Zsolt Piros (was: Apache Spark)
> Make "SPARK-34674: Close SparkContext
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42219:
Assignee: Apache Spark (was: Attila Zsolt Piros)
> Make "SPARK-34674: Close SparkContext
[
https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681465#comment-17681465
]
Apache Spark commented on SPARK-42219:
--
User 'attilapiros' has created a pull reque
BingKun Pan created SPARK-42220:
---
Summary: Upgrade buf from 1.12.0 to 1.13.1
Key: SPARK-42220
URL: https://issues.apache.org/jira/browse/SPARK-42220
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681499#comment-17681499
]
Apache Spark commented on SPARK-42220:
--
User 'panbingkun' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-42220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42220:
Assignee: Apache Spark
> Upgrade buf from 1.12.0 to 1.13.1
>
[
https://issues.apache.org/jira/browse/SPARK-42220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42220:
Assignee: (was: Apache Spark)
> Upgrade buf from 1.12.0 to 1.13.1
> -
[
https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42216.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 39772
[https://
[
https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42216:
-
Assignee: Yang Jie
> Use `immutable.Map` by default and fix two check conditions in
>
[
https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42218:
-
Assignee: Bjørn Jørgensen
> Upgrade netty to version 4.1.87.Final
> ---
[
https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42218.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39774
[https://
Gengliang Wang created SPARK-42221:
--
Summary: Introduce a new conf for TimestampNTZ schema inference in
JSON/CSV
Key: SPARK-42221
URL: https://issues.apache.org/jira/browse/SPARK-42221
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42221:
Assignee: Gengliang Wang (was: Apache Spark)
> Introduce a new conf for TimestampNTZ sch
[
https://issues.apache.org/jira/browse/SPARK-42221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42221:
Assignee: Apache Spark (was: Gengliang Wang)
> Introduce a new conf for TimestampNTZ sch
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681522#comment-17681522
]
Yang Jie commented on SPARK-42214:
--
[~gurwls223] [~yikun] branch-3.4 daily build has s
[
https://issues.apache.org/jira/browse/SPARK-41897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-41897.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39450
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-41897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-41897:
Assignee: Sandeep Singh
> Parity in Error types between pyspark and connect functions
> -
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681524#comment-17681524
]
Hyukjin Kwon commented on SPARK-42214:
--
cc [~itholic]and [~XinrongM] FYI
> Branch-
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681526#comment-17681526
]
Yikun Jiang commented on SPARK-42214:
-
https://github.com/apache/spark/blob/c8b1e526
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42214:
Assignee: Apache Spark
> Branch-3.4 daily test failed
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681527#comment-17681527
]
Apache Spark commented on SPARK-42214:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42214:
Assignee: (was: Apache Spark)
> Branch-3.4 daily test failed
> --
[
https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681528#comment-17681528
]
Apache Spark commented on SPARK-42214:
--
User 'Yikun' has created a pull request for
Kevin Cheung created SPARK-4:
Summary: Spark 3.3 Backport: SPARK-41344 Reading V2 datasource
masks underlying error
Key: SPARK-4
URL: https://issues.apache.org/jira/browse/SPARK-4
Project:
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Cheung updated SPARK-4:
-
Description:
The underlying error message is thrown away, leading to a misleading/non-user
frie
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Cheung updated SPARK-4:
-
Description:
The underlying error message is thrown away, leading to a misleading/non-user
frie
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681531#comment-17681531
]
Kevin Cheung commented on SPARK-4:
--
Added link to backport
https://github.com/
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681532#comment-17681532
]
Kevin Cheung commented on SPARK-4:
--
[~gurwls223] do you think you can review th
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-4:
Assignee: (was: Apache Spark)
> Spark 3.3 Backport: SPARK-41344 Reading V2 datasource
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-4:
Assignee: Apache Spark
> Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks unde
76 matches
Mail list logo