[
https://issues.apache.org/jira/browse/SPARK-42680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696739#comment-17696739
]
jiaan.geng commented on SPARK-42680:
I'm working on.
> Create the helper function withSQLConf for
[
https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng resolved SPARK-42678.
Resolution: Duplicate
> Create the helper function withSQLConf for connect's test
>
jiaan.geng created SPARK-42680:
--
Summary: Create the helper function withSQLConf for connect's test
Key: SPARK-42680
URL: https://issues.apache.org/jira/browse/SPARK-42680
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696738#comment-17696738
]
jiaan.geng commented on SPARK-42678:
https://issues.apache.org/jira/browse/SPARK-42680 duplicated
>
[
https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-42678:
---
Parent: (was: SPARK-42554)
Issue Type: New Feature (was: Sub-task)
> Create the helper
Haejoon Lee created SPARK-42679:
---
Summary: createDataFrame doesn't work with non-nullable schema.
Key: SPARK-42679
URL: https://issues.apache.org/jira/browse/SPARK-42679
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-42676.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40292
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-42676:
Assignee: Anish Shrigondekar
> Write temp checkpoints for streaming queries to local
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696716#comment-17696716
]
Apache Spark commented on SPARK-40610:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40610:
Assignee: Apache Spark
> Spark fall back to use getPartitions instead of
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40610:
Assignee: (was: Apache Spark)
> Spark fall back to use getPartitions instead of
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696715#comment-17696715
]
Apache Spark commented on SPARK-40610:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42673:
-
Summary: Make build/mvn build Spark only with the verified maven version
(was: Ban maven 3.9.x for
[
https://issues.apache.org/jira/browse/SPARK-41874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-41874.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40228
jiaan.geng created SPARK-42678:
--
Summary: Create the helper function withSQLConf for connect's test
Key: SPARK-42678
URL: https://issues.apache.org/jira/browse/SPARK-42678
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696687#comment-17696687
]
Apache Spark commented on SPARK-42677:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42677:
Assignee: Apache Spark
> Fix the invalid tests for broadcast hint
>
[
https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696686#comment-17696686
]
Apache Spark commented on SPARK-42677:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42677:
Assignee: (was: Apache Spark)
> Fix the invalid tests for broadcast hint
>
[
https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-42677:
---
Description: Currently, there are a lot of test cases for broadcast hint is
invalid. Because the
[
https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-42677:
---
Description: Currently, there are a lot of test cases for
> Fix the invalid tests for broadcast
jiaan.geng created SPARK-42677:
--
Summary: Fix the invalid tests for broadcast hint
Key: SPARK-42677
URL: https://issues.apache.org/jira/browse/SPARK-42677
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696680#comment-17696680
]
Apache Spark commented on SPARK-42676:
--
User 'anishshri-db' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696678#comment-17696678
]
Apache Spark commented on SPARK-42676:
--
User 'anishshri-db' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42676:
Assignee: (was: Apache Spark)
> Write temp checkpoints for streaming queries to
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42676:
Assignee: Apache Spark
> Write temp checkpoints for streaming queries to local
[
https://issues.apache.org/jira/browse/SPARK-34145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-34145.
-
Resolution: Not A Problem
Issue fixed through SPARK-34079.
> Combine scalar subqueries
>
[
https://issues.apache.org/jira/browse/SPARK-34117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-34117.
-
Resolution: Not A Problem
Issue fixed through SPARK-34081.
> Disable LeftSemi/LeftAnti push
[
https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696672#comment-17696672
]
Anish Shrigondekar commented on SPARK-42676:
Will send the PR soon
cc - [~kabhwan]
>
Anish Shrigondekar created SPARK-42676:
--
Summary: Write temp checkpoints for streaming queries to local
filesystem even if default FS is set differently
Key: SPARK-42676
URL:
[
https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42578:
Assignee: (was: Apache Spark)
> Add JDBC to DataFrameWriter
>
[
https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42578:
Assignee: Apache Spark
> Add JDBC to DataFrameWriter
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696671#comment-17696671
]
Apache Spark commented on SPARK-42578:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696668#comment-17696668
]
Apache Spark commented on SPARK-42478:
--
User 'Yikf' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696667#comment-17696667
]
Apache Spark commented on SPARK-42478:
--
User 'Yikf' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1769#comment-1769
]
Apache Spark commented on SPARK-42478:
--
User 'Yikf' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696665#comment-17696665
]
Yuming Wang commented on SPARK-42650:
-
It seems to be caused by
[
https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42496:
Assignee: (was: Apache Spark)
> Introduction Spark Connect at main page.
>
[
https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42496:
Assignee: Apache Spark
> Introduction Spark Connect at main page.
>
[
https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696655#comment-17696655
]
Apache Spark commented on SPARK-42496:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-42654.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40254
[
https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-42654:
-
Priority: Trivial (was: Major)
> Upgrade dropwizard metrics 4.2.17
>
[
https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-42654:
Assignee: Yang Jie
> Upgrade dropwizard metrics 4.2.17
>
[
https://issues.apache.org/jira/browse/SPARK-41527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-41527.
---
Fix Version/s: 3.4.1
Assignee: jiaan.geng
Resolution: Fixed
>
[
https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-42558:
-
Assignee: Yang Jie
> Implement DataFrameStatFunctions
>
[
https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-42558.
---
Fix Version/s: 3.4.1
Resolution: Fixed
> Implement DataFrameStatFunctions
>
[
https://issues.apache.org/jira/browse/SPARK-42557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-42557.
---
Fix Version/s: 3.4.1
Assignee: jiaan.geng
Resolution: Fixed
> Add
[
https://issues.apache.org/jira/browse/SPARK-42671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-42671.
---
Fix Version/s: 3.4.1
Assignee: BingKun Pan
Resolution: Fixed
> Fix
[
https://issues.apache.org/jira/browse/SPARK-42671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-42671:
--
Epic Link: SPARK-42554
> Fix bug for createDataFrame from complex type schema
>
[
https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42562:
Assignee: (was: Apache Spark)
> UnresolvedLambdaVariables in python do not need
[
https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696647#comment-17696647
]
Apache Spark commented on SPARK-42562:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42562:
Assignee: Apache Spark
> UnresolvedLambdaVariables in python do not need unique names
>
[ https://issues.apache.org/jira/browse/SPARK-42562 ]
jiaan.geng deleted comment on SPARK-42562:
was (Author: beliefer):
I will take a look!
> UnresolvedLambdaVariables in python do not need unique names
>
[
https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696645#comment-17696645
]
kevinshin commented on SPARK-42650:
---
Thanks [~ulysses] , I can reproduced it without any spark's
[
https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42674:
Assignee: BingKun Pan
> Upgrade scalafmt from 3.7.1 to 3.7.2
>
[
https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42674.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40284
[
https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-42675.
-
Fix Version/s: 3.4.0
Assignee: Yang Jie (was: Apache Spark)
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696634#comment-17696634
]
Yuming Wang commented on SPARK-40610:
-
This is because of
[
https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696570#comment-17696570
]
Apache Spark commented on SPARK-42577:
--
User 'ivoson' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42577:
Assignee: (was: Apache Spark)
> A large stage could run indefinitely due to executor
[
https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696569#comment-17696569
]
Apache Spark commented on SPARK-42577:
--
User 'ivoson' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42577:
Assignee: Apache Spark
> A large stage could run indefinitely due to executor lost
>
[
https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42675:
Assignee: (was: Apache Spark)
> Should clean up temp view after test
>
[
https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696564#comment-17696564
]
Apache Spark commented on SPARK-42675:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42675:
Assignee: Apache Spark
> Should clean up temp view after test
>
[
https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42675:
Assignee: Apache Spark
> Should clean up temp view after test
>
Yang Jie created SPARK-42675:
Summary: Should clean up temp view after test
Key: SPARK-42675
URL: https://issues.apache.org/jira/browse/SPARK-42675
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-34145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696545#comment-17696545
]
Sujith Chacko commented on SPARK-34145:
---
[~yumwang] Is anyone working on this feature?
> Combine
[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696543#comment-17696543
]
Sujith Chacko commented on SPARK-27714:
---
[~xinxianyin] any work is in progress for this issue? I
[
https://issues.apache.org/jira/browse/SPARK-34117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696541#comment-17696541
]
Sujith Chacko edited comment on SPARK-34117 at 3/5/23 8:57 AM:
---
[~yumwang]
[
https://issues.apache.org/jira/browse/SPARK-34117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696541#comment-17696541
]
Sujith Chacko commented on SPARK-34117:
---
Is any work going for this improvement, do we have any PR
[
https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42674:
Assignee: (was: Apache Spark)
> Upgrade scalafmt from 3.7.1 to 3.7.2
>
[
https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42674:
Assignee: Apache Spark
> Upgrade scalafmt from 3.7.1 to 3.7.2
>
[
https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696539#comment-17696539
]
Apache Spark commented on SPARK-42674:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42673:
-
Description: GA (was: {code:java}
[ERROR] An error occurred attempting to read POM
[
https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan resolved SPARK-42646.
-
Resolution: Duplicate
> Upgrad cyclonedx from 2.7.3 to 2.7.5
>
BingKun Pan created SPARK-42674:
---
Summary: Upgrade scalafmt from 3.7.1 to 3.7.2
Key: SPARK-42674
URL: https://issues.apache.org/jira/browse/SPARK-42674
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42673:
Assignee: (was: Apache Spark)
> Ban maven 3.9.x for Spark Build
>
[
https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42673:
Assignee: Apache Spark
> Ban maven 3.9.x for Spark Build
>
[
https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696537#comment-17696537
]
Apache Spark commented on SPARK-42673:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42673:
-
Description:
{code:java}
[ERROR] An error occurred attempting to read POM
Yang Jie created SPARK-42673:
Summary: Ban maven 3.9.x for Spark Build
Key: SPARK-42673
URL: https://issues.apache.org/jira/browse/SPARK-42673
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696536#comment-17696536
]
Apache Spark commented on SPARK-42672:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696535#comment-17696535
]
Apache Spark commented on SPARK-42672:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42672:
Assignee: (was: Apache Spark)
> Document error class list
>
[
https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42672:
Assignee: Apache Spark
> Document error class list
> -
>
>
86 matches
Mail list logo