[
https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17535909#comment-17535909
]
Apache Spark commented on SPARK-39159:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17535941#comment-17535941
]
Apache Spark commented on SPARK-38633:
--
User 'beliefer' has created a pull request
Yang Jie created SPARK-39161:
Summary: Upgrade rocksdbjni to 7.2.2
Key: SPARK-39161
URL: https://issues.apache.org/jira/browse/SPARK-39161
Project: Spark
Issue Type: Improvement
Compone
jiaan.geng created SPARK-39162:
--
Summary: Jdbc dialect should decide which function could be pushed
down.
Key: SPARK-39162
URL: https://issues.apache.org/jira/browse/SPARK-39162
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39162:
---
Description:
Regardless of whether the functions are ANSI or not, most databases are
actually unsur
[
https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536016#comment-17536016
]
Apache Spark commented on SPARK-39162:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39162:
Assignee: (was: Apache Spark)
> Jdbc dialect should decide which function could be pu
[
https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39162:
Assignee: Apache Spark
> Jdbc dialect should decide which function could be pushed down.
[
https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39161:
Assignee: (was: Apache Spark)
> Upgrade rocksdbjni to 7.2.2
> ---
[
https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536020#comment-17536020
]
Apache Spark commented on SPARK-39161:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39161:
Assignee: Apache Spark
> Upgrade rocksdbjni to 7.2.2
> ---
>
>
Max Gekk created SPARK-39163:
Summary: Throw an exception w/ error class for an invalid bucket
file
Key: SPARK-39163
URL: https://issues.apache.org/jira/browse/SPARK-39163
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-39163:
-
Description:
Replace IllegalStateException by Spark's exception w/ an error class there
[https://github
Max Gekk created SPARK-39164:
Summary: Wrap asserts/illegal state exceptions by the
INTERNAL_ERROR exception
Key: SPARK-39164
URL: https://issues.apache.org/jira/browse/SPARK-39164
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-39164:
-
Summary: Wrap asserts/illegal state exceptions by the INTERNAL_ERROR
exception in actions (was: Wrap as
[
https://issues.apache.org/jira/browse/SPARK-37956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536045#comment-17536045
]
Apache Spark commented on SPARK-37956:
--
User 'andersonm-ibm' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-37956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536046#comment-17536046
]
Apache Spark commented on SPARK-37956:
--
User 'andersonm-ibm' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39164:
Assignee: Max Gekk (was: Apache Spark)
> Wrap asserts/illegal state exceptions by the IN
[
https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39164:
Assignee: Apache Spark (was: Max Gekk)
> Wrap asserts/illegal state exceptions by the IN
[
https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536047#comment-17536047
]
Apache Spark commented on SPARK-39164:
--
User 'MaxGekk' has created a pull request f
Max Gekk created SPARK-39165:
Summary: Replace sys.error by IllegalStateException in Spark SQL
Key: SPARK-39165
URL: https://issues.apache.org/jira/browse/SPARK-39165
Project: Spark
Issue Type: S
[
https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536101#comment-17536101
]
Apache Spark commented on SPARK-39165:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39165:
Assignee: (was: Apache Spark)
> Replace sys.error by IllegalStateException in Spark S
[
https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39165:
Assignee: Apache Spark
> Replace sys.error by IllegalStateException in Spark SQL
> --
Gengliang Wang created SPARK-39166:
--
Summary: Provide runtime error query context for Binary Arithmetic
when WSCG is off
Key: SPARK-39166
URL: https://issues.apache.org/jira/browse/SPARK-39166
Projec
[
https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39166:
Assignee: Gengliang Wang (was: Apache Spark)
> Provide runtime error query context for B
[
https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536175#comment-17536175
]
Apache Spark commented on SPARK-39166:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536174#comment-17536174
]
Apache Spark commented on SPARK-39166:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39166:
Assignee: Apache Spark (was: Gengliang Wang)
> Provide runtime error query context for B
[
https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-39166:
---
Description:
Currently, for most of the cases, the project
https://issues.apache.org/jira/b
[
https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-39165:
Assignee: Max Gekk
> Replace sys.error by IllegalStateException in Spark SQL
> --
[
https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-39165.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36524
[https://github.com
Max Gekk created SPARK-39167:
Summary: Throw an exception w/ an error class for multiple rows
from a subquery used as an expression
Key: SPARK-39167
URL: https://issues.apache.org/jira/browse/SPARK-39167
Brian Schaefer created SPARK-39168:
--
Summary: Consider all values in a python list when inferring schema
Key: SPARK-39168
URL: https://issues.apache.org/jira/browse/SPARK-39168
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-36837:
--
Parent: (was: SPARK-33772)
Issue Type: Improvement (was: Sub-task)
> Upgrade Kafk
[
https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-36837:
--
Fix Version/s: 3.4.0
(was: 3.3.0)
> Upgrade Kafka to 3.1.0
> --
[
https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-36837:
--
Affects Version/s: 3.4.0
(was: 3.3.0)
> Upgrade Kafka to 3.1.0
> --
[
https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-39161:
-
Assignee: Yang Jie
> Upgrade rocksdbjni to 7.2.2
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-39161.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36522
[https://
[
https://issues.apache.org/jira/browse/SPARK-39145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Erik Krogen resolved SPARK-39145.
-
Resolution: Duplicate
Closing this as a duplicate..
> CLONE - SPIP: Public APIs for extended Co
[
https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brian Schaefer updated SPARK-39168:
---
Description:
Schema inference fails on the following case:
{code:python}
>>> data = [{"a": [
[
https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-39164.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36500
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-39160.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36518
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-39160:
Assignee: Cheng Pan
> Remove workaround for ARROW-1948
>
[
https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38850:
--
Summary: Upgrade Kafka to 3.2.0 (was: Upgrade Kafka to 3.1.1)
> Upgrade Kafka to 3.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38850:
--
Issue Type: Improvement (was: Bug)
> Upgrade Kafka to 3.1.1
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-34930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34930.
--
Resolution: Invalid
We dropped Jenkins.
> Install PyArrow and pandas on Jenkins
> ---
Vitalii Li created SPARK-39169:
--
Summary: Optimize FIRST when used as non-aggregate
Key: SPARK-39169
URL: https://issues.apache.org/jira/browse/SPARK-39169
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536381#comment-17536381
]
Apache Spark commented on SPARK-38850:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vitalii Li updated SPARK-39169:
---
Description:
When `FIRST` is a single aggregate function in `Aggregate` we could either
rewrite who
[
https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vitalii Li updated SPARK-39169:
---
Summary: Optimize FIRST when used as a single aggregate function (was:
Optimize FIRST when used as
[
https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536385#comment-17536385
]
Hyukjin Kwon commented on SPARK-39168:
--
Sounds making sense to me. Are you interest
[
https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38850:
--
Affects Version/s: 3.4.0
(was: 3.3.0)
> Upgrade Kafka to 3.2.0
> --
[
https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38397:
--
Description:
There are several ways to run Spark on K8s including vanilla `spark-submit`
with
[
https://issues.apache.org/jira/browse/SPARK-39142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536388#comment-17536388
]
Hyukjin Kwon commented on SPARK-39142:
--
[~tigerhawkvok], Are you interested in subm
[
https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39169:
Assignee: (was: Apache Spark)
> Optimize FIRST when used as a single aggregate functi
[
https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536390#comment-17536390
]
Apache Spark commented on SPARK-39169:
--
User 'vli-databricks' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39169:
Assignee: Apache Spark
> Optimize FIRST when used as a single aggregate function
> --
[
https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39144:
-
Summary: Nested subquery expressions deduplicate relations should be done
bottom up (was: Spark SQL rep
[
https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39144:
-
Description: When we have nested subquery expressions, there is a chance
that deduplicate relations coul
Hyunwoo Park created SPARK-39170:
Summary: ImportError when creating pyspark.pandas document
"Supported APIs" if pandas version is low.
Key: SPARK-39170
URL: https://issues.apache.org/jira/browse/SPARK-39170
[
https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38850:
-
Assignee: Dongjoon Hyun
> Upgrade Kafka to 3.2.0
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38850.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36526
[https://
[
https://issues.apache.org/jira/browse/SPARK-39041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-39041.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36373
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-39041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-39041:
Assignee: Kent Yao
> Mapping Spark Query ResultSet/Schema to TRowSet/TTableSchema directly
>
jiaan.geng created SPARK-39171:
--
Summary: Unify the Cast expression
Key: SPARK-39171
URL: https://issues.apache.org/jira/browse/SPARK-39171
Project: Spark
Issue Type: New Feature
Compo
[
https://issues.apache.org/jira/browse/SPARK-39171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39171:
---
Issue Type: Improvement (was: New Feature)
> Unify the Cast expression
> -
[
https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536413#comment-17536413
]
Yang Jie commented on SPARK-39102:
--
Give a pr https://github.com/apache/spark/pull/3652
XiDuo You created SPARK-39172:
-
Summary: Remove outer join if all output come from streamed side
and buffered side keys exist unique
Key: SPARK-39172
URL: https://issues.apache.org/jira/browse/SPARK-39172
[
https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39102:
Assignee: Apache Spark
> Replace the usage of guava's Files.createTempDir() with
> java
[
https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39102:
Assignee: (was: Apache Spark)
> Replace the usage of guava's Files.createTempDir() w
[
https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-39172:
--
Summary: Remove outer join if all output come from streamed side and
buffered side keys exist unique k
[
https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28516.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36365
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28516:
---
Assignee: Daniel
> Data Type Formatting Functions: `to_char`
>
Yuming Wang created SPARK-39173:
---
Summary: The error message is different if disable broadcast join
Key: SPARK-39173
URL: https://issues.apache.org/jira/browse/SPARK-39173
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-39173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-39173:
Description:
How to reproduce this issue:
{code:scala}
Seq(-1, 10L).foreach { broadcastThr
[
https://issues.apache.org/jira/browse/SPARK-39173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-39173:
Description:
How to reproduce this issue:
{code:scala}
Seq(-1, 10L).foreach { broadcastThr
[
https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39172:
Assignee: Apache Spark
> Remove outer join if all output come from streamed side and buff
[
https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536428#comment-17536428
]
Apache Spark commented on SPARK-39172:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39172:
Assignee: (was: Apache Spark)
> Remove outer join if all output come from streamed si
[
https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-39166.
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 36525
[https:
Kent Yao created SPARK-39174:
Summary: Catalogs loading swallows missing classname for
ClassNotFoundException
Key: SPARK-39174
URL: https://issues.apache.org/jira/browse/SPARK-39174
Project: Spark
Gengliang Wang created SPARK-39175:
--
Summary: Provide runtime error query context for Cast when WSCG is
off
Key: SPARK-39175
URL: https://issues.apache.org/jira/browse/SPARK-39175
Project: Spark
83 matches
Mail list logo