[
https://issues.apache.org/jira/browse/SPARK-33166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223466#comment-17223466
]
jiaan.geng commented on SPARK-33166:
I will take a look!
> Provide Search Function
Maxim Gekk created SPARK-33299:
--
Summary: Unify schema parsing in from_json/from_csv across all APIs
Key: SPARK-33299
URL: https://issues.apache.org/jira/browse/SPARK-33299
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-33299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33299:
Assignee: Apache Spark
> Unify schema parsing in from_json/from_csv across all APIs
> ---
[
https://issues.apache.org/jira/browse/SPARK-33299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33299:
Assignee: (was: Apache Spark)
> Unify schema parsing in from_json/from_csv across all
[
https://issues.apache.org/jira/browse/SPARK-33299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223485#comment-17223485
]
Apache Spark commented on SPARK-33299:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33294.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30197
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-33294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-33294:
---
Assignee: ulysses you
> Add query resolved check before analyze InsertIntoDir
> ---
[
https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-33183:
Fix Version/s: 3.0.2
2.4.8
> Bug in optimizer rule EliminateSorts
> ---
[
https://issues.apache.org/jira/browse/SPARK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-33297.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30198
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-33248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223508#comment-17223508
]
Apache Spark commented on SPARK-33248:
--
User 'AngersZh' has created a pull requ
chendihao created SPARK-33300:
-
Summary: Rule SimplifyCasts will not work for nested columns
Key: SPARK-33300
URL: https://issues.apache.org/jira/browse/SPARK-33300
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chendihao updated SPARK-33300:
--
Description:
We use SparkSQL and Catalyst to optimize the Spark job. We have read the source
code and
[
https://issues.apache.org/jira/browse/SPARK-33301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223603#comment-17223603
]
Yuming Wang commented on SPARK-33301:
-
{noformat}
20/10/30 05:01:40 ERROR CodeGener
Yuming Wang created SPARK-33301:
---
Summary: Code grows beyond 64 KB when compiling large CASE_WHEN
Key: SPARK-33301
URL: https://issues.apache.org/jira/browse/SPARK-33301
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-33301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-33301:
Summary: Code grows beyond 64 KB when compiling large CaseWhen (was: Code
grows beyond 64 KB when
Yuming Wang created SPARK-33302:
---
Summary: Failed to push filters through Expand
Key: SPARK-33302
URL: https://issues.apache.org/jira/browse/SPARK-33302
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-33302:
Description:
How to reproduce this issue:
{code:sql}
create table SPARK_33302_1(pid int, uid int,
[
https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-33302:
Summary: Failed to push down filters through Expand (was: Failed to push
filters through Expand)
[
https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-33302:
Issue Type: Improvement (was: Bug)
> Failed to push filters through Expand
>
[
https://issues.apache.org/jira/browse/SPARK-32591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-32591:
--
Description:
A question came up when we added offheap memory to be able to set in a
ResourceP
Peter Toth created SPARK-33303:
--
Summary: Deduplicate deterministic UDF calls
Key: SPARK-33303
URL: https://issues.apache.org/jira/browse/SPARK-33303
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-33303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33303:
Assignee: Apache Spark
> Deduplicate deterministic UDF calls
> --
[
https://issues.apache.org/jira/browse/SPARK-33303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33303:
Assignee: (was: Apache Spark)
> Deduplicate deterministic UDF calls
> ---
[
https://issues.apache.org/jira/browse/SPARK-33303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223675#comment-17223675
]
Apache Spark commented on SPARK-33303:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-33303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33303:
Assignee: Apache Spark
> Deduplicate deterministic UDF calls
> --
[
https://issues.apache.org/jira/browse/SPARK-33303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223674#comment-17223674
]
Apache Spark commented on SPARK-33303:
--
User 'peter-toth' has created a pull reques
Maciej Szymkiewicz created SPARK-33304:
--
Summary: Add from_avro and to_avro functions to SparkR
Key: SPARK-33304
URL: https://issues.apache.org/jira/browse/SPARK-33304
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223723#comment-17223723
]
Apache Spark commented on SPARK-33288:
--
User 'tgravescs' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33288:
Assignee: (was: Apache Spark)
> Support k8s cluster manager with stage level scheduli
[
https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33288:
Assignee: Apache Spark
> Support k8s cluster manager with stage level scheduling
> --
[
https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33290:
--
Labels: correctness (was: )
> REFRESH TABLE should invalidate cache even though the table its
[
https://issues.apache.org/jira/browse/SPARK-32661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223727#comment-17223727
]
Apache Spark commented on SPARK-32661:
--
User 'tgravescs' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33290:
--
Issue Type: Bug (was: Improvement)
> REFRESH TABLE should invalidate cache even though the ta
[
https://issues.apache.org/jira/browse/SPARK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223753#comment-17223753
]
Dongjoon Hyun commented on SPARK-33295:
---
Hi, [~jaanai]. Yes. I've been working on
[
https://issues.apache.org/jira/browse/SPARK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223754#comment-17223754
]
Dongjoon Hyun commented on SPARK-33295:
---
Until ORC 1.6.5, it's technically infeasi
[
https://issues.apache.org/jira/browse/SPARK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33295:
--
Summary: Upgrade ORC to 1.6.6 (was: Upgrade ORC to 1.6.1)
> Upgrade ORC to 1.6.6
> ---
[
https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223761#comment-17223761
]
Dongjoon Hyun commented on SPARK-33279:
---
Thank you, [~fan_li_ya] and [~hyukjin.kwo
[
https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223762#comment-17223762
]
L. C. Hsieh commented on SPARK-33280:
-
Yeah, I thought you can work around with a {{
[
https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-33279.
-
> Spark 3.0 failure due to lack of Arrow dependency
> --
[
https://issues.apache.org/jira/browse/SPARK-33301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223776#comment-17223776
]
Dongjoon Hyun commented on SPARK-33301:
---
Thank you, [~yumwang].
> Code grows beyo
[
https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223779#comment-17223779
]
Dongjoon Hyun commented on SPARK-33259:
---
Is there a way to block this at the analy
[
https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33259:
--
Priority: Critical (was: Major)
> Joining 3 streams results in incorrect output
> ---
[
https://issues.apache.org/jira/browse/SPARK-33261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33261:
Assignee: Apache Spark
> Allow people to extend the pod feature steps
> -
[
https://issues.apache.org/jira/browse/SPARK-33261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33261:
Assignee: (was: Apache Spark)
> Allow people to extend the pod feature steps
> --
[
https://issues.apache.org/jira/browse/SPARK-33261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223806#comment-17223806
]
Apache Spark commented on SPARK-33261:
--
User 'holdenk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223807#comment-17223807
]
Apache Spark commented on SPARK-33262:
--
User 'holdenk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223812#comment-17223812
]
Apache Spark commented on SPARK-33098:
--
User 'bersprockets' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-33261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33261:
--
Parent: SPARK-33005
Issue Type: Sub-task (was: Improvement)
> Allow people to extend
[
https://issues.apache.org/jira/browse/SPARK-26888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-26888.
-
> Upgrade to Log4j 2.x
>
>
> Key: SPARK-26888
>
[
https://issues.apache.org/jira/browse/SPARK-32661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32661.
---
Resolution: Duplicate
This is superseded by SPARK-33288.
> Spark executors on K8S do not re
[
https://issues.apache.org/jira/browse/SPARK-32661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-32661.
-
> Spark executors on K8S do not request extra memory for off-heap allocations
>
[
https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223924#comment-17223924
]
Apache Spark commented on SPARK-33259:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33259:
Assignee: Apache Spark
> Joining 3 streams results in incorrect output
>
[
https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33259:
Assignee: (was: Apache Spark)
> Joining 3 streams results in incorrect output
> -
[
https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223925#comment-17223925
]
Apache Spark commented on SPARK-33259:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223929#comment-17223929
]
Dongwook Kwon commented on SPARK-29683:
---
I agree with Genmao, these logics that ad
[
https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-32037:
-
Assignee: Thomas Graves
> Rename blacklisting feature to avoid language with racist con
[
https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-32037.
---
Fix Version/s: 3.1.0
Resolution: Fixed
> Rename blacklisting feature to avoid languag
Chao Sun created SPARK-33305:
Summary: DSv2: DROP TABLE command should also invalidate cache
Key: SPARK-33305
URL: https://issues.apache.org/jira/browse/SPARK-33305
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223971#comment-17223971
]
Aoyuan Liao commented on SPARK-33150:
-
[~DieterDP] The time difference is passed via
EdisonWang created SPARK-33306:
--
Summary: TimezoneID is needed when there cast from Date to String
Key: SPARK-33306
URL: https://issues.apache.org/jira/browse/SPARK-33306
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223974#comment-17223974
]
Apache Spark commented on SPARK-33305:
--
User 'sunchao' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33305:
Assignee: (was: Apache Spark)
> DSv2: DROP TABLE command should also invalidate cache
[
https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33305:
Assignee: Apache Spark
> DSv2: DROP TABLE command should also invalidate cache
>
angerszhu created SPARK-33307:
-
Summary: Refact GROUPING ANALYTICS
Key: SPARK-33307
URL: https://issues.apache.org/jira/browse/SPARK-33307
Project: Spark
Issue Type: Improvement
Compone
[
https://issues.apache.org/jira/browse/SPARK-33307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-33307:
--
Description: Support CUBE(...) and ROLLUP(...) in the parser level and
support GROUPING SETS(...) as
angerszhu created SPARK-33308:
-
Summary: support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as
group by expr in parser level
Key: SPARK-33308
URL: https://issues.apache.org/jira/browse/SPARK-33308
Proj
angerszhu created SPARK-33309:
-
Summary: Replace origin GROUPING SETS with new expression
Key: SPARK-33309
URL: https://issues.apache.org/jira/browse/SPARK-33309
Project: Spark
Issue Type: Sub-ta
[
https://issues.apache.org/jira/browse/SPARK-33307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223990#comment-17223990
]
angerszhu commented on SPARK-33307:
---
FYI [~maropu] [~cloud_fan]
> Refact GROUPING ANA
[
https://issues.apache.org/jira/browse/SPARK-33296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-33296:
--
Parent: SPARK-33307
Issue Type: Sub-task (was: Improvement)
> Format exception when use cube
[
https://issues.apache.org/jira/browse/SPARK-33229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-33229:
--
Parent: SPARK-33307
Issue Type: Sub-task (was: Improvement)
> UnsupportedOperationException w
[
https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-33233:
--
Parent: SPARK-33307
Issue Type: Sub-task (was: Improvement)
> CUBE/ROLLUP can't support Unres
[
https://issues.apache.org/jira/browse/SPARK-33308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33308:
Assignee: Apache Spark
> support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group b
[
https://issues.apache.org/jira/browse/SPARK-33308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223992#comment-17223992
]
Apache Spark commented on SPARK-33308:
--
User 'AngersZh' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-33308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33308:
Assignee: (was: Apache Spark)
> support CUBE(...) and ROLLUP(...), GROUPING SETS(...)
[
https://issues.apache.org/jira/browse/SPARK-29606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224007#comment-17224007
]
Asif commented on SPARK-29606:
--
Have proposed following PR which completely solves the issu
76 matches
Mail list logo
