[
https://issues.apache.org/jira/browse/SPARK-37446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447812#comment-17447812
]
angerszhu commented on SPARK-37446:
---
Seems has been fixed, will close this
> hive-2.3
[
https://issues.apache.org/jira/browse/SPARK-37446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu resolved SPARK-37446.
---
Resolution: Duplicate
> hive-2.3.9 related API use invoke method
> -
angerszhu created SPARK-37446:
-
Summary: hive-2.3.9 related API use invoke method
Key: SPARK-37446
URL: https://issues.apache.org/jira/browse/SPARK-37446
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-37446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447811#comment-17447811
]
angerszhu commented on SPARK-37446:
---
Raise a pr soon
> hive-2.3.9 related API use inv
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447805#comment-17447805
]
Apache Spark commented on SPARK-37445:
--
User 'AngersZh' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37445:
Assignee: (was: Apache Spark)
> Update hadoop-profile
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447804#comment-17447804
]
Apache Spark commented on SPARK-37445:
--
User 'AngersZh' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37445:
Assignee: Apache Spark
> Update hadoop-profile
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-37438.
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34681
[https:
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447785#comment-17447785
]
Apache Spark commented on SPARK-32079:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32079:
Assignee: (was: Apache Spark)
> PySpark <> Beam pickling issues for collections.named
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447784#comment-17447784
]
Apache Spark commented on SPARK-32079:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32079:
Assignee: Apache Spark
> PySpark <> Beam pickling issues for collections.namedtuple
> ---
angerszhu created SPARK-37445:
-
Summary: Update hadoop-profile
Key: SPARK-37445
URL: https://issues.apache.org/jira/browse/SPARK-37445
Project: Spark
Issue Type: Task
Components: Build
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447752#comment-17447752
]
angerszhu commented on SPARK-37445:
---
Raise a pr soon
> Update hadoop-profile
> --
[
https://issues.apache.org/jira/browse/SPARK-27810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27810.
--
Resolution: Duplicate
> PySpark breaks Cloudpickle serialization of collections.namedtuple obj
[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22674.
--
Resolution: Duplicate
> PySpark breaks serialization of namedtuple subclasses
> --
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447747#comment-17447747
]
Hyukjin Kwon commented on SPARK-32079:
--
im working on this.
> PySpark <> Beam pick
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-32079:
-
Affects Version/s: 3.3.0
(was: 3.0.0)
> PySpark <> Beam pickling issu
[
https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447744#comment-17447744
]
Apache Spark commented on SPARK-36231:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447743#comment-17447743
]
Apache Spark commented on SPARK-36231:
--
User 'Yikun' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447727#comment-17447727
]
Apache Spark commented on SPARK-37444:
--
User 'imback82' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37444:
Assignee: (was: Apache Spark)
> ALTER NAMESPACE ... SET LOCATION should handle empty
[
https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37444:
Assignee: Apache Spark
> ALTER NAMESPACE ... SET LOCATION should handle empty location co
[
https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Terry Kim updated SPARK-37444:
--
Description: ALTER NAMESPACE ... SET LOCATION should handle empty location
consistently across v1 and
[
https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Terry Kim updated SPARK-37444:
--
Summary: ALTER NAMESPACE ... SET LOCATION should handle empty location
consistently across v1 and v2 c
Terry Kim created SPARK-37444:
-
Summary: ALTER NAMESPACE ... SET LOCATION handles empty location
consistently across v1 and v2 command
Key: SPARK-37444
URL: https://issues.apache.org/jira/browse/SPARK-37444
[
https://issues.apache.org/jira/browse/SPARK-30537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30537.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34401
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-30537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-30537:
Assignee: pralabhkumar
> toPandas gets wrong dtypes when applied on empty DF when Arrow e
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447702#comment-17447702
]
Hyukjin Kwon commented on SPARK-37391:
--
cc [~gaborgsomogyi] FYI
> SIGNIFICANT bott
[
https://issues.apache.org/jira/browse/SPARK-37337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37337.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34608
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-37337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37337:
Assignee: Xinrong Meng
> Improve the API of Spark DataFrame to pandas-on-Spark DataFrame
[
https://issues.apache.org/jira/browse/SPARK-37443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447682#comment-17447682
]
Apache Spark commented on SPARK-37443:
--
User 'ueshin' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-37443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37443:
Assignee: (was: Apache Spark)
> Provide a profiler for Python/Pandas UDFs
> -
[
https://issues.apache.org/jira/browse/SPARK-37443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37443:
Assignee: Apache Spark
> Provide a profiler for Python/Pandas UDFs
>
Takuya Ueshin created SPARK-37443:
-
Summary: Provide a profiler for Python/Pandas UDFs
Key: SPARK-37443
URL: https://issues.apache.org/jira/browse/SPARK-37443
Project: Spark
Issue Type: Impro
[
https://issues.apache.org/jira/browse/SPARK-37439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-37439.
--
Resolution: Not A Problem
> org.apache.spark.sql.AnalysisException: Non-time-based windows are
[
https://issues.apache.org/jira/browse/SPARK-37439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447616#comment-17447616
]
Jungtaek Lim commented on SPARK-37439:
--
Hi,
By time-window we described what time
[
https://issues.apache.org/jira/browse/SPARK-37441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-37441.
--
Resolution: Duplicate
> org.apache.spark.sql.AnalysisException: Non-time-based windows are not
[
https://issues.apache.org/jira/browse/SPARK-37440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-37440.
--
Resolution: Duplicate
> org.apache.spark.sql.AnalysisException: Non-time-based windows are not
[
https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447578#comment-17447578
]
Kevin Appel commented on SPARK-37259:
-
It would be difficult to be able to actually
[
https://issues.apache.org/jira/browse/SPARK-37442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37442:
Assignee: (was: Apache Spark)
> In AQE, wrong InMemoryRelation size estimation causes
[
https://issues.apache.org/jira/browse/SPARK-37442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37442:
Assignee: Apache Spark
> In AQE, wrong InMemoryRelation size estimation causes "Cannot br
[
https://issues.apache.org/jira/browse/SPARK-37442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447577#comment-17447577
]
Apache Spark commented on SPARK-37442:
--
User 'ChenMichael' has created a pull reque
Michael Chen created SPARK-37442:
Summary: In AQE, wrong InMemoryRelation size estimation causes
"Cannot broadcast the table that is larger than 8GB: 8 GB" failure
Key: SPARK-37442
URL: https://issues.apache.org/j
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447529#comment-17447529
]
Danny Guinther commented on SPARK-37391:
Here's an example stacktrace for one of
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447512#comment-17447512
]
Danny Guinther commented on SPARK-37391:
[~hyukjin.kwon] , sorry, I seem to have
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Guinther updated SPARK-37391:
---
Attachment: so-much-blocking.jpg
> SIGNIFICANT bottleneck introduced by fix for SPARK-32001
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Guinther updated SPARK-37391:
---
Attachment: spark-regression-dashes.jpg
> SIGNIFICANT bottleneck introduced by fix for SPARK
Ilya created SPARK-37441:
Summary: org.apache.spark.sql.AnalysisException: Non-time-based
windows are not supported on streaming DataFrames/Datasets;; despite of
time-based window
Key: SPARK-37441
URL: https://issues.apa
Ilya created SPARK-37440:
Summary: org.apache.spark.sql.AnalysisException: Non-time-based
windows are not supported on streaming DataFrames/Datasets;; despite of
time-based window
Key: SPARK-37440
URL: https://issues.apa
Ilya created SPARK-37439:
Summary: org.apache.spark.sql.AnalysisException: Non-time-based
windows are not supported on streaming DataFrames/Datasets;; despite of
time-based window
Key: SPARK-37439
URL: https://issues.apa
[
https://issues.apache.org/jira/browse/SPARK-37192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37192:
---
Assignee: PengLei
> Migrate SHOW TBLPROPERTIES to use V2 command by default
> -
[
https://issues.apache.org/jira/browse/SPARK-37192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37192.
-
Resolution: Fixed
Issue resolved by pull request 34666
[https://github.com/apache/spark/pull/346
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Guinther updated SPARK-37391:
---
Summary: SIGNIFICANT bottleneck introduced by fix for SPARK-32001 (was:
SIGNIFICANT bottlen
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447162#comment-17447162
]
Hyukjin Kwon edited comment on SPARK-37391 at 11/22/21, 3:21 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Guinther updated SPARK-37391:
---
Description:
The fix for https://issues.apache.org/jira/browse/SPARK-32001 (
[https://githu
[
https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Guinther updated SPARK-37391:
---
Description:
The fix for SPARK-34497 (
[https://github.com/apache/spark/pull/29024/files#di
[
https://issues.apache.org/jira/browse/SPARK-37393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas resolved SPARK-37393.
--
Resolution: Duplicate
> Inline annotations for {ml, mllib}/common.py
> ---
[
https://issues.apache.org/jira/browse/SPARK-37283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447436#comment-17447436
]
Apache Spark commented on SPARK-37283:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-37283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447435#comment-17447435
]
Apache Spark commented on SPARK-37283:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447386#comment-17447386
]
Marek Novotny commented on SPARK-35885:
---
[~dongjoon] FYI, buster-cran35 is signed
[
https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-36357.
-
Fix Version/s: 3.3.0
Assignee: jiaan.geng
Resolution: Fixed
> Support pushdown T
[
https://issues.apache.org/jira/browse/SPARK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447280#comment-17447280
]
caican commented on SPARK-37382:
[~victor-wong] Does the images display nomally now?
>
[
https://issues.apache.org/jira/browse/SPARK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-37382:
---
Description:
In Spark3.1, the `with as` clause in the same SQL is executed multiple times,
got different r
[
https://issues.apache.org/jira/browse/SPARK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-37382:
---
Attachment: spark2.3.png
> `with as` clause got inconsistent results
> -
[
https://issues.apache.org/jira/browse/SPARK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-37382:
---
Attachment: spark3.1.png
> `with as` clause got inconsistent results
> -
[
https://issues.apache.org/jira/browse/SPARK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447277#comment-17447277
]
caican commented on SPARK-37382:
[~zhenw] Thank you for your reply, i will test it out.
[
https://issues.apache.org/jira/browse/SPARK-37438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37438:
Assignee: Apache Spark (was: Gengliang Wang)
> ANSI mode: Use store assignment rules for
[
https://issues.apache.org/jira/browse/SPARK-37438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447267#comment-17447267
]
Apache Spark commented on SPARK-37438:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-37438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37438:
Assignee: Gengliang Wang (was: Apache Spark)
> ANSI mode: Use store assignment rules for
[
https://issues.apache.org/jira/browse/SPARK-37438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-37438:
---
Description:
Under ANSI mode(spark.sql.ansi.enabled=true), the function invocation of Spark
Gengliang Wang created SPARK-37438:
--
Summary: ANSI mode: Use store assignment rules for resolving
function invocation
Key: SPARK-37438
URL: https://issues.apache.org/jira/browse/SPARK-37438
Project:
[
https://issues.apache.org/jira/browse/SPARK-37388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37388.
-
Fix Version/s: 3.1.3
3.2.1
3.3.0
Assignee: Tom van
74 matches
Mail list logo
