[
https://issues.apache.org/jira/browse/SPARK-37471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-37471:
--
Description:
{code}
/*
select
select /* BROADCAST(b) */ 4\\;
*/
select 1
;
{code}
failed in
[
https://issues.apache.org/jira/browse/SPARK-37471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-37471:
--
Description:
{code}
/*
select
select /* BROADCAST(b) */ 4\\;
*/
select 1
;
{code}
failed in
[
https://issues.apache.org/jira/browse/SPARK-37471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-37471:
--
Description:
{code}
/*
select
select /* BROADCAST(b) */ 4\\;
*/
select 1
;
{code}
failed in
[
https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-37099:
-
Description:
in JD, we found that more than 90% usage of window function follows this
pattern:
angerszhu created SPARK-37471:
-
Summary: spark-sql support nested bracketed comment
Key: SPARK-37471
URL: https://issues.apache.org/jira/browse/SPARK-37471
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449384#comment-17449384
]
Apache Spark commented on SPARK-37469:
--
User 'toujours33' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449383#comment-17449383
]
Apache Spark commented on SPARK-37469:
--
User 'toujours33' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37469:
Assignee: (was: Apache Spark)
> Unified "fetchWaitTime" and "shuffleReadTime"
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37469:
Assignee: Apache Spark
> Unified "fetchWaitTime" and "shuffleReadTime" metrics On UI
>
[
https://issues.apache.org/jira/browse/SPARK-37470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449379#comment-17449379
]
Yuto Akutsu commented on SPARK-37470:
-
I'm working on this.
> A new created table gets duplicated
Yuto Akutsu created SPARK-37470:
---
Summary: A new created table gets duplicated after ALTER DATABASE
SET LOCATION command
Key: SPARK-37470
URL: https://issues.apache.org/jira/browse/SPARK-37470
Project:
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yazhi Wang updated SPARK-37469:
---
Attachment: executor-page.png
sql-page.png
> Unified "fetchWaitTime" and
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yazhi Wang updated SPARK-37469:
---
Description:
Metrics in Executor/Task page shown as "
Shuffle Read Block Time", and the SQL page
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449371#comment-17449371
]
Yazhi Wang commented on SPARK-37469:
I'm working on it
> Unified "fetchWaitTime" and
[
https://issues.apache.org/jira/browse/SPARK-37469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yazhi Wang updated SPARK-37469:
---
Description:
Metrics in Executor/Task page shown as "
Shuffle Read Block Time", and the SQL page
Yazhi Wang created SPARK-37469:
--
Summary: Unified "fetchWaitTime" and "shuffleReadTime" metrics On
UI
Key: SPARK-37469
URL: https://issues.apache.org/jira/browse/SPARK-37469
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449370#comment-17449370
]
Apache Spark commented on SPARK-37381:
--
User 'Peng-Lei' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37381:
Assignee: Apache Spark
> Unify v1 and v2 SHOW CREATE TABLE tests
>
[
https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37381:
Assignee: (was: Apache Spark)
> Unify v1 and v2 SHOW CREATE TABLE tests
>
[
https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449369#comment-17449369
]
Apache Spark commented on SPARK-37381:
--
User 'Peng-Lei' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449367#comment-17449367
]
Apache Spark commented on SPARK-37460:
--
User 'yutoacts' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37460:
Assignee: Apache Spark
> ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37460:
Assignee: (was: Apache Spark)
> ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION
[
https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-37099:
-
Description:
in JD, we found that more than 90% usage of window function follows this
pattern:
[
https://issues.apache.org/jira/browse/SPARK-37468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37468:
Assignee: Kousuke Saruta (was: Apache Spark)
> Support ANSI intervals and TimestampNTZ
[
https://issues.apache.org/jira/browse/SPARK-37468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449364#comment-17449364
]
Apache Spark commented on SPARK-37468:
--
User 'sarutak' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37468:
Assignee: Apache Spark (was: Kousuke Saruta)
> Support ANSI intervals and TimestampNTZ
[
https://issues.apache.org/jira/browse/SPARK-37468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37468:
---
Description: Currently, UnionEstimation doesn't support ANSI intervals and
TimestampNTZ.
Kousuke Saruta created SPARK-37468:
--
Summary: Support ANSI intervals and TimestampNTZ for
UnionEstimation
Key: SPARK-37468
URL: https://issues.apache.org/jira/browse/SPARK-37468
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449362#comment-17449362
]
Apache Spark commented on SPARK-37445:
--
User 'AngersZh' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449358#comment-17449358
]
Hyukjin Kwon commented on SPARK-37465:
--
cc [~yikunkero] and [~itholic] FYI
> PySpark tests failing
[
https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449357#comment-17449357
]
Hyukjin Kwon commented on SPARK-37465:
--
Maybe we should rather bump up the minimum pandas version
[
https://issues.apache.org/jira/browse/SPARK-37457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37457:
Assignee: Hyukjin Kwon
> Update cloudpickle to v2.0.0
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-37457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37457.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34705
[
https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449352#comment-17449352
]
dch nguyen commented on SPARK-37381:
Can I go for it? I want to try to fix it [~xiaopenglei]
[
https://issues.apache.org/jira/browse/SPARK-37436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37436.
--
Fix Version/s: 3.3.0
Assignee: Hyukjin Kwon
Resolution: Fixed
Fixed in
Adam Binford created SPARK-37467:
Summary: Consolidate whole stage and non-whole stage subexpression
elimination
Key: SPARK-37467
URL: https://issues.apache.org/jira/browse/SPARK-37467
Project: Spark
Adam Binford created SPARK-37466:
Summary: Support subexpression elimination in lambda functions
Key: SPARK-37466
URL: https://issues.apache.org/jira/browse/SPARK-37466
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37445:
Assignee: Apache Spark
> Update hadoop-profile
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37445:
Assignee: (was: Apache Spark)
> Update hadoop-profile
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reopened SPARK-37445:
--
Assignee: (was: angerszhu)
Reverted at
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-37445:
-
Fix Version/s: (was: 3.3.0)
> Update hadoop-profile
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32079:
Assignee: Hyukjin Kwon
> PySpark <> Beam pickling issues for collections.namedtuple
>
[
https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32079.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34688
[
https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Willi Raschkowski updated SPARK-37465:
--
Description:
I was running Spark tests with Pandas {{0.23.4}} and got the error
Willi Raschkowski created SPARK-37465:
-
Summary: PySpark tests failing on Pandas 0.23
Key: SPARK-37465
URL: https://issues.apache.org/jira/browse/SPARK-37465
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37464:
Assignee: Apache Spark
> SCHEMA and DATABASE should simply be aliases of NAMESPACE
>
[
https://issues.apache.org/jira/browse/SPARK-37464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37464:
Assignee: (was: Apache Spark)
> SCHEMA and DATABASE should simply be aliases of
[
https://issues.apache.org/jira/browse/SPARK-37464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449227#comment-17449227
]
Apache Spark commented on SPARK-37464:
--
User 'cloud-fan' has created a pull request for this issue:
Wenchen Fan created SPARK-37464:
---
Summary: SCHEMA and DATABASE should simply be aliases of NAMESPACE
Key: SPARK-37464
URL: https://issues.apache.org/jira/browse/SPARK-37464
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-37463:
---
Summary: Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp (was:
read/write Timestamp ntz
[
https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37463:
Assignee: Apache Spark
> read/write Timestamp ntz or ltz to Orc uses UTC timestamp
>
[
https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449179#comment-17449179
]
Apache Spark commented on SPARK-37463:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37463:
Assignee: (was: Apache Spark)
> read/write Timestamp ntz or ltz to Orc uses UTC
jiaan.geng created SPARK-37463:
--
Summary: read/write Timestamp ntz or ltz to Orc uses UTC timestamp
Key: SPARK-37463
URL: https://issues.apache.org/jira/browse/SPARK-37463
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449170#comment-17449170
]
Apache Spark commented on SPARK-37462:
--
User 'weixiuli' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37462:
Assignee: Apache Spark
> Avoid unnecessary calculating the number of outstanding fetch
[
https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37462:
Assignee: (was: Apache Spark)
> Avoid unnecessary calculating the number of
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37445:
---
Assignee: angerszhu
> Update hadoop-profile
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37445.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34689
[
https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
weixiuli updated SPARK-37462:
-
Description: It is unnecessary to calculate the number of outstanding fetch
requests and RPCS when the
[
https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
weixiuli updated SPARK-37462:
-
Description: To avoid unnecessary calculation of outstanding fetch requests
and RPCS (was: To avoid
[
https://issues.apache.org/jira/browse/SPARK-37311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37311.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34708
[
https://issues.apache.org/jira/browse/SPARK-37311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37311:
---
Assignee: Terry Kim
> Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by
weixiuli created SPARK-37462:
Summary: To avoid unnecessary flight request calculations
Key: SPARK-37462
URL: https://issues.apache.org/jira/browse/SPARK-37462
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449135#comment-17449135
]
Apache Spark commented on SPARK-37461:
--
User 'AngersZh' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37461:
Assignee: (was: Apache Spark)
> yarn-client mode client's appid value is null
>
[
https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37461:
Assignee: Apache Spark
> yarn-client mode client's appid value is null
>
[
https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449133#comment-17449133
]
Apache Spark commented on SPARK-37461:
--
User 'AngersZh' has created a pull request for this
angerszhu created SPARK-37461:
-
Summary: yarn-client mode client's appid value is null
Key: SPARK-37461
URL: https://issues.apache.org/jira/browse/SPARK-37461
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449072#comment-17449072
]
Apache Spark commented on SPARK-37259:
--
User 'akhalymon-cv' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449067#comment-17449067
]
Andrew commented on SPARK-37259:
I've created another PR following [~KevinAppelBofa] idea to unwrap the
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449049#comment-17449049
]
Yuto Akutsu commented on SPARK-37460:
-
I'm working on this.
> ALTER (DATABASE|SCHEMA|NAMESPACE) ...
[
https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37357.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34634
[
https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37357:
---
Assignee: XiDuo You
> Add small partition factor for rebalance partitions
>
[
https://issues.apache.org/jira/browse/SPARK-37311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449025#comment-17449025
]
Apache Spark commented on SPARK-37311:
--
User 'imback82' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37311:
Assignee: Apache Spark
> Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by
[
https://issues.apache.org/jira/browse/SPARK-37311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37311:
Assignee: (was: Apache Spark)
> Migrate ALTER NAMESPACE ... SET LOCATION to use v2
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuto Akutsu updated SPARK-37460:
Description: The instruction of {color:#ff}ALTER DATABASE ... SET
LOCATION ...
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuto Akutsu updated SPARK-37460:
Description: The instruction of {color:#FF}ALTER DATABASE ... SET
LOCATION ...
[
https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuto Akutsu updated SPARK-37460:
Description: The instruction of {color:#ff}ALTER DATABASE ... SET
LOCATION ...{color:#172b4d}
Yuto Akutsu created SPARK-37460:
---
Summary: ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION
command not documented
Key: SPARK-37460
URL: https://issues.apache.org/jira/browse/SPARK-37460
Project:
[
https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37454.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34699
[
https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37454:
---
Assignee: Wenchen Fan
> support expressions in time travel timestamp
>
84 matches
Mail list logo
