Hyukjin Kwon created SPARK-28578:
Summary: Improve Github pull request template
Key: SPARK-28578
URL: https://issues.apache.org/jira/browse/SPARK-28578
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-28577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-28577:
-
Description: If MEMORY_OFFHEAP_ENABLED is true, we should ensure
executorOverheadMemory not less than ME
Yang Jie created SPARK-28577:
Summary: Ensure executorMemoryHead requested value not less than
MEMORY_OFFHEAP_SIZE when MEMORY_OFFHEAP_ENABLED is true
Key: SPARK-28577
URL: https://issues.apache.org/jira/browse/SPARK-
[
https://issues.apache.org/jira/browse/SPARK-28529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28529.
-
Resolution: Duplicate
> Fix PullupCorrelatedPredicates optimizer rule to enforce idempotence
> -
[
https://issues.apache.org/jira/browse/SPARK-28529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28529:
---
Assignee: Dilip Biswal
> Fix PullupCorrelatedPredicates optimizer rule to enforce idempotence
> ---
[
https://issues.apache.org/jira/browse/SPARK-28348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-28348.
-
Resolution: Won't Fix
> Avoid cast twice for decimal type
> -
>
[
https://issues.apache.org/jira/browse/SPARK-28576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-28576:
---
Description: After enable AE(SPARK-23128), we found the dead lock issue in
Q6 1TB TPC-DS. The root cause is
[
https://issues.apache.org/jira/browse/SPARK-28576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-28576:
---
Description: After enable
AE([lSPARK-23128|https://issues.apache.org/jira/browse/SPARK-23128]), we found
th
[
https://issues.apache.org/jira/browse/SPARK-28576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-28576:
---
Attachment: q6.sql
physical plan.txt
jstack.log
> Fix the dead lock issue w
Ke Jia created SPARK-28576:
--
Summary: Fix the dead lock issue when enable new adaptive
execution
Key: SPARK-28576
URL: https://issues.apache.org/jira/browse/SPARK-28576
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-25382:
Assignee: Weichen Xu
> Remove ImageSchema.readImages in 3.0
> ---
[
https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25382.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25245
[https://gi
Kushal Mahajan created SPARK-28575:
--
Summary: Spark job time increasing when upgrading Spark from 2.1.1
to 2.3.1
Key: SPARK-28575
URL: https://issues.apache.org/jira/browse/SPARK-28575
Project: Spark
Yun Zou created SPARK-28574:
---
Summary: Allow to config different sizes for event queues
Key: SPARK-28574
URL: https://issues.apache.org/jira/browse/SPARK-28574
Project: Spark
Issue Type: Improvemen
Xianjin YE created SPARK-28573:
--
Summary: Convert InsertIntoTable(HiveTableRelation) to Datasource
inserting for partitioned table
Key: SPARK-28573
URL: https://issues.apache.org/jira/browse/SPARK-28573
[
https://issues.apache.org/jira/browse/SPARK-28038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28038:
Assignee: Yuming Wang
> Add text.sql
>
>
> Key: SPARK-28038
[
https://issues.apache.org/jira/browse/SPARK-28038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28038.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24862
[https://gi
Burak Yavuz created SPARK-28572:
---
Summary: Add simple analysis checks to the V2 Create Table code
paths
Key: SPARK-28572
URL: https://issues.apache.org/jira/browse/SPARK-28572
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28426:
---
Assignee: yuming.wang
> Metadata Handling in Thrift Server
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28426:
---
Assignee: Yuming Wang (was: yuming.wang)
> Metadata Handling in Thrift Server
> --
[
https://issues.apache.org/jira/browse/SPARK-26175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-26175.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25138
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-26175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-26175:
Assignee: Weichen Xu
> PySpark cannot terminate worker process if user program reads from
[
https://issues.apache.org/jira/browse/SPARK-27994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicolas Pascal resolved SPARK-27994.
Resolution: Invalid
After investigation, data produced was not correct format
> Spark Avr
[
https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896617#comment-16896617
]
Xiao Li commented on SPARK-28375:
-
This is possible, if users add the rule into postHocO
[
https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28375.
-
Resolution: Fixed
Assignee: Dilip Biswal
Fix Version/s: 3.0.0
> Enforce idempotence on t
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-28209:
---
Description: Adds the write-side API for storing shuffle data in arbitrary
storage systems. Also ref
Matt Cheah created SPARK-28571:
--
Summary: Shuffle storage API: Use API in SortShuffleWriter
Key: SPARK-28571
URL: https://issues.apache.org/jira/browse/SPARK-28571
Project: Spark
Issue Type: Sub
Matt Cheah created SPARK-28570:
--
Summary: Shuffle Storage API: Use writer API in UnsafeShuffleWriter
Key: SPARK-28570
URL: https://issues.apache.org/jira/browse/SPARK-28570
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-28209:
---
Summary: Shuffle Storage API: Writer API and usage in
BypassMergeSortShuffleWriter (was: Shuffle St
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-28209:
---
Summary: Shuffle Storage API: Writer API (was: Shuffle Storage API: Writes)
> Shuffle Storage API:
Sean Mackrory created SPARK-28569:
-
Summary: Recommended additions to SECRET_REDACTION_PATTERN
Key: SPARK-28569
URL: https://issues.apache.org/jira/browse/SPARK-28569
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-26152:
Affects Version/s: 2.4.0
2.4.1
2.4.2
2
[
https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-26152:
Fix Version/s: 2.4.4
> Synchronize Worker Cleanup with Worker Shutdown
> -
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-28209.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25007
[https:
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-28209:
--
Assignee: Matt Cheah
> Shuffle Storage API: Writes
> ---
>
>
Matt Cheah created SPARK-28568:
--
Summary: Make Javadoc in org.apache.spark.shuffle.api visible
Key: SPARK-28568
URL: https://issues.apache.org/jira/browse/SPARK-28568
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26152:
--
Summary: Synchronize Worker Cleanup with Worker Shutdown (was: Flaky test:
BroadcastSuite)
>
[
https://issues.apache.org/jira/browse/SPARK-28525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-28525.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25265
[https:
Ganesh Kumar created SPARK-28567:
Summary: pyspark-sql returns error "Paths and fileStatuses are
expected to be 1. . Got paths: 1 fileStatuses: 26"
Key: SPARK-28567
URL: https://issues.apache.org/jira/browse/SPARK
Dylan Guedes created SPARK-28566:
Summary: window functions should not be allowed in window
definitions
Key: SPARK-28566
URL: https://issues.apache.org/jira/browse/SPARK-28566
Project: Spark
John Zhuge created SPARK-28565:
--
Summary: DataSourceV2: DataFrameWriter.saveAsTable
Key: SPARK-28565
URL: https://issues.apache.org/jira/browse/SPARK-28565
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-28565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Zhuge updated SPARK-28565:
---
Description:
Support multiple catalogs in the following use cases:
* DataFrameWriter.saveAsTable("c
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-27689:
Comment: was deleted
(was: It seemed that this failure is caused by PR-SPARK-18801,
https://github.com/
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896249#comment-16896249
]
feiwang commented on SPARK-27689:
-
It seemed that this failure is caused by PR-SPARK-18
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896247#comment-16896247
]
feiwang commented on SPARK-27689:
-
It seemed that this failure is caused by PR-SPARK-18
[
https://issues.apache.org/jira/browse/SPARK-28399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-28399:
-
Assignee: zhengruifeng
> Impl RobustScaler
> -
>
> Key: SPARK-2
[
https://issues.apache.org/jira/browse/SPARK-28399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-28399.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25160
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid reassigned SPARK-26755:
Assignee: Parth Gandhi
> Optimize Spark Scheduler to dequeue speculative tasks more effic
[
https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-26755.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23677
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-28519:
--
Docs Text:
The result of `java.lang.Math`'s `log`, `log1p`, `exp`, `expm1`, and `pow` may
vary across
[
https://issues.apache.org/jira/browse/SPARK-28564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dzcxzl updated SPARK-28564:
---
Description:
When we set spark.history.ui.maxApplications to a small value, we can't get
some apps from the
dzcxzl created SPARK-28564:
--
Summary: Access history application defaults to the last attempt id
Key: SPARK-28564
URL: https://issues.apache.org/jira/browse/SPARK-28564
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-28503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28503:
---
Summary: Return null result on cast an out-of-range value to a integral
type (was: Return n
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896132#comment-16896132
]
Li Jin edited comment on SPARK-28482 at 7/30/19 1:28 PM:
-
Hi [~j
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896132#comment-16896132
]
Li Jin edited comment on SPARK-28482 at 7/30/19 1:28 PM:
-
Hi [~j
[
https://issues.apache.org/jira/browse/SPARK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-28561:
---
Summary: DAG viz for barrier-execution mode (was: DAG viz for barrier-mode
execution)
> DA
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896132#comment-16896132
]
Li Jin commented on SPARK-28482:
Hi [~jiangyu1211], thank you for the bug report.
>Fro
[
https://issues.apache.org/jira/browse/SPARK-28553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Guedes resolved SPARK-28553.
--
Resolution: Duplicate
This is a duplicate of SPARK-28379.
> subqueries must be aggregated bef
[
https://issues.apache.org/jira/browse/SPARK-28553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896064#comment-16896064
]
Dylan Guedes commented on SPARK-28553:
--
Oh, my bad. I even look'd for an already cr
[
https://issues.apache.org/jira/browse/SPARK-28563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vishal Donderia resolved SPARK-28563.
-
Resolution: Not A Bug
> Spark 2.4 | Reading all the data inside partition like director
Vishal Donderia created SPARK-28563:
---
Summary: Spark 2.4 | Reading all the data inside partition like
directory.
Key: SPARK-28563
URL: https://issues.apache.org/jira/browse/SPARK-28563
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-28071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-28071.
--
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
Resolved
Albertus Kelvin created SPARK-28562:
---
Summary: PySpark profiling is not understandable
Key: SPARK-28562
URL: https://issues.apache.org/jira/browse/SPARK-28562
Project: Spark
Issue Type: Que
[
https://issues.apache.org/jira/browse/SPARK-28559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28559.
--
Resolution: Duplicate
> when execute "create table" on ThriftServer ,the hive table owner is
[
https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28178:
---
Assignee: John Zhuge
> DataSourceV2: DataFrameWriter.insertInfo
> -
[
https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28178.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24980
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-28156:
Fix Version/s: 2.3.4
> Join plan sometimes does not use cached query
> ---
[
https://issues.apache.org/jira/browse/SPARK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895862#comment-16895862
]
Kousuke Saruta commented on SPARK-28561:
I've attached images of my prototype im
Kousuke Saruta created SPARK-28561:
--
Summary: DAG viz for barrier-mode execution
Key: SPARK-28561
URL: https://issues.apache.org/jira/browse/SPARK-28561
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-28561:
---
Attachment: Screenshot from 2019-07-30 16-31-09.png
Screenshot from 2019-07-3
[
https://issues.apache.org/jira/browse/SPARK-28406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28406.
---
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
This is resolve
[
https://issues.apache.org/jira/browse/SPARK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28326.
---
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
This is resolve
72 matches
Mail list logo
