[
https://issues.apache.org/jira/browse/SPARK-27798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851576#comment-16851576
]
Dongjoon Hyun commented on SPARK-27798:
---
Is this fixed in `branch-2.4`, too?
> fr
[
https://issues.apache.org/jira/browse/SPARK-27821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27821:
--
Affects Version/s: (was: 2.3.3)
3.0.0
> Spark WebUI - show numbers
[
https://issues.apache.org/jira/browse/SPARK-27822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851573#comment-16851573
]
Dongjoon Hyun commented on SPARK-27822:
---
For the new feature, let's use 3.0.0 as `
[
https://issues.apache.org/jira/browse/SPARK-27822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27822:
--
Affects Version/s: (was: 2.3.3)
3.0.0
> Spark WebUi - for running a
[
https://issues.apache.org/jira/browse/SPARK-27827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851570#comment-16851570
]
Dongjoon Hyun commented on SPARK-27827:
---
Could you give us a reproducible procedur
[
https://issues.apache.org/jira/browse/SPARK-27832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-27832.
-
> Don't decompress and create column batch when the task is completed
>
[
https://issues.apache.org/jira/browse/SPARK-27840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-27840.
-
> Hadoop attempts to create a temporary folder in root folder
>
[
https://issues.apache.org/jira/browse/SPARK-27876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27876:
--
Summary: Split large shuffle partition to multi-segments to enable transfer
oversize shuffle p
[
https://issues.apache.org/jira/browse/SPARK-27863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27863.
---
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27864.
---
Resolution: Invalid
Please try the following Scala 2.12 Apache Spark 2.4.3. And feel free to
[
https://issues.apache.org/jira/browse/SPARK-27864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851549#comment-16851549
]
Dongjoon Hyun commented on SPARK-27864:
---
[~satorg2]. `2.4.3 (installed with homebr
[
https://issues.apache.org/jira/browse/SPARK-27866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27866.
---
Resolution: Invalid
Please feel free to reopen this if `-Phive` and the official `Apache Spa
[
https://issues.apache.org/jira/browse/SPARK-27866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851543#comment-16851543
]
Dongjoon Hyun edited comment on SPARK-27866 at 5/30/19 6:00 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-27866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851543#comment-16851543
]
Dongjoon Hyun edited comment on SPARK-27866 at 5/30/19 6:00 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-27866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851543#comment-16851543
]
Dongjoon Hyun commented on SPARK-27866:
---
It seems to be a configuration issue inst
[
https://issues.apache.org/jira/browse/SPARK-27866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27866:
--
Component/s: (was: Kubernetes)
SQL
> Cannot connect to hive metastore
> -
[
https://issues.apache.org/jira/browse/SPARK-27866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27866:
--
Labels: (was: bug)
> Cannot connect to hive metastore
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-27725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27725.
---
Resolution: Fixed
Fix Version/s: 3.0.0
This is resolved via https://github.com/apache
[
https://issues.apache.org/jira/browse/SPARK-27854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27854.
--
Resolution: Incomplete
There won't be more releases at 1.x line. We're resolving JIRAs affecti
[
https://issues.apache.org/jira/browse/SPARK-27873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851534#comment-16851534
]
Hyukjin Kwon commented on SPARK-27873:
--
Can you show a reproducer with output and e
[
https://issues.apache.org/jira/browse/SPARK-27876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-27876:
Description:
There is a limit for shuffle read.
If a shuffle partition block's size is large than Intege
[
https://issues.apache.org/jira/browse/SPARK-27876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-27876:
Description:
There is a limit for shuffle read.
If a shuffle partition block's size is large than Intege
[
https://issues.apache.org/jira/browse/SPARK-27876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27876:
Assignee: (was: Apache Spark)
> [CORE][SHUFFLE] Split large shuffle partition to mult
[
https://issues.apache.org/jira/browse/SPARK-27876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27876:
Assignee: Apache Spark
> [CORE][SHUFFLE] Split large shuffle partition to multi-segments
feiwang created SPARK-27876:
---
Summary: [CORE][SHUFFLE] Split large shuffle partition to
multi-segments to enable transfer oversize shuffle partition block.
Key: SPARK-27876
URL: https://issues.apache.org/jira/browse/SPA
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851445#comment-16851445
]
Thomas Graves commented on SPARK-27396:
---
The vote passed.
> SPIP: Public APIs for
[
https://issues.apache.org/jira/browse/SPARK-27875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27875:
Assignee: Apache Spark
> Wrap all PrintWrite with Utils.tryWithResource
> ---
[
https://issues.apache.org/jira/browse/SPARK-27875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27875:
Assignee: (was: Apache Spark)
> Wrap all PrintWrite with Utils.tryWithResource
>
Yuming Wang created SPARK-27875:
---
Summary: Wrap all PrintWrite with Utils.tryWithResource
Key: SPARK-27875
URL: https://issues.apache.org/jira/browse/SPARK-27875
Project: Spark
Issue Type: Impr
[
https://issues.apache.org/jira/browse/SPARK-27538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851440#comment-16851440
]
Hyukjin Kwon commented on SPARK-27538:
--
actually we can track it via the link too.
Bjorn Jonsson created SPARK-27874:
-
Summary: ShuffleBlockFetchIterator can log information about
per-block sizes
Key: SPARK-27874
URL: https://issues.apache.org/jira/browse/SPARK-27874
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Wong updated SPARK-27772:
-
Description:
The current `SQLTestUtils` created many `withXXX` utility functions to clean up
ta
[
https://issues.apache.org/jira/browse/SPARK-27772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Wong updated SPARK-27772:
-
Description:
The current `SQLTestUtils` created many `withXXX` utility functions to clean up
ta
[
https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27868:
--
Issue Type: Bug (was: Improvement)
> Better document shuffle / RPC listen backlog
> -
[
https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27868.
---
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-27378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27378:
Assignee: (was: Apache Spark)
> spark-submit requests GPUs in YARN mode
> ---
[
https://issues.apache.org/jira/browse/SPARK-27378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851338#comment-16851338
]
Apache Spark commented on SPARK-27378:
--
User 'tgravescs' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-27378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27378:
Assignee: Apache Spark
> spark-submit requests GPUs in YARN mode
> --
[
https://issues.apache.org/jira/browse/SPARK-27376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27376.
---
Resolution: Fixed
resolving this since seems no objections
> Design: YARN supports Spark GP
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851298#comment-16851298
]
Thomas Graves commented on SPARK-27361:
---
Note the design Jira covers more details.
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27361:
--
Description:
Design and implement YARN support for GPU-aware scheduling:
* User can request G
[
https://issues.apache.org/jira/browse/SPARK-27849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27849.
---
Resolution: Fixed
Assignee: Gengliang Wang
Fix Version/s: 3.0.0
This is reso
Marcin Mejran created SPARK-27873:
-
Summary: Csv reader, adding a corrupt record column causes error
if enforceSchema=false
Key: SPARK-27873
URL: https://issues.apache.org/jira/browse/SPARK-27873
Proj
[
https://issues.apache.org/jira/browse/SPARK-25466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-25466.
---
Resolution: Duplicate
This has been resolved in SPARK-27687.
> Documentation does not speci
[
https://issues.apache.org/jira/browse/SPARK-27538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851185#comment-16851185
]
Li Jin commented on SPARK-27538:
[~hyukjin.kwon] I saw you closed this. I wonder if this
[
https://issues.apache.org/jira/browse/SPARK-27869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27869.
---
Resolution: Fixed
Assignee: Aaruna Godthi
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-27869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27869:
--
Affects Version/s: 2.3.3
> Redact sensitive information in System Properties from UI
> ---
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851026#comment-16851026
]
Erik Erlandson commented on SPARK-27872:
[~skonto], executors were never given a
[
https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850879#comment-16850879
]
Stavros Kontopoulos edited comment on SPARK-24815 at 5/29/19 2:05 PM:
[
https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850879#comment-16850879
]
Stavros Kontopoulos commented on SPARK-24815:
-
I agree with [~gsomogyi] on s
[
https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850834#comment-16850834
]
Sébastien BARNOUD commented on SPARK-21827:
---
https://issues.apache.org/jira/br
[
https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23472:
Assignee: Apache Spark
> Add config properties for administrator JVM options
> --
[
https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23472:
Assignee: (was: Apache Spark)
> Add config properties for administrator JVM options
>
[
https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850821#comment-16850821
]
Gabor Somogyi commented on SPARK-23472:
---
I've picked this up and started to work o
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Summary: Driver and executors use a different service account breaking pull
secret
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850804#comment-16850804
]
Stavros Kontopoulos commented on SPARK-27872:
-
[~eje] [~liyinan926] I can pr
Stavros Kontopoulos created SPARK-27872:
---
Summary: Driver and executors use a different service acount
Key: SPARK-27872
URL: https://issues.apache.org/jira/browse/SPARK-27872
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27872:
Description:
Driver and executors use different service accounts in case the drive
[
https://issues.apache.org/jira/browse/SPARK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Guo updated SPARK-27792:
--
Shepherd: Dongjoon Hyun (was: Liang-Chi Hsieh)
> SkewJoin--handle only skewed keys with broadcastjoin
[
https://issues.apache.org/jira/browse/SPARK-27865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Guo updated SPARK-27865:
--
Shepherd: Dongjoon Hyun
> Spark SQL support 1:N sort merge bucket join without shuffle
> -
[
https://issues.apache.org/jira/browse/SPARK-27832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-27832.
-
Resolution: Won't Fix
> Don't decompress and create column batch when the task is comple
[
https://issues.apache.org/jira/browse/SPARK-23098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23098:
Assignee: Apache Spark
> Migrate Kafka batch source to v2
> -
[
https://issues.apache.org/jira/browse/SPARK-23098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23098:
Assignee: (was: Apache Spark)
> Migrate Kafka batch source to v2
> --
[
https://issues.apache.org/jira/browse/SPARK-27854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850653#comment-16850653
]
kai zhao commented on SPARK-27854:
--
It's hard to check this issue in higher version.
[
https://issues.apache.org/jira/browse/SPARK-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850631#comment-16850631
]
Peter Nijem commented on SPARK-27842:
-
The issue reproduces as well on the latest Sp
[
https://issues.apache.org/jira/browse/SPARK-27829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27829.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24693
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850596#comment-16850596
]
Gabor Somogyi commented on SPARK-24815:
---
{quote}If somebody can give me pointers o
78 matches
Mail list logo
