[
https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14303092#comment-14303092
]
WangTaoTheTonic commented on SPARK-2945:
I also tested on master and branch 1.2, `
WangTaoTheTonic created SPARK-5337:
--
Summary: respect spark.task.cpus when launch executors
Key: SPARK-5337
URL: https://issues.apache.org/jira/browse/SPARK-5337
Project: Spark
Issue Type: B
WangTaoTheTonic created SPARK-5336:
--
Summary: spark.executor.cores must not be less than spark.task.cpus
Key: SPARK-5336
URL: https://issues.apache.org/jira/browse/SPARK-5336
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282397#comment-14282397
]
WangTaoTheTonic commented on SPARK-4697:
Should this be closed?
> System properti
[
https://issues.apache.org/jira/browse/SPARK-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282396#comment-14282396
]
WangTaoTheTonic commented on SPARK-5222:
If I didn't miss something, the issue des
[
https://issues.apache.org/jira/browse/SPARK-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276429#comment-14276429
]
WangTaoTheTonic commented on SPARK-3678:
In SparkHdfsLR there has {quote}val spark
[
https://issues.apache.org/jira/browse/SPARK-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic closed SPARK-5170.
--
Resolution: Duplicate
Duplicated submit as the server block issue. So close it.
> fetch the cor
WangTaoTheTonic created SPARK-5170:
--
Summary: fetch the correct max attempts
Key: SPARK-5170
URL: https://issues.apache.org/jira/browse/SPARK-5170
Project: Spark
Issue Type: Bug
Co
WangTaoTheTonic created SPARK-5169:
--
Summary: fetch the correct max attempts
Key: SPARK-5169
URL: https://issues.apache.org/jira/browse/SPARK-5169
Project: Spark
Issue Type: Bug
Co
[
https://issues.apache.org/jira/browse/SPARK-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic closed SPARK-5120.
--
Resolution: Won't Fix
> Output the thread name in log4j.properties
> ---
WangTaoTheTonic created SPARK-5130:
--
Summary: yarn-cluster mode should not be considered as client mode
in spark-submit
Key: SPARK-5130
URL: https://issues.apache.org/jira/browse/SPARK-5130
Project:
[
https://issues.apache.org/jira/browse/SPARK-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-5120:
---
Issue Type: Improvement (was: Bug)
> Output the thread name in log4j.properties
> ---
WangTaoTheTonic created SPARK-5120:
--
Summary: Output the thread name in log4j.properties
Key: SPARK-5120
URL: https://issues.apache.org/jira/browse/SPARK-5120
Project: Spark
Issue Type: Bug
WangTaoTheTonic created SPARK-5057:
--
Summary: Add more details in log when using actor to get infos
Key: SPARK-5057
URL: https://issues.apache.org/jira/browse/SPARK-5057
Project: Spark
Issue
WangTaoTheTonic created SPARK-5006:
--
Summary: spark.port.maxRetries doesn't work
Key: SPARK-5006
URL: https://issues.apache.org/jira/browse/SPARK-5006
Project: Spark
Issue Type: Bug
WangTaoTheTonic created SPARK-4990:
--
Summary: Search SPARK_CONF_DIR first when --properties-file is not
specified
Key: SPARK-4990
URL: https://issues.apache.org/jira/browse/SPARK-4990
Project: Spark
WangTaoTheTonic created SPARK-4832:
--
Summary: some other processes might take the daemon pid
Key: SPARK-4832
URL: https://issues.apache.org/jira/browse/SPARK-4832
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237835#comment-14237835
]
WangTaoTheTonic commented on SPARK-4697:
I took a quick look at the results filter
[
https://issues.apache.org/jira/browse/SPARK-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic closed SPARK-4181.
--
Resolution: Duplicate
> Create separate options to control the client-mode AM resource allocatio
[
https://issues.apache.org/jira/browse/SPARK-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237794#comment-14237794
]
WangTaoTheTonic commented on SPARK-4181:
I see an related issue SPARK-4696 opened
[
https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237785#comment-14237785
]
WangTaoTheTonic commented on SPARK-4705:
We have an configuration item "spark.even
[
https://issues.apache.org/jira/browse/SPARK-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237163#comment-14237163
]
WangTaoTheTonic commented on SPARK-4181:
I couldn't think out one case for extraLi
[
https://issues.apache.org/jira/browse/SPARK-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234305#comment-14234305
]
WangTaoTheTonic commented on SPARK-4181:
Maybe I didn't describe exactly here. Wha
WangTaoTheTonic created SPARK-4697:
--
Summary: System properties should override environment variables
Key: SPARK-4697
URL: https://issues.apache.org/jira/browse/SPARK-4697
Project: Spark
Iss
WangTaoTheTonic created SPARK-4669:
--
Summary: Allow users to set arbitrary akka configurations via
property file
Key: SPARK-4669
URL: https://issues.apache.org/jira/browse/SPARK-4669
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic closed SPARK-4451.
--
Resolution: Won't Fix
it is better for catching bugs in future to keep not forcing to kill daemo
[
https://issues.apache.org/jira/browse/SPARK-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4451:
---
Description:
When we stop history server or thrift server, sometimes they were not totally
st
[
https://issues.apache.org/jira/browse/SPARK-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225557#comment-14225557
]
WangTaoTheTonic commented on SPARK-4598:
I think pagination is a better idea. Allo
WangTaoTheTonic created SPARK-4451:
--
Summary: force to kill process after 5 seconds
Key: SPARK-4451
URL: https://issues.apache.org/jira/browse/SPARK-4451
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4404:
---
Description:
When we have spark.driver.extra* or spark.driver.memory in
SPARK_SUBMIT_PROPERTI
WangTaoTheTonic created SPARK-4404:
--
Summary: SparkSubmitDriverBootstrapper should stop after its
SparkSubmit sub-process ends
Key: SPARK-4404
URL: https://issues.apache.org/jira/browse/SPARK-4404
P
[
https://issues.apache.org/jira/browse/SPARK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4253:
---
Summary: Ignore spark.driver.host in yarn-cluster and standalone-cluster
mode (was: Ignore sp
[
https://issues.apache.org/jira/browse/SPARK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4253:
---
Description:
We actually don't know where driver will be before it is launched in
yarn-cluste
[
https://issues.apache.org/jira/browse/SPARK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4253:
---
Attachment: Cannot assign requested address.txt
Attach the exception content.
> Ignore spark.
WangTaoTheTonic created SPARK-4253:
--
Summary: Ignore spark.driver.host in yarn-cluster mode
Key: SPARK-4253
URL: https://issues.apache.org/jira/browse/SPARK-4253
Project: Spark
Issue Type: B
WangTaoTheTonic created SPARK-4181:
--
Summary: Create separate options to control the client-mode AM
resource allocation request
Key: SPARK-4181
URL: https://issues.apache.org/jira/browse/SPARK-4181
P
WangTaoTheTonic created SPARK-4116:
--
Summary: Delete the abandoned log4j-spark-container.properties
Key: SPARK-4116
URL: https://issues.apache.org/jira/browse/SPARK-4116
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4096:
---
Summary: let ApplicationMaster accept executor memory argument in same
format as JVM memory st
[
https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-4096:
---
Description: Here ApplicationMaster accept executor memory argument only in
number format, we
WangTaoTheTonic created SPARK-4098:
--
Summary: use appUIAddress instead of appUIHostPort in yarn-client
mode
Key: SPARK-4098
URL: https://issues.apache.org/jira/browse/SPARK-4098
Project: Spark
WangTaoTheTonic created SPARK-4096:
--
Summary: Update executor memory description in the help message
Key: SPARK-4096
URL: https://issues.apache.org/jira/browse/SPARK-4096
Project: Spark
Issu
WangTaoTheTonic created SPARK-4095:
--
Summary: [YARN][Minor]extract val isLaunchingDriver in ClientBase
Key: SPARK-4095
URL: https://issues.apache.org/jira/browse/SPARK-4095
Project: Spark
Is
WangTaoTheTonic created SPARK-3890:
--
Summary: remove redundant spark.executor.memory in doc
Key: SPARK-3890
URL: https://issues.apache.org/jira/browse/SPARK-3890
Project: Spark
Issue Type: I
WangTaoTheTonic created SPARK-3722:
--
Summary: Spark on yarn docs work
Key: SPARK-3722
URL: https://issues.apache.org/jira/browse/SPARK-3722
Project: Spark
Issue Type: Improvement
C
[
https://issues.apache.org/jira/browse/SPARK-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-3715:
---
Description: Fix some typo.
> [Docs]Minor typo
>
>
> Key: SPA
WangTaoTheTonic created SPARK-3715:
--
Summary: [Docs]Minor typo
Key: SPARK-3715
URL: https://issues.apache.org/jira/browse/SPARK-3715
Project: Spark
Issue Type: Improvement
Componen
WangTaoTheTonic created SPARK-3696:
--
Summary: Do not override user-defined conf_dir in spark-config.sh
Key: SPARK-3696
URL: https://issues.apache.org/jira/browse/SPARK-3696
Project: Spark
Is
WangTaoTheTonic created SPARK-3658:
--
Summary: Take thrift server as a daemon
Key: SPARK-3658
URL: https://issues.apache.org/jira/browse/SPARK-3658
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-3599:
---
Attachment: too many verbose.txt
> Avoid loading and printing properties file content frequent
WangTaoTheTonic created SPARK-3599:
--
Summary: Avoid loading and printing properties file content
frequently
Key: SPARK-3599
URL: https://issues.apache.org/jira/browse/SPARK-3599
Project: Spark
WangTaoTheTonic created SPARK-3589:
--
Summary: [Minor]Remove redundant code in deploy module
Key: SPARK-3589
URL: https://issues.apache.org/jira/browse/SPARK-3589
Project: Spark
Issue Type: I
WangTaoTheTonic created SPARK-3565:
--
Summary: make code consistent with document
Key: SPARK-3565
URL: https://issues.apache.org/jira/browse/SPARK-3565
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-3547:
---
Description:
It incurred runtime exception when hadoop version is not A.B.* format, which is
WangTaoTheTonic created SPARK-3547:
--
Summary: Maybe we should not simply make return code 1 equal to
CLASS_NOT_FOUND
Key: SPARK-3547
URL: https://issues.apache.org/jira/browse/SPARK-3547
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-3411:
---
Description:
If the waiting driver array is too big, the drivers in it will be dispatched to
[
https://issues.apache.org/jira/browse/SPARK-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-3411:
---
Summary: Improve load-balancing of concurrently-submitted drivers across
workers (was: Optimi
WangTaoTheTonic created SPARK-3411:
--
Summary: Optimize the schedule procedure in Master
Key: SPARK-3411
URL: https://issues.apache.org/jira/browse/SPARK-3411
Project: Spark
Issue Type: Impro
WangTaoTheTonic created SPARK-3344:
--
Summary: Reformat code: add blank lines
Key: SPARK-3344
URL: https://issues.apache.org/jira/browse/SPARK-3344
Project: Spark
Issue Type: Test
C
WangTaoTheTonic created SPARK-3225:
--
Summary: Typo in script
Key: SPARK-3225
URL: https://issues.apache.org/jira/browse/SPARK-3225
Project: Spark
Issue Type: Bug
Components: Deploy
[
https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic reopened SPARK-2750:
> Add Https support for Web UI
>
>
> Key: SPARK-27
[
https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic resolved SPARK-2750.
Resolution: Implemented
Fix Version/s: 1.0.2
Target Version/s: 1.0.2
Alrea
[
https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-2750:
---
Description:
Now I try to add https support for web ui using Jetty ssl integration.Below is
[
https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-2750:
---
Description:
Now I try to add https support for web ui using Jetty ssl integration.Below is
[
https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangTaoTheTonic updated SPARK-2750:
---
Description:
Now I try to add https support for web ui using Jetty ssl integration.Below is
WangTaoTheTonic created SPARK-2750:
--
Summary: Add Https support for Web UI
Key: SPARK-2750
URL: https://issues.apache.org/jira/browse/SPARK-2750
Project: Spark
Issue Type: New Feature
WangTaoTheTonic created SPARK-1738:
--
Summary: Is spark-debugger still available?
Key: SPARK-1738
URL: https://issues.apache.org/jira/browse/SPARK-1738
Project: Spark
Issue Type: Question
66 matches
Mail list logo