[jira] [Created] (SPARK-35328) Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default

2021-05-06 Thread sharkd tu (Jira)
sharkd tu created SPARK-35328: - Summary: Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default Key: SPARK-35328 URL: https://issues.apache.org/jira/browse/SPARK-35328 Project: Spark

[jira] [Updated] (SPARK-24678) We should use 'PROCESS_LOCAL' first for Spark-Streaming

2018-06-28 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-24678: -- Description: Currently, `BlockRDD.getPreferredLocations`  only get hosts info of blocks, which

[jira] [Created] (SPARK-24678) We should use 'PROCESS_LOCAL' first for Spark-Streaming

2018-06-28 Thread sharkd tu (JIRA)
sharkd tu created SPARK-24678: - Summary: We should use 'PROCESS_LOCAL' first for Spark-Streaming Key: SPARK-24678 URL: https://issues.apache.org/jira/browse/SPARK-24678 Project: Spark Issue

[jira] [Created] (SPARK-22900) remove unnecessary restrict for streaming dynamic allocation

2017-12-25 Thread sharkd tu (JIRA)
sharkd tu created SPARK-22900: - Summary: remove unnecessary restrict for streaming dynamic allocation Key: SPARK-22900 URL: https://issues.apache.org/jira/browse/SPARK-22900 Project: Spark

[jira] [Updated] (SPARK-20977) NPE in CollectionAccumulator

2017-06-27 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-20977: -- Description: {code:java} 17/06/03 13:39:31 ERROR Utils: Uncaught exception in thread

[jira] [Updated] (SPARK-20977) NPE in CollectionAccumulator

2017-06-27 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-20977: -- Environment: (was: OpenJDK 64-Bit Server VM (25.71-b00) for linux-ppc64 JRE

[jira] [Updated] (SPARK-20977) NPE in CollectionAccumulator

2017-06-27 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-20977: -- Description: {code:java} 17/06/03 13:39:31 ERROR Utils: Uncaught exception in thread

[jira] [Updated] (SPARK-21138) Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different

2017-06-19 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-21138: -- Description: When I set different clusters for "spark.hadoop.fs.defaultFS" and

[jira] [Created] (SPARK-21138) Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different

2017-06-19 Thread sharkd tu (JIRA)
sharkd tu created SPARK-21138: - Summary: Cannot delete staging dir when the clusters of "spark.yarn.stagingDir" and "spark.hadoop.fs.defaultFS" are different Key: SPARK-21138 URL:

[jira] [Updated] (SPARK-20977) NPE in CollectionAccumulator

2017-06-07 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-20977: -- Environment: OpenJDK 64-Bit Server VM (25.71-b00) for linux-ppc64 JRE

[jira] [Created] (SPARK-20977) NPE in CollectionAccumulator

2017-06-04 Thread sharkd tu (JIRA)
sharkd tu created SPARK-20977: - Summary: NPE in CollectionAccumulator Key: SPARK-20977 URL: https://issues.apache.org/jira/browse/SPARK-20977 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-20722) Replay event log that hasn't be replayed in current checking period in advance for request

2017-05-12 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-20722: -- Attachment: history-server2.png history-server1.png > Replay event log that hasn't be

[jira] [Created] (SPARK-20722) Replay event log that hasn't be replayed in current checking period in advance for request

2017-05-12 Thread sharkd tu (JIRA)
sharkd tu created SPARK-20722: - Summary: Replay event log that hasn't be replayed in current checking period in advance for request Key: SPARK-20722 URL: https://issues.apache.org/jira/browse/SPARK-20722

[jira] [Created] (SPARK-19576) Task attempt paths exist in output path after saveAsNewAPIHadoopFile completes with speculation enabled

2017-02-13 Thread sharkd tu (JIRA)
sharkd tu created SPARK-19576: - Summary: Task attempt paths exist in output path after saveAsNewAPIHadoopFile completes with speculation enabled Key: SPARK-19576 URL: https://issues.apache.org/jira/browse/SPARK-19576

[jira] [Updated] (SPARK-19576) Task attempt paths exist in output path after saveAsNewAPIHadoopFile completes with speculation enabled

2017-02-13 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-19576: -- Description: {{writeShard}} in {{saveAsNewAPIHadoopDataset}} always committed its tasks without

[jira] [Updated] (SPARK-19576) Task attempt paths exist in output path after saveAsNewAPIHadoopFile completes with speculation enabled

2017-02-13 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-19576: -- Description: {{writeShard}} in {{saveAsNewAPIHadoopDataset}} always committed its tasks without

[jira] [Updated] (SPARK-19576) Task attempt paths exist in output path after saveAsNewAPIHadoopFile completes with speculation enabled

2017-02-13 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-19576: -- Description: {{writeShard}} in {{saveAsNewAPIHadoopDataset}} always committed its tasks without

[jira] [Created] (SPARK-19298) History server can't match MalformedInputException and prompt the detail logs while repalying eventlog

2017-01-19 Thread sharkd tu (JIRA)
sharkd tu created SPARK-19298: - Summary: History server can't match MalformedInputException and prompt the detail logs while repalying eventlog Key: SPARK-19298 URL: https://issues.apache.org/jira/browse/SPARK-19298

[jira] [Updated] (SPARK-19298) History server can't match MalformedInputException and prompt the detail logs while repalying eventlog

2017-01-19 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-19298: -- Description: Could't match MalformedInputException and prompt the detail logs while repalying

[jira] [Updated] (SPARK-17664) Failed to saveAsHadoop when speculate is enabled

2016-09-25 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-17664: -- Description: >From follow logs, task 22 has failed 4 times because of "the driver did not >authorize

[jira] [Created] (SPARK-17664) Failed to saveAsHadoop when speculate is enabled

2016-09-25 Thread sharkd tu (JIRA)
sharkd tu created SPARK-17664: - Summary: Failed to saveAsHadoop when speculate is enabled Key: SPARK-17664 URL: https://issues.apache.org/jira/browse/SPARK-17664 Project: Spark Issue Type: Bug

[jira] [Issue Comment Deleted] (SPARK-16873) force spill NPE

2016-08-03 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-16873: -- Comment: was deleted (was: Please see https://github.com/apache/spark/pull/14479) > force spill NPE >

[jira] [Commented] (SPARK-16873) force spill NPE

2016-08-03 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405812#comment-15405812 ] sharkd tu commented on SPARK-16873: --- Please see https://github.com/apache/spark/pull/14479 > force

[jira] [Updated] (SPARK-16873) force spill NPE

2016-08-03 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-16873: -- Description: 16/07/31 20:52:38 INFO executor.Executor: Running task 1090.1 in stage 18.0 (TID 23793)

[jira] [Updated] (SPARK-16873) force spill NPE

2016-08-03 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-16873: -- Issue Type: Bug (was: Question) > force spill NPE > --- > > Key:

[jira] [Created] (SPARK-16873) force spill NPE

2016-08-03 Thread sharkd tu (JIRA)
sharkd tu created SPARK-16873: - Summary: force spill NPE Key: SPARK-16873 URL: https://issues.apache.org/jira/browse/SPARK-16873 Project: Spark Issue Type: Question Components: Spark

[jira] [Created] (SPARK-16414) Can not get user config when calling SparkHadoopUtil.get.conf in other places, such as DataSourceStrategy

2016-07-07 Thread sharkd tu (JIRA)
sharkd tu created SPARK-16414: - Summary: Can not get user config when calling SparkHadoopUtil.get.conf in other places, such as DataSourceStrategy Key: SPARK-16414 URL:

[jira] [Created] (SPARK-15422) Remove unnecessary calculation of stage's parents

2016-05-19 Thread sharkd tu (JIRA)
sharkd tu created SPARK-15422: - Summary: Remove unnecessary calculation of stage's parents Key: SPARK-15422 URL: https://issues.apache.org/jira/browse/SPARK-15422 Project: Spark Issue Type: