[jira] [Created] (SPARK-2384) Add tooltips for shuffle write and scheduler delay in UI

Kay Ousterhout created SPARK-2384: - Summary: Add tooltips for shuffle write and scheduler delay in UI Key: SPARK-2384 URL: https://issues.apache.org/jira/browse/SPARK-2384 Project: Spark

[jira] [Commented] (SPARK-2382) build error:

[ https://issues.apache.org/jira/browse/SPARK-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053433#comment-14053433 ] Sean Owen commented on SPARK-2382: -- I can't reproduce this. It is almost certainly a

[jira] [Commented] (SPARK-2386) RowWriteSupport should use the exact types to cast.

[ https://issues.apache.org/jira/browse/SPARK-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053537#comment-14053537 ] Takuya Ueshin commented on SPARK-2386: -- PRed:

[jira] [Created] (SPARK-2387) Remove the stage barrier for better resource utilization

Rui Li created SPARK-2387: - Summary: Remove the stage barrier for better resource utilization Key: SPARK-2387 URL: https://issues.apache.org/jira/browse/SPARK-2387 Project: Spark Issue Type: New

[jira] [Created] (SPARK-2388) Streaming from multiple different Kafka topics is problematic

Sergey created SPARK-2388: - Summary: Streaming from multiple different Kafka topics is problematic Key: SPARK-2388 URL: https://issues.apache.org/jira/browse/SPARK-2388 Project: Spark Issue Type:

[jira] [Created] (SPARK-2389) globally shared SparkContext / shared Spark application

Robert Stupp created SPARK-2389: --- Summary: globally shared SparkContext / shared Spark application Key: SPARK-2389 URL: https://issues.apache.org/jira/browse/SPARK-2389 Project: Spark Issue

[jira] [Commented] (SPARK-2384) Add tooltips for shuffle write and scheduler delay in UI

[ https://issues.apache.org/jira/browse/SPARK-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053834#comment-14053834 ] Sandy Ryza commented on SPARK-2384: --- This is a great idea Add tooltips for shuffle

[jira] [Commented] (SPARK-2160) error of Decision tree algorithm in Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053938#comment-14053938 ] Jon Sondag commented on SPARK-2160: --- https://github.com/apache/spark/pull/1316 (also

[jira] [Created] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

Kousuke Saruta created SPARK-2390: - Summary: Files in staging directory cannot be deleted and wastes the space of HDFS Key: SPARK-2390 URL: https://issues.apache.org/jira/browse/SPARK-2390 Project:

[jira] [Updated] (SPARK-2391) LIMIT queries ship a whole partition of data

[ https://issues.apache.org/jira/browse/SPARK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2391: Fix Version/s: 1.1.0 LIMIT queries ship a whole partition of data

[jira] [Created] (SPARK-2391) LIMIT queries ship a whole partition of data

Michael Armbrust created SPARK-2391: --- Summary: LIMIT queries ship a whole partition of data Key: SPARK-2391 URL: https://issues.apache.org/jira/browse/SPARK-2391 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2391) LIMIT queries ship a whole partition of data

[ https://issues.apache.org/jira/browse/SPARK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2391: Target Version/s: 1.1.0 Fix Version/s: (was: 1.1.0) LIMIT queries ship a whole

[jira] [Commented] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053994#comment-14053994 ] Xiangrui Meng commented on SPARK-1977: -- I think now I understand when it happens. We

[jira] [Updated] (SPARK-2386) RowWriteSupport should use the exact types to cast.

[ https://issues.apache.org/jira/browse/SPARK-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2386: Target Version/s: 1.1.0 RowWriteSupport should use the exact types to cast.

[jira] [Commented] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053999#comment-14053999 ] Neville Li commented on SPARK-1977: --- [~mengxr] sounds good to me. mutable.BitSet in

[jira] [Commented] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054003#comment-14054003 ] Xiangrui Meng commented on SPARK-1977: -- Do you mind creating a PR registering

[jira] [Updated] (SPARK-2311) Added additional GLMs (Poisson and Gamma) into MLlib

[ https://issues.apache.org/jira/browse/SPARK-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaokai Wei updated SPARK-2311: --- Priority: Major (was: Minor) Added additional GLMs (Poisson and Gamma) into MLlib

[jira] [Updated] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-2390: -- Affects Version/s: 1.0.1 Files in staging directory cannot be deleted and wastes the space of

[jira] [Commented] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054041#comment-14054041 ] Kousuke Saruta commented on SPARK-2390: --- I modified the way to create a instance of

[jira] [Commented] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054043#comment-14054043 ] Neville Li commented on SPARK-1977: --- There you go:

[jira] [Created] (SPARK-2392) Executors should not start an HTTP server

Andrew Or created SPARK-2392: Summary: Executors should not start an HTTP server Key: SPARK-2392 URL: https://issues.apache.org/jira/browse/SPARK-2392 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2392) Executors should not start their own HTTP servers

[ https://issues.apache.org/jira/browse/SPARK-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2392: - Summary: Executors should not start their own HTTP servers (was: Executors should not start an HTTP

[jira] [Commented] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054162#comment-14054162 ] Mridul Muralidharan commented on SPARK-2390: Here, and a bunch of other

[jira] [Updated] (SPARK-2212) Hash Outer Joins

[ https://issues.apache.org/jira/browse/SPARK-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2212: Priority: Minor (was: Major) Hash Outer Joins Key:

[jira] [Updated] (SPARK-2179) Public API for DataTypes and Schema

[ https://issues.apache.org/jira/browse/SPARK-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2179: Priority: Critical (was: Major) Public API for DataTypes and Schema

[jira] [Updated] (SPARK-2391) LIMIT queries ship a whole partition of data

[ https://issues.apache.org/jira/browse/SPARK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2391: Priority: Blocker (was: Major) LIMIT queries ship a whole partition of data

[jira] [Updated] (SPARK-2054) Code Generation for Expression Evaluation

[ https://issues.apache.org/jira/browse/SPARK-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2054: Priority: Critical (was: Major) Code Generation for Expression Evaluation

[jira] [Updated] (SPARK-2097) UDF Support

[ https://issues.apache.org/jira/browse/SPARK-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2097: Priority: Critical (was: Major) UDF Support --- Key:

[jira] [Updated] (SPARK-2087) Support SQLConf per session

[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2087: Priority: Minor (was: Major) Support SQLConf per session ---

[jira] [Updated] (SPARK-2190) Specialized ColumnType for Timestamp

[ https://issues.apache.org/jira/browse/SPARK-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2190: Priority: Critical (was: Major) Specialized ColumnType for Timestamp

[jira] [Updated] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2205: Priority: Minor (was: Major) Unnecessary exchange operators in a join on multiple tables

[jira] [Updated] (SPARK-2375) JSON schema inference may not resolve type conflicts correctly for a field inside an array of structs

[ https://issues.apache.org/jira/browse/SPARK-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2375: Target Version/s: 1.1.0 Fix Version/s: (was: 1.1.0) JSON schema inference may

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054178#comment-14054178 ] Masayoshi TSUZUKI commented on SPARK-2017: -- Pagination seems to be better because

[jira] [Updated] (SPARK-2376) Selecting list values inside nested JSON objects raises java.lang.IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2376: Target Version/s: 1.1.0 Selecting list values inside nested JSON objects raises

[jira] [Created] (SPARK-2393) Simple cost estimation and auto selection of broadcast join

Michael Armbrust created SPARK-2393: --- Summary: Simple cost estimation and auto selection of broadcast join Key: SPARK-2393 URL: https://issues.apache.org/jira/browse/SPARK-2393 Project: Spark

[jira] [Updated] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2339: Target Version/s: 1.1.0 SQL parser in sql-core is case sensitive, but a table alias is converted to

[jira] [Updated] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2339: Fix Version/s: (was: 1.1.0) SQL parser in sql-core is case sensitive, but a table alias is converted

[jira] [Updated] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2205: Target Version/s: 1.1.0 (was: 1.0.1, 1.1.0) Unnecessary exchange operators in a join on multiple tables

[jira] [Updated] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2339: Component/s: SQL SQL parser in sql-core is case sensitive, but a table alias is converted to lower case

[jira] [Commented] (SPARK-2384) Add tooltips for shuffle write and scheduler delay in UI

[ https://issues.apache.org/jira/browse/SPARK-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054207#comment-14054207 ] Kay Ousterhout commented on SPARK-2384: --- https://github.com/apache/spark/pull/1314

[jira] [Created] (SPARK-2394) Make it easier to read LZO-compressed files from EC2 clusters

Nicholas Chammas created SPARK-2394: --- Summary: Make it easier to read LZO-compressed files from EC2 clusters Key: SPARK-2394 URL: https://issues.apache.org/jira/browse/SPARK-2394 Project: Spark

[jira] [Resolved] (SPARK-1977) mutable.BitSet in ALS not serializable with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1977. -- Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by pull

[jira] [Closed] (SPARK-2378) Implement functionality to read csv files

[ https://issues.apache.org/jira/browse/SPARK-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-2378. --- Resolution: Duplicate Implement functionality to read csv files

[jira] [Updated] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2360: Description: I think the first step it to design the interface that we want to present to

[jira] [Commented] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054262#comment-14054262 ] Hossein Falaki commented on SPARK-2360: --- As a point for comparison the interface in

[jira] [Comment Edited] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054262#comment-14054262 ] Hossein Falaki edited comment on SPARK-2360 at 7/7/14 11:03 PM:

[jira] [Comment Edited] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054262#comment-14054262 ] Hossein Falaki edited comment on SPARK-2360 at 7/7/14 11:04 PM:

[jira] [Created] (SPARK-2395) Optimize common like expressions

Michael Armbrust created SPARK-2395: --- Summary: Optimize common like expressions Key: SPARK-2395 URL: https://issues.apache.org/jira/browse/SPARK-2395 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054298#comment-14054298 ] Kousuke Saruta commented on SPARK-2390: --- Thank you for your comment [~mridulm80]. I

[jira] [Resolved] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2339. - Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 SQL parser in

[jira] [Resolved] (SPARK-2386) RowWriteSupport should use the exact types to cast.

[ https://issues.apache.org/jira/browse/SPARK-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2386. - Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 Assignee:

[jira] [Resolved] (SPARK-2375) JSON schema inference may not resolve type conflicts correctly for a field inside an array of structs

[ https://issues.apache.org/jira/browse/SPARK-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2375. - Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 JSON schema

[jira] [Commented] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054333#comment-14054333 ] Kousuke Saruta commented on SPARK-2390: --- Pull Requested at

[jira] [Comment Edited] (SPARK-2390) Files in staging directory cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054333#comment-14054333 ] Kousuke Saruta edited comment on SPARK-2390 at 7/8/14 12:41 AM:

[jira] [Comment Edited] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054262#comment-14054262 ] Hossein Falaki edited comment on SPARK-2360 at 7/8/14 12:45 AM:

[jira] [Created] (SPARK-2397) Get rid of LocalHiveContext

Michael Armbrust created SPARK-2397: --- Summary: Get rid of LocalHiveContext Key: SPARK-2397 URL: https://issues.apache.org/jira/browse/SPARK-2397 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-2376) Selecting list values inside nested JSON objects raises java.lang.IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2376. - Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 Selecting list values inside

[jira] [Commented] (SPARK-2201) Improve FlumeInputDStream's stability and make it scalable

[ https://issues.apache.org/jira/browse/SPARK-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054431#comment-14054431 ] llai commented on SPARK-2201: - is it a good idea to add dependency of zookeeper? Improve

[jira] [Created] (SPARK-2398) Trouble running Spark 1.0 on Yarn

Nishkam Ravi created SPARK-2398: --- Summary: Trouble running Spark 1.0 on Yarn Key: SPARK-2398 URL: https://issues.apache.org/jira/browse/SPARK-2398 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054434#comment-14054434 ] Guoqiang Li commented on SPARK-2398: Seems to be related to

[jira] [Commented] (SPARK-2201) Improve FlumeInputDStream's stability and make it scalable

[ https://issues.apache.org/jira/browse/SPARK-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054442#comment-14054442 ] sunshangchun commented on SPARK-2201: - I don't like it's a problem. It's a external

[jira] [Resolved] (SPARK-2235) Spark SQL basicOperator add Intersect operator

[ https://issues.apache.org/jira/browse/SPARK-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2235. - Resolution: Fixed Fix Version/s: 1.1.0 Assignee: (was: Michael

[jira] [Commented] (SPARK-2181) The keys for sorting the columns of Executor page in SparkUI are incorrect

[ https://issues.apache.org/jira/browse/SPARK-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054455#comment-14054455 ] Shuo Xiang commented on SPARK-2181: --- Hi, I've merged the latest version but the column

[jira] [Closed] (SPARK-2303) Poisson regression model for count data

[ https://issues.apache.org/jira/browse/SPARK-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Bai closed SPARK-2303. --- Resolution: Fixed Poisson regression model for count data ---

[jira] [Commented] (SPARK-2303) Poisson regression model for count data

[ https://issues.apache.org/jira/browse/SPARK-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054470#comment-14054470 ] Gang Bai commented on SPARK-2303: - This change has been merged into another JIRA

[jira] [Commented] (SPARK-2215) Multi-way join

[ https://issues.apache.org/jira/browse/SPARK-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054491#comment-14054491 ] Yin Huai commented on SPARK-2215: - Instead of implementing a multi-way join operator, how

[jira] [Updated] (SPARK-2399) Add support for LZ4 compression

[ https://issues.apache.org/jira/browse/SPARK-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Bowyer updated SPARK-2399: --- Attachment: SPARK-2399-Make-spark-compression-able-to-use-LZ4.patch Add support for LZ4 compression

[jira] [Updated] (SPARK-2399) Add support for LZ4 compression

[ https://issues.apache.org/jira/browse/SPARK-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Bowyer updated SPARK-2399: --- Description: LZ4 is a compression codec of the same ideas as googles snappy, but has some

[jira] [Created] (SPARK-2400) config spark.yarn.max.executor.failures is not explained accurately

Chen Chao created SPARK-2400: Summary: config spark.yarn.max.executor.failures is not explained accurately Key: SPARK-2400 URL: https://issues.apache.org/jira/browse/SPARK-2400 Project: Spark

[jira] [Commented] (SPARK-2400) config spark.yarn.max.executor.failures is not explained accurately

[ https://issues.apache.org/jira/browse/SPARK-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054540#comment-14054540 ] Chen Chao commented on SPARK-2400: -- it should be numExecutors * 2, with minimum of 3