[jira] [Resolved] (SPARK-2630) Input data size of CoalescedRDD is incorrect

2014-10-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-2630. --- Resolution: Fixed Fix Version/s: 1.2.0 Input data size of CoalescedRDD is incorrect

[jira] [Reopened] (SPARK-2630) Input data size of CoalescedRDD is incorrect

2014-10-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-2630: --- not merged yet, sorry. Input data size of CoalescedRDD is incorrect

[jira] [Commented] (SPARK-2256) pyspark: RDD.take doesn't work ... sometimes ...

2014-10-03 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157765#comment-14157765 ] Ángel Álvarez commented on SPARK-2256: -- It seems the problem has been solved in Spark

[jira] [Created] (SPARK-3775) Not suitable error message in spark-shell.cmd

2014-10-03 Thread Masayoshi TSUZUKI (JIRA)
Masayoshi TSUZUKI created SPARK-3775: Summary: Not suitable error message in spark-shell.cmd Key: SPARK-3775 URL: https://issues.apache.org/jira/browse/SPARK-3775 Project: Spark Issue

[jira] [Commented] (SPARK-3775) Not suitable error message in spark-shell.cmd

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157818#comment-14157818 ] Apache Spark commented on SPARK-3775: - User 'tsudukim' has created a pull request for

[jira] [Resolved] (SPARK-3366) Compute best splits distributively in decision tree

2014-10-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3366. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2595

[jira] [Created] (SPARK-3776) Wrong conversion to Catalyst for Option[Product]

2014-10-03 Thread Renat Yusupov (JIRA)
Renat Yusupov created SPARK-3776: Summary: Wrong conversion to Catalyst for Option[Product] Key: SPARK-3776 URL: https://issues.apache.org/jira/browse/SPARK-3776 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3776) Wrong conversion to Catalyst for Option[Product]

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157913#comment-14157913 ] Apache Spark commented on SPARK-3776: - User 'r3natko' has created a pull request for

[jira] [Commented] (SPARK-2421) Spark should treat writable as serializable for keys

2014-10-03 Thread Brian Husted (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157936#comment-14157936 ] Brian Husted commented on SPARK-2421: - To work around the problem, one must map the

[jira] [Created] (SPARK-3777) Display Executor ID for Tasks in Stage page

2014-10-03 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-3777: --- Summary: Display Executor ID for Tasks in Stage page Key: SPARK-3777 URL: https://issues.apache.org/jira/browse/SPARK-3777 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3777) Display Executor ID for Tasks in Stage page

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157944#comment-14157944 ] Apache Spark commented on SPARK-3777: - User 'zsxwing' has created a pull request for

[jira] [Resolved] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

2014-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3764. -- Resolution: Not a Problem Invalid dependencies of artifacts in Maven Central Repository.

[jira] [Commented] (SPARK-3769) SparkFiles.get gives me the wrong fully qualified path

2014-10-03 Thread Tom Weber (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157946#comment-14157946 ] Tom Weber commented on SPARK-3769: -- I believe I originally called it on the driver side,

[jira] [Created] (SPARK-3778) newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn

2014-10-03 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-3778: Summary: newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn Key: SPARK-3778 URL: https://issues.apache.org/jira/browse/SPARK-3778 Project:

[jira] [Closed] (SPARK-2256) pyspark: RDD.take doesn't work ... sometimes ...

2014-10-03 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Farrellee closed SPARK-2256. Resolution: Fixed Fix Version/s: 1.1.0 pyspark: RDD.take doesn't work ... sometimes

[jira] [Created] (SPARK-3779) yarn spark.yarn.applicationMaster.waitTries config should be changed to a time period

2014-10-03 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-3779: Summary: yarn spark.yarn.applicationMaster.waitTries config should be changed to a time period Key: SPARK-3779 URL: https://issues.apache.org/jira/browse/SPARK-3779

[jira] [Created] (SPARK-3780) YarnAllocator should look at the container completed diagnostic message

2014-10-03 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-3780: Summary: YarnAllocator should look at the container completed diagnostic message Key: SPARK-3780 URL: https://issues.apache.org/jira/browse/SPARK-3780 Project: Spark

[jira] [Created] (SPARK-3781) code style format

2014-10-03 Thread sjk (JIRA)
sjk created SPARK-3781: -- Summary: code style format Key: SPARK-3781 URL: https://issues.apache.org/jira/browse/SPARK-3781 Project: Spark Issue Type: Improvement Reporter: sjk -- This

[jira] [Commented] (SPARK-3781) code style format

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158074#comment-14158074 ] Apache Spark commented on SPARK-3781: - User 'shijinkui' has created a pull request for

[jira] [Commented] (SPARK-3783) The type parameters for SparkContext.accumulable are inconsistent Accumulable itself

2014-10-03 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158176#comment-14158176 ] Nathan Kronenfeld commented on SPARK-3783: --

[jira] [Created] (SPARK-3785) Support off-loading computations to a GPU

2014-10-03 Thread Thomas Darimont (JIRA)
Thomas Darimont created SPARK-3785: -- Summary: Support off-loading computations to a GPU Key: SPARK-3785 URL: https://issues.apache.org/jira/browse/SPARK-3785 Project: Spark Issue Type:

[jira] [Closed] (SPARK-2058) SPARK_CONF_DIR should override all present configs

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2058. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 SPARK_CONF_DIR should override all

[jira] [Updated] (SPARK-2058) SPARK_CONF_DIR should override all present configs

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2058: - Assignee: Eugen Cepoi SPARK_CONF_DIR should override all present configs

[jira] [Commented] (SPARK-3706) Cannot run IPython REPL with IPYTHON set to 1 and PYSPARK_PYTHON unset

2014-10-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158200#comment-14158200 ] Josh Rosen commented on SPARK-3706: --- This introduced a problem, since after this patch

[jira] [Commented] (SPARK-2058) SPARK_CONF_DIR should override all present configs

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158197#comment-14158197 ] Andrew Or commented on SPARK-2058: -- To give a quick update, this change has not made it

[jira] [Created] (SPARK-3786) Speedup tests of PySpark

2014-10-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3786: - Summary: Speedup tests of PySpark Key: SPARK-3786 URL: https://issues.apache.org/jira/browse/SPARK-3786 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3696) Do not override user-defined conf_dir in spark-config.sh

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3696: - Assignee: WangTaoTheTonic Do not override user-defined conf_dir in spark-config.sh

[jira] [Closed] (SPARK-3696) Do not override user-defined conf_dir in spark-config.sh

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3696. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Updated] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2014-10-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1655: - Assignee: Aaron Staple In naive Bayes, store conditional probabilities distributively.

[jira] [Closed] (SPARK-2778) Add unit tests for Yarn integration

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2778. Resolution: Fixed Target Version/s: 1.2.0 Add unit tests for Yarn integration

[jira] [Closed] (SPARK-3710) YARN integration test is flaky

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3710. Resolution: Fixed Fix Version/s: 1.2.0 YARN integration test is flaky

[jira] [Commented] (SPARK-3710) YARN integration test is flaky

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158326#comment-14158326 ] Andrew Or commented on SPARK-3710: -- https://github.com/apache/spark/pull/2605 YARN

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

2014-10-03 Thread Reza Farivar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158363#comment-14158363 ] Reza Farivar commented on SPARK-3785: - Olivier Chafik who wrote javacl (which you

[jira] [Commented] (SPARK-3710) YARN integration test is flaky

2014-10-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158364#comment-14158364 ] Marcelo Vanzin commented on SPARK-3710: --- Hmm. For some the e-mail for this bug ended

[jira] [Commented] (SPARK-3710) YARN integration test is flaky

2014-10-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158376#comment-14158376 ] Marcelo Vanzin commented on SPARK-3710: --- I filed a Yarn bug (YARN-2642), although we

[jira] [Resolved] (SPARK-3007) Add Dynamic Partition support to Spark Sql hive

2014-10-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3007. Resolution: Fixed Okay, this was merged again: https://github.com/apache/spark/pull/2616

[jira] [Resolved] (SPARK-3212) Improve the clarity of caching semantics

2014-10-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3212. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2501

[jira] [Resolved] (SPARK-1379) Calling .cache() on a SchemaRDD should do something more efficient than caching the individual row objects.

2014-10-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1379. - Resolution: Fixed Calling .cache() on a SchemaRDD should do something more efficient

[jira] [Resolved] (SPARK-3641) Correctly populate SparkPlan.currentContext

2014-10-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3641. - Resolution: Fixed Assignee: Michael Armbrust (was: Yin Huai) Correctly populate

[jira] [Resolved] (SPARK-1671) Cached tables should follow write-through policy

2014-10-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1671. - Resolution: Fixed I'm gonna mark this as resolved now that we do at least invalidate the

[jira] [Updated] (SPARK-2973) Add a way to show tables without executing a job

2014-10-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2973: Assignee: Cheng Lian (was: Michael Armbrust) Add a way to show tables without executing a

[jira] [Closed] (SPARK-3535) Spark on Mesos not correctly setting heap overhead

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3535. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Spark on Mesos not correctly

[jira] [Updated] (SPARK-3535) Spark on Mesos not correctly setting heap overhead

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3535: - Assignee: Brenden Matthews Spark on Mesos not correctly setting heap overhead

[jira] [Updated] (SPARK-3775) Not suitable error message in spark-shell.cmd

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3775: - Affects Version/s: 1.1.0 Not suitable error message in spark-shell.cmd

[jira] [Closed] (SPARK-3775) Not suitable error message in spark-shell.cmd

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3775. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee:

[jira] [Closed] (SPARK-3774) typo comment in bin/utils.sh

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3774. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee:

[jira] [Updated] (SPARK-3606) Spark-on-Yarn AmIpFilter does not work with Yarn HA.

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3606: - Fix Version/s: 1.2.0 Spark-on-Yarn AmIpFilter does not work with Yarn HA.

[jira] [Updated] (SPARK-3606) Spark-on-Yarn AmIpFilter does not work with Yarn HA.

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3606: - Target Version/s: 1.1.1, 1.2.0 Affects Version/s: (was: 1.2.0) Spark-on-Yarn AmIpFilter does

[jira] [Updated] (SPARK-3606) Spark-on-Yarn AmIpFilter does not work with Yarn HA.

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3606: - Affects Version/s: 1.2.0 Spark-on-Yarn AmIpFilter does not work with Yarn HA.

[jira] [Closed] (SPARK-3763) The example of building with sbt should be sbt assembly instead of sbt compile

2014-10-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3763. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta The example of building

[jira] [Resolved] (SPARK-1860) Standalone Worker cleanup should not clean up running executors

2014-10-03 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-1860. --- Resolution: Fixed Fixed by mccheah in https://github.com/apache/spark/pull/2609 Standalone

[jira] [Commented] (SPARK-3786) Speedup tests of PySpark

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158552#comment-14158552 ] Apache Spark commented on SPARK-3786: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-3561) Native Hadoop/YARN integration for batch/ETL workloads

2014-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158571#comment-14158571 ] Sandy Ryza commented on SPARK-3561: --- I think there may be somewhat of a misunderstanding

[jira] [Created] (SPARK-3787) Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

2014-10-03 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3787: - Summary: Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version Key: SPARK-3787 URL: https://issues.apache.org/jira/browse/SPARK-3787 Project:

[jira] [Updated] (SPARK-3787) Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

2014-10-03 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3787: -- Description: When we build with sbt with profile for hadoop and without property for hadoop

[jira] [Commented] (SPARK-3787) Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158602#comment-14158602 ] Apache Spark commented on SPARK-3787: - User 'sarutak' has created a pull request for

[jira] [Updated] (SPARK-3787) Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

2014-10-03 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3787: -- Description: When we build with sbt with profile for hadoop and without property for hadoop

[jira] [Commented] (SPARK-3561) Decouple Spark's API from its execution engine

2014-10-03 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158614#comment-14158614 ] Oleg Zhurakousky commented on SPARK-3561: - [~sandyr] Indeed YARN is a _resource

[jira] [Comment Edited] (SPARK-3561) Decouple Spark's API from its execution engine

2014-10-03 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158614#comment-14158614 ] Oleg Zhurakousky edited comment on SPARK-3561 at 10/3/14 10:34 PM:

[jira] [Updated] (SPARK-3561) Decouple Spark's API from its execution engine

2014-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-3561: -- Description: Currently Spark's API is tightly coupled with its backend execution engine. It could be

[jira] [Updated] (SPARK-3561) Decouple Spark's API from its execution engine

2014-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-3561: -- Description: Currently Spark's API is tightly coupled with its backend execution engine. It could be

[jira] [Comment Edited] (SPARK-3561) Decouple Spark's API from its execution engine

2014-10-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158571#comment-14158571 ] Sandy Ryza edited comment on SPARK-3561 at 10/3/14 11:00 PM: -

[jira] [Created] (SPARK-3788) Yarn dist cache code is not friendly to HDFS HA, Federation

2014-10-03 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-3788: - Summary: Yarn dist cache code is not friendly to HDFS HA, Federation Key: SPARK-3788 URL: https://issues.apache.org/jira/browse/SPARK-3788 Project: Spark

[jira] [Commented] (SPARK-1860) Standalone Worker cleanup should not clean up running executors

2014-10-03 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158646#comment-14158646 ] Andrew Ash commented on SPARK-1860: --- [~ilikerps] this ticket mentioned turning the

[jira] [Commented] (SPARK-3788) Yarn dist cache code is not friendly to HDFS HA, Federation

2014-10-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158657#comment-14158657 ] Marcelo Vanzin commented on SPARK-3788: --- Note: 2 above only applies to branch-1.1.

[jira] [Commented] (SPARK-3788) Yarn dist cache code is not friendly to HDFS HA, Federation

2014-10-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158710#comment-14158710 ] Marcelo Vanzin commented on SPARK-3788: --- Ah, 2 was fixed in branch-1.1 as part of

[jira] [Created] (SPARK-3789) Python bindings for GraphX

2014-10-03 Thread Ameet Talwalkar (JIRA)
Ameet Talwalkar created SPARK-3789: -- Summary: Python bindings for GraphX Key: SPARK-3789 URL: https://issues.apache.org/jira/browse/SPARK-3789 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-3788) Yarn dist cache code is not friendly to HDFS HA, Federation

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158725#comment-14158725 ] Apache Spark commented on SPARK-3788: - User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-3314) Script creation of AMIs

2014-10-03 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158777#comment-14158777 ] Nicholas Chammas commented on SPARK-3314: - Hey [~holdenk], I think this is a great

[jira] [Commented] (SPARK-3772) RDD operation on IPython REPL failed with an illegal port number

2014-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158865#comment-14158865 ] Apache Spark commented on SPARK-3772: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-3434) Distributed block matrix

2014-10-03 Thread Reza Zadeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158949#comment-14158949 ] Reza Zadeh commented on SPARK-3434: --- Any updates Shivaraman? Distributed block matrix