[jira] [Commented] (SPARK-1764) EOF reached before Python server acknowledged

2014-05-13 Thread Bernardo Gomez Palacio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995484#comment-13995484 ] Bernardo Gomez Palacio commented on SPARK-1764: --- We just ran

[jira] [Commented] (SPARK-1780) Non-existent SPARK_DAEMON_OPTS is referred to in a few places

2014-05-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995902#comment-13995902 ] Andrew Or commented on SPARK-1780: -- https://github.com/apache/spark/pull/751

[jira] [Commented] (SPARK-1161) Add saveAsObjectFile and SparkContext.objectFile in Python

2014-05-13 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996081#comment-13996081 ] Kan Zhang commented on SPARK-1161: -- PR: https://github.com/apache/spark/pull/755 Add

[jira] [Commented] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995815#comment-13995815 ] Sean Owen commented on SPARK-1802: -- I looked further into just what might go wrong by

[jira] [Resolved] (SPARK-1753) PySpark on YARN does not work on assembly jar built on Red Hat based OS

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1753. Resolution: Fixed Fix Version/s: (was: 1.0.1) 1.0.0 Issue

[jira] [Commented] (SPARK-1756) Add missing description to spark-env.sh.template

2014-05-13 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992535#comment-13992535 ] Guoqiang Li commented on SPARK-1756: [PR 646|

[jira] [Created] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

2014-05-13 Thread Michael Malak (JIRA)
Michael Malak created SPARK-1817: Summary: RDD zip erroneous when partitions do not divide RDD count Key: SPARK-1817 URL: https://issues.apache.org/jira/browse/SPARK-1817 Project: Spark

[jira] [Commented] (SPARK-1616) input file not found issue

2014-05-13 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994044#comment-13994044 ] Marcelo Vanzin commented on SPARK-1616: --- Hi Prasad, This doesn't really sound like

[jira] [Commented] (SPARK-1818) Freshen Mesos docs

2014-05-13 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996146#comment-13996146 ] Andrew Ash commented on SPARK-1818: --- https://github.com/apache/spark/pull/756 Freshen

[jira] [Resolved] (SPARK-1780) Non-existent SPARK_DAEMON_OPTS is referred to in a few places

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1780. Resolution: Fixed Assignee: Andrew Or (was: Patrick Wendell) Non-existent

[jira] [Commented] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996178#comment-13996178 ] Patrick Wendell commented on SPARK-1802: This protobuf thing is very troubling.

[jira] [Comment Edited] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996178#comment-13996178 ] Patrick Wendell edited comment on SPARK-1802 at 5/13/14 8:18 AM:

[jira] [Created] (SPARK-1819) Fix GetField.nullable.

2014-05-13 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-1819: Summary: Fix GetField.nullable. Key: SPARK-1819 URL: https://issues.apache.org/jira/browse/SPARK-1819 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1802. Resolution: Fixed Issue resolved by pull request 744

[jira] [Commented] (SPARK-1760) mvn -Dsuites=* test throw an ClassNotFoundException

2014-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993493#comment-13993493 ] Sean Owen commented on SPARK-1760: -- If `wildcardSuites` lets you invoke specific suites

[jira] [Comment Edited] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995815#comment-13995815 ] Sean Owen edited comment on SPARK-1802 at 5/13/14 11:27 AM:

[jira] [Commented] (SPARK-1819) Fix GetField.nullable.

2014-05-13 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996201#comment-13996201 ] Takuya Ueshin commented on SPARK-1819: -- Pull-requested:

[jira] [Updated] (SPARK-1680) Clean up use of setExecutorEnvs in SparkConf

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1680: --- Fix Version/s: (was: 1.0.0) 1.1.0 Clean up use of setExecutorEnvs in

[jira] [Created] (SPARK-1809) Mesos backend doesn't respect HADOOP_CONF_DIR

2014-05-13 Thread Andrew Ash (JIRA)
Andrew Ash created SPARK-1809: - Summary: Mesos backend doesn't respect HADOOP_CONF_DIR Key: SPARK-1809 URL: https://issues.apache.org/jira/browse/SPARK-1809 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

2014-05-13 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-1813: - Summary: Add a utility to SparkConf that makes using Kryo really easy Key: SPARK-1813 URL: https://issues.apache.org/jira/browse/SPARK-1813 Project: Spark Issue

[jira] [Commented] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

2014-05-13 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996390#comment-13996390 ] Mridul Muralidharan commented on SPARK-1813: Writing a KryoRegistrator is the

[jira] [Created] (SPARK-1808) bin/pyspark does not load default configuration properties

2014-05-13 Thread Andrew Or (JIRA)
Andrew Or created SPARK-1808: Summary: bin/pyspark does not load default configuration properties Key: SPARK-1808 URL: https://issues.apache.org/jira/browse/SPARK-1808 Project: Spark Issue Type:

[jira] [Created] (SPARK-1810) The spark tar ball does not unzip into a separate folder when un-tarred.

2014-05-13 Thread Manikandan Narayanaswamy (JIRA)
Manikandan Narayanaswamy created SPARK-1810: --- Summary: The spark tar ball does not unzip into a separate folder when un-tarred. Key: SPARK-1810 URL: https://issues.apache.org/jira/browse/SPARK-1810

[jira] [Closed] (SPARK-1821) Document History Server

2014-05-13 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu closed SPARK-1821. -- Resolution: Implemented sorry, missed some documents Document History Server ---

[jira] [Updated] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

2014-05-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1813: -- Description: It would be nice to have a method in SparkConf that makes it really easy to turn on Kryo

[jira] [Updated] (SPARK-1769) Executor loss can cause race condition in Pool

2014-05-13 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-1769: -- Assignee: Andrew Or (was: Aaron Davidson) Executor loss can cause race condition in Pool

[jira] [Assigned] (SPARK-1769) Executor loss can cause race condition in Pool

2014-05-13 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson reassigned SPARK-1769: - Assignee: Aaron Davidson Executor loss can cause race condition in Pool

[jira] [Commented] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

2014-05-13 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996818#comment-13996818 ] Kan Zhang commented on SPARK-1817: -- PR: https://github.com/apache/spark/pull/760 RDD

[jira] [Created] (SPARK-1821) Document History Server

2014-05-13 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1821: -- Summary: Document History Server Key: SPARK-1821 URL: https://issues.apache.org/jira/browse/SPARK-1821 Project: Spark Issue Type: Bug Components: Deploy

[jira] [Updated] (SPARK-1821) Document History Server

2014-05-13 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1821: --- Issue Type: Improvement (was: Bug) Document History Server --- Key:

[jira] [Updated] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

2014-05-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1813: -- Description: It would be nice to have a method in SparkConf that makes it really easy to turn on Kryo

[jira] [Commented] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

2014-05-13 Thread William Benton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995560#comment-13995560 ] William Benton commented on SPARK-1789: --- Sean, we're currently building against Akka

[jira] [Updated] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

2014-05-13 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1817: - Affects Version/s: 1.0.0 RDD zip erroneous when partitions do not divide RDD count

[jira] [Resolved] (SPARK-1708) Add ClassTag parameter on accumulator and broadcast methods

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1708. Resolution: Fixed Fix Version/s: (was: 1.0.0) 1.1.0 Issue

[jira] [Commented] (SPARK-1283) Create spark-contrib repo for 1.0

2014-05-13 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992974#comment-13992974 ] Evan Chan commented on SPARK-1283: -- ping Any more comments? Objections to creating a

[jira] [Resolved] (SPARK-571) Forbid return statements when cleaning closures

2014-05-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-571. --- Resolution: Fixed Forbid return statements when cleaning closures

[jira] [Updated] (SPARK-1736) spark-submit on Windows

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1736: --- Assignee: Andrew Or spark-submit on Windows --- Key:

[jira] [Updated] (SPARK-1753) PySpark on YARN does not work on assembly jar built on Red Hat based OS

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1753: --- Assignee: Andrew Or PySpark on YARN does not work on assembly jar built on Red Hat based OS

[jira] [Resolved] (SPARK-1793) Heavily duplicated test setup code in SVMSuite

2014-05-13 Thread Andrew Tulloch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Tulloch resolved SPARK-1793. --- Resolution: Fixed Fix Version/s: 1.0.0 Heavily duplicated test setup code in

[jira] [Updated] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

2014-05-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1823: - Affects Version/s: 1.0.0 ExternalAppendOnlyMap can still OOM if one key is very large

[jira] [Resolved] (SPARK-1816) LiveListenerBus dies if a listener throws an exception

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1816. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 759

[jira] [Commented] (SPARK-1769) Executor loss can cause race condition in Pool

2014-05-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997079#comment-13997079 ] Andrew Or commented on SPARK-1769: -- https://github.com/apache/spark/pull/762 Executor

[jira] [Updated] (SPARK-1824) Python examples still take in master

2014-05-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1824: - Affects Version/s: 1.0.0 Python examples still take in master --

[jira] [Created] (SPARK-1769) Executor loss can cause race condition in Pool

2014-05-13 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-1769: - Summary: Executor loss can cause race condition in Pool Key: SPARK-1769 URL: https://issues.apache.org/jira/browse/SPARK-1769 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1283) Create spark-contrib repo for 1.0

2014-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993076#comment-13993076 ] Patrick Wendell commented on SPARK-1283: [~velvia] Yeah - do you want to submit a

[jira] [Updated] (SPARK-1825) Windows Spark fails to work with Linux YARN

2014-05-13 Thread Taeyun Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taeyun Kim updated SPARK-1825: -- Fix Version/s: 1.0.0 Windows Spark fails to work with Linux YARN