[jira] [Commented] (SPARK-1585) Not robust Lasso causes Infinity on weights and losses

2014-05-19 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001405#comment-14001405 ] Xusen Yin commented on SPARK-1585: -- I see. I close it now. Not robust Lasso causes

[jira] [Commented] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001420#comment-14001420 ] Matei Zaharia commented on SPARK-1875: -- I see, it might be fine to just remove the

[jira] [Commented] (SPARK-1877) ClassNotFoundException when loading RDD with serialized objects

2014-05-19 Thread Bogdan Ghidireac (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001423#comment-14001423 ] Bogdan Ghidireac commented on SPARK-1877: - Submitted the patch as a GitHub pull

[jira] [Commented] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001424#comment-14001424 ] Sean Owen commented on SPARK-1875: -- (That's correct that commons-lang and commons-lang3

[jira] [Created] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

2014-05-19 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-1878: --- Summary: Incorrect initialization order in JavaStreamingContext Key: SPARK-1878 URL: https://issues.apache.org/jira/browse/SPARK-1878 Project: Spark Issue

[jira] [Commented] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

2014-05-19 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001436#comment-14001436 ] Shixiong Zhu commented on SPARK-1878: - PR: https://github.com/apache/spark/pull/822

[jira] [Created] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-1879: Summary: Default PermGen size too small when using Hadoop2 and Hive Key: SPARK-1879 URL: https://issues.apache.org/jira/browse/SPARK-1879 Project: Spark

[jira] [Assigned] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1879: Assignee: Matei Zaharia Default PermGen size too small when using Hadoop2 and Hive

[jira] [Commented] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001450#comment-14001450 ] Guoqiang Li commented on SPARK-1875: ||hadoop or hive ||commons-lang|| |hive 0.12

[jira] [Comment Edited] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001451#comment-14001451 ] Matei Zaharia edited comment on SPARK-1879 at 5/19/14 7:25 AM:

[jira] [Comment Edited] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001450#comment-14001450 ] Guoqiang Li edited comment on SPARK-1875 at 5/19/14 7:26 AM: -

[jira] [Commented] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001451#comment-14001451 ] Matei Zaharia commented on SPARK-1879: -- BTW the warning on Java 8 is the following:

[jira] [Commented] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001461#comment-14001461 ] Matei Zaharia commented on SPARK-1879: -- https://github.com/apache/spark/pull/823

[jira] [Updated] (SPARK-1880) Eliminate unnecessary job executions.

2014-05-19 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-1880: - Description: There are unnecessary job executions in {{BroadcastNestedLoopJoin}}. When

[jira] [Created] (SPARK-1881) Executor caching

2014-05-19 Thread nigel (JIRA)
nigel created SPARK-1881: Summary: Executor caching Key: SPARK-1881 URL: https://issues.apache.org/jira/browse/SPARK-1881 Project: Spark Issue Type: Improvement Components: Mesos

[jira] [Created] (SPARK-1882) Support dynamic memory sharing in Mesos

2014-05-19 Thread Andrew Ash (JIRA)
Andrew Ash created SPARK-1882: - Summary: Support dynamic memory sharing in Mesos Key: SPARK-1882 URL: https://issues.apache.org/jira/browse/SPARK-1882 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-1873) Add README.md file when making distributions

2014-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1873. Resolution: Fixed Add README.md file when making distributions

[jira] [Resolved] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1802. Resolution: Fixed Audit dependency graph when Spark is built with -Phive

[jira] [Updated] (SPARK-1575) failing tests with master branch

2014-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1575: --- Priority: Minor (was: Blocker) failing tests with master branch

[jira] [Resolved] (SPARK-1533) The (kill) button in the web UI is visible to everyone.

2014-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1533. Resolution: Won't Fix We'd like to keep it visible and let security conscious people

[jira] [Resolved] (SPARK-1575) failing tests with master branch

2014-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1575. Resolution: Cannot Reproduce I couldn't reproduce this issue, but if you can still

[jira] [Resolved] (SPARK-1514) Standardize process for creating Spark packages

2014-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1514. Resolution: Fixed Standardize process for creating Spark packages

[jira] [Commented] (SPARK-1514) Standardize process for creating Spark packages

2014-05-19 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002193#comment-14002193 ] Thomas Graves commented on SPARK-1514: -- What was the resolution here? is there a

[jira] [Commented] (SPARK-1857) map() with lookup() causes exception

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002275#comment-14002275 ] Matei Zaharia commented on SPARK-1857: -- The problem is that it's not currently

[jira] [Updated] (SPARK-1883) spark graph.triplets does not return correct values

2014-05-19 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glenn Strycker updated SPARK-1883: -- Summary: spark graph.triplets does not return correct values (was: spark graphx triplets.map

[jira] [Created] (SPARK-1883) spark graphx triplets.map does not return correct values

2014-05-19 Thread Glenn Strycker (JIRA)
Glenn Strycker created SPARK-1883: - Summary: spark graphx triplets.map does not return correct values Key: SPARK-1883 URL: https://issues.apache.org/jira/browse/SPARK-1883 Project: Spark

[jira] [Commented] (SPARK-1188) GraphX triplets not working properly

2014-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002336#comment-14002336 ] Reynold Xin commented on SPARK-1188: Adding a link to the commit:

[jira] [Commented] (SPARK-1883) spark graph.triplets does not return correct values

2014-05-19 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002358#comment-14002358 ] Glenn Strycker commented on SPARK-1883: --- Sorry, this has been fixed --

[jira] [Resolved] (SPARK-1883) spark graph.triplets does not return correct values

2014-05-19 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glenn Strycker resolved SPARK-1883. --- Resolution: Fixed already fixed -- user is running an old version of Spark spark

[jira] [Commented] (SPARK-1874) Clean up MLlib sample data

2014-05-19 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002369#comment-14002369 ] Matei Zaharia commented on SPARK-1874: -- Yes, cause there's other stuff in `data`. I

[jira] [Updated] (SPARK-1884) Shark failed to start

2014-05-19 Thread Wei Cui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Cui updated SPARK-1884: --- Summary: Shark failed to start (was: Shark ) Shark failed to start -

[jira] [Commented] (SPARK-1884) Shark failed to start

2014-05-19 Thread Wei Cui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002427#comment-14002427 ] Wei Cui commented on SPARK-1884: It's Caused by: java.lang.VerifyError: class

[jira] [Closed] (SPARK-1876) Update Windows scripts to deal with latest distribution layout changes

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1876. Resolution: Fixed Update Windows scripts to deal with latest distribution layout changes

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002483#comment-14002483 ] Colin Patrick McCabe commented on SPARK-1518: - [~pwendell], I can take a look

[jira] [Created] (SPARK-1885) GraphX reduce function not working properly -- returns only 1 element

2014-05-19 Thread Glenn Strycker (JIRA)
Glenn Strycker created SPARK-1885: - Summary: GraphX reduce function not working properly -- returns only 1 element Key: SPARK-1885 URL: https://issues.apache.org/jira/browse/SPARK-1885 Project: Spark

[jira] [Commented] (SPARK-1874) Clean up MLlib sample data

2014-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002535#comment-14002535 ] Xiangrui Meng commented on SPARK-1874: -- There are three files under `data/`:

[jira] [Closed] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1878. Resolution: Fixed Fix Version/s: 1.0.0 Incorrect initialization order in

[jira] [Commented] (SPARK-1870) Jars specified via --jars in spark-submit are not added to executor classpath for YARN

2014-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002613#comment-14002613 ] Xiangrui Meng commented on SPARK-1870: -- I tested it on a Spark 1.0RC standalone

[jira] [Commented] (SPARK-1859) Linear, Ridge and Lasso Regressions with SGD yield unexpected results

2014-05-19 Thread Vlad Frolov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002626#comment-14002626 ] Vlad Frolov commented on SPARK-1859: Unfortunately, there is no Python bindings to

[jira] [Reopened] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reopened SPARK-1878: -- Incorrect initialization order in JavaStreamingContext

[jira] [Created] (SPARK-1886) workers keep dying for uncaught exception of executor id not found

2014-05-19 Thread Zhen Peng (JIRA)
Zhen Peng created SPARK-1886: Summary: workers keep dying for uncaught exception of executor id not found Key: SPARK-1886 URL: https://issues.apache.org/jira/browse/SPARK-1886 Project: Spark

[jira] [Resolved] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1878. -- Resolution: Fixed Incorrect initialization order in JavaStreamingContext

[jira] [Commented] (SPARK-1886) workers keep dying for uncaught exception of executor id not found

2014-05-19 Thread Zhen Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002688#comment-14002688 ] Zhen Peng commented on SPARK-1886: -- https://github.com/apache/spark/pull/827 workers

[jira] [Reopened] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reopened SPARK-1879: -- Default PermGen size too small when using Hadoop2 and Hive

[jira] [Resolved] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1879. -- Resolution: Fixed Default PermGen size too small when using Hadoop2 and Hive

[jira] [Reopened] (SPARK-1689) AppClient does not respond correctly to RemoveApplication

2014-05-19 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson reopened SPARK-1689: --- The new behavior correctly informs the scheduler of the failed state, but does not exit though

[jira] [Resolved] (SPARK-1861) ArrayIndexOutOfBoundsException when reading bzip2 files

2014-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1861. -- Resolution: Implemented Patch will be included for the next Hadoop release (1.3.0, 2.5.0).

[jira] [Resolved] (SPARK-1689) AppClient does not respond correctly to RemoveApplication

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1689. -- Resolution: Fixed AppClient does not respond correctly to RemoveApplication

[jira] [Resolved] (SPARK-1874) Clean up MLlib sample data

2014-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1874. -- Resolution: Fixed Clean up MLlib sample data --