[jira] [Commented] (SPARK-3819) Jenkins should compile Spark against multiple versions of Hadoop

2014-10-08 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164468#comment-14164468 ] Andrew Ash commented on SPARK-3819: --- Patrick do you think it's feasible to add to the ev

[jira] [Updated] (SPARK-3866) Clean up python/run-tests problems

2014-10-08 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3866: - Environment: Mac OS X 10.9.5, Python 2.7.8, Java 1.8.0_20 (was: Mac OS X 10.9.5, Python 2.7.8, IPython 2.

[jira] [Updated] (SPARK-3866) Clean up python/run-tests problems

2014-10-08 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3866: - Attachment: (was: unit-tests.log) > Clean up python/run-tests problems > -

[jira] [Updated] (SPARK-3866) Clean up python/run-tests problems

2014-10-08 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3866: - Attachment: unit-tests.log An output from ./python/run-tests > Clean up python/run-tests problems > -

[jira] [Created] (SPARK-3867) ./python/run-tests failed when it run with Python 2.6 and unittest2 is not installed

2014-10-08 Thread cocoatomo (JIRA)
cocoatomo created SPARK-3867: Summary: ./python/run-tests failed when it run with Python 2.6 and unittest2 is not installed Key: SPARK-3867 URL: https://issues.apache.org/jira/browse/SPARK-3867 Project: S

[jira] [Commented] (SPARK-3805) Enable Standalone worker cleanup by default

2014-10-08 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164485#comment-14164485 ] Aaron Davidson commented on SPARK-3805: --- Upon further thought, I also agree with Pat

[jira] [Created] (SPARK-3868) Hard to recognize which module is tested from unit-tests.log

2014-10-08 Thread cocoatomo (JIRA)
cocoatomo created SPARK-3868: Summary: Hard to recognize which module is tested from unit-tests.log Key: SPARK-3868 URL: https://issues.apache.org/jira/browse/SPARK-3868 Project: Spark Issue Typ

[jira] [Updated] (SPARK-3868) Hard to recognize which module is tested from unit-tests.log

2014-10-08 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3868: - Issue Type: Sub-task (was: Bug) Parent: SPARK-3866 > Hard to recognize which module is tested fro

[jira] [Updated] (SPARK-3867) ./python/run-tests failed when it run with Python 2.6 and unittest2 is not installed

2014-10-08 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3867: - Issue Type: Sub-task (was: Bug) Parent: SPARK-3866 > ./python/run-tests failed when it run with P

[jira] [Created] (SPARK-3869) ./bin/spark-class miss Java version with _JAVA_OPTIONS set

2014-10-08 Thread cocoatomo (JIRA)
cocoatomo created SPARK-3869: Summary: ./bin/spark-class miss Java version with _JAVA_OPTIONS set Key: SPARK-3869 URL: https://issues.apache.org/jira/browse/SPARK-3869 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-3707) Type Coercion for DIV doesn't work for non-numeric argument

2014-10-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3707. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2559 [https:/

[jira] [Resolved] (SPARK-3810) Rule PreInsertionCasts doesn't handle partitioned table properly

2014-10-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3810. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2672 [https:/

[jira] [Commented] (SPARK-3868) Hard to recognize which module is tested from unit-tests.log

2014-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164517#comment-14164517 ] Apache Spark commented on SPARK-3868: - User 'cocoatomo' has created a pull request for

[jira] [Commented] (SPARK-3869) ./bin/spark-class miss Java version with _JAVA_OPTIONS set

2014-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164535#comment-14164535 ] Apache Spark commented on SPARK-3869: - User 'cocoatomo' has created a pull request for

[jira] [Updated] (SPARK-3869) ./bin/spark-class miss Java version with _JAVA_OPTIONS set

2014-10-08 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cocoatomo updated SPARK-3869: - Description: When _JAVA_OPTIONS environment variable is set, a command "java -version" outputs a message

[jira] [Updated] (SPARK-3758) Script style checking

2014-10-08 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3758: -- Summary: Script style checking (was: Wrong EOL character in *.cmd) > Script style checking > --

[jira] [Resolved] (SPARK-3857) Create a join package for various join operators

2014-10-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3857. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2719 [https:/

[jira] [Commented] (SPARK-3736) Workers should reconnect to Master if disconnected

2014-10-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164578#comment-14164578 ] Patrick Wendell commented on SPARK-3736: I spoke a bit offline with [~ilikerps] ab

[jira] [Updated] (SPARK-3736) Workers should reconnect to Master if disconnected

2014-10-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3736: --- Assignee: Matthew Cheah > Workers should reconnect to Master if disconnected > ---

[jira] [Commented] (SPARK-3805) Enable Standalone worker cleanup by default

2014-10-08 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164584#comment-14164584 ] Andrew Ash commented on SPARK-3805: --- That sounds very reasonable -- I'll close. Maybe in

[jira] [Closed] (SPARK-3805) Enable Standalone worker cleanup by default

2014-10-08 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash closed SPARK-3805. - Resolution: Won't Fix > Enable Standalone worker cleanup by default >

[jira] [Commented] (SPARK-3759) SparkSubmitDriverBootstrapper should return exit code of driver process

2014-10-08 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164595#comment-14164595 ] Nan Zhu commented on SPARK-3759: just passed by for merged PR, shall the status of th

[jira] [Commented] (SPARK-3767) Support wildcard in Spark properties

2014-10-08 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164605#comment-14164605 ] Nan Zhu commented on SPARK-3767: do you mean something like -DpropertyName=EXEID, where

[jira] [Created] (SPARK-3870) EOL character enforcement

2014-10-08 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3870: - Summary: EOL character enforcement Key: SPARK-3870 URL: https://issues.apache.org/jira/browse/SPARK-3870 Project: Spark Issue Type: Improvement Affects

[jira] [Updated] (SPARK-3758) Script style checking

2014-10-08 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3758: -- Description: There are no way to check style of scripts. (was: Windows platform expects the EOL

[jira] [Commented] (SPARK-3870) EOL character enforcement

2014-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164618#comment-14164618 ] Apache Spark commented on SPARK-3870: - User 'sarutak' has created a pull request for t

[jira] [Created] (SPARK-3871) compute-classpath.sh does not escape :

2014-10-08 Thread Hector Yee (JIRA)
Hector Yee created SPARK-3871: - Summary: compute-classpath.sh does not escape : Key: SPARK-3871 URL: https://issues.apache.org/jira/browse/SPARK-3871 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-3135) Avoid memory copy in TorrentBroadcast serialization

2014-10-08 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164645#comment-14164645 ] Andrew Ash commented on SPARK-3135: --- [~pwendell] how do you feel about backporting this

[jira] [Commented] (SPARK-3861) Avoid rebuilding hash tables on each partition

2014-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164723#comment-14164723 ] Apache Spark commented on SPARK-3861: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-3847) Enum.hashCode is only consistent within the same JVM

2014-10-08 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164775#comment-14164775 ] Mridul Muralidharan commented on SPARK-3847: [~joshrosen] array hashcode might

[jira] [Resolved] (SPARK-3856) Clean deprecated usage after breeze 0.10 upgrade

2014-10-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3856. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2718 [https://githu

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-10-08 Thread Dan Di Spaltro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164795#comment-14164795 ] Dan Di Spaltro commented on SPARK-1812: --- +1 on this issue =) > Support cross-buildi

[jira] [Commented] (SPARK-3657) yarn alpha YarnRMClientImpl throws NPE appMasterRequest.setTrackingUrl starting spark-shell

2014-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164799#comment-14164799 ] Apache Spark commented on SPARK-3657: - User 'sarutak' has created a pull request for t

[jira] [Resolved] (SPARK-2805) Update akka to version 2.3.4

2014-10-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2805. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Anand Avati > Update akka t

[jira] [Updated] (SPARK-2805) Update akka to version 2.3.4

2014-10-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2805: --- Summary: Update akka to version 2.3.4 (was: Update akka to version 2.3) > Update akka to vers

[jira] [Updated] (SPARK-2805) Update akka to version 2.3

2014-10-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2805: --- Summary: Update akka to version 2.3 (was: update akka to version 2.3) > Update akka to versio

[jira] [Created] (SPARK-3872) Rewrite the test for ActorInputStream.

2014-10-08 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-3872: -- Summary: Rewrite the test for ActorInputStream. Key: SPARK-3872 URL: https://issues.apache.org/jira/browse/SPARK-3872 Project: Spark Issue Type: Sub-tas

[jira] [Assigned] (SPARK-3872) Rewrite the test for ActorInputStream.

2014-10-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-3872: -- Assignee: Prashant Sharma > Rewrite the test for ActorInputStream. > -

[jira] [Created] (SPARK-3873) Scala style: check import ordering

2014-10-08 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-3873: -- Summary: Scala style: check import ordering Key: SPARK-3873 URL: https://issues.apache.org/jira/browse/SPARK-3873 Project: Spark Issue Type: Sub-task

<    1   2