[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Summary: Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run

[jira] [Updated] (SPARK-1520) Assembly Jar with more than JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Summary: Assembly Jar with more than JDK7 and run on JDK6 (was: Inclusion of breeze

[jira] [Created] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-17 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1529: -- Summary: Support setting spark.local.dirs to a hadoop FileSystem Key: SPARK-1529 URL: https://issues.apache.org/jira/browse/SPARK-1529 Project: Spark

[jira] [Updated] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1496) SparkContext.jarOfClass should return Option instead of a sequence

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1496: --- Labels: release-notes (was: releasenotes) SparkContext.jarOfClass should return Option

[jira] [Updated] (SPARK-1496) SparkContext.jarOfClass should return Option instead of a sequence

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1496: --- Labels: releasenotes (was: ) SparkContext.jarOfClass should return Option instead of a

[jira] [Updated] (SPARK-1496) SparkContext.jarOfClass should return Option instead of a sequence

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1496: --- Labels: api-change (was: release-notes) SparkContext.jarOfClass should return Option

[jira] [Updated] (SPARK-964) Investigate the potential for using JDK 8 lambda expressions for the Java/Scala APIs

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-964: -- Labels: api-change (was: ) Investigate the potential for using JDK 8 lambda expressions for

[jira] [Created] (SPARK-1530) Streaming UI test can hang indefinitely

2014-04-17 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1530: -- Summary: Streaming UI test can hang indefinitely Key: SPARK-1530 URL: https://issues.apache.org/jira/browse/SPARK-1530 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-1549) Add python support to spark-submit script

2014-04-20 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1549: -- Summary: Add python support to spark-submit script Key: SPARK-1549 URL: https://issues.apache.org/jira/browse/SPARK-1549 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-1202) Add a cancel button in the UI for stages

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1202. Resolution: Fixed Add a cancel button in the UI for stages

[jira] [Resolved] (SPARK-918) hadoop-client dependency should be explained for Scala in addition to Java in quickstart

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-918. --- Resolution: Won't Fix This was fixed as a result of a separate re-factoring of the docs.

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975947#comment-13975947 ] Patrick Wendell commented on SPARK-1529: [~liancheng] Hey Cheng, the tricky thing

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976038#comment-13976038 ] Patrick Wendell commented on SPARK-1529: One idea proposed by [~adav] was to

[jira] [Resolved] (SPARK-1399) Reason for Stage Failure should be shown in UI

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1399. Resolution: Fixed Reason for Stage Failure should be shown in UI

[jira] [Updated] (SPARK-1399) Reason for Stage Failure should be shown in UI

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1399: --- Fix Version/s: 1.0.0 Reason for Stage Failure should be shown in UI

[jira] [Resolved] (SPARK-1539) RDDPage.scala contains RddPage

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1539. Resolution: Fixed Fix Version/s: 1.0.0 RDDPage.scala contains RddPage

[jira] [Created] (SPARK-1562) Exclude internal catalyst classes from scaladoc, or make them package private

2014-04-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1562: -- Summary: Exclude internal catalyst classes from scaladoc, or make them package private Key: SPARK-1562 URL: https://issues.apache.org/jira/browse/SPARK-1562

[jira] [Resolved] (SPARK-1440) Generate JavaDoc instead of ScalaDoc for Java API

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1440. Resolution: Fixed Generate JavaDoc instead of ScalaDoc for Java API

[jira] [Resolved] (SPARK-1439) Aggregate Scaladocs across projects

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1439. Resolution: Fixed Aggregate Scaladocs across projects

[jira] [Resolved] (SPARK-1332) Improve Spark Streaming's Network Receiver and InputDStream API for future stability

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1332. Resolution: Fixed Fix Version/s: 1.0.0 Improve Spark Streaming's Network Receiver

[jira] [Resolved] (SPARK-1459) EventLoggingListener does not work with file:// target dir

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1459. Resolution: Fixed Fix Version/s: 1.0.0 EventLoggingListener does not work with

[jira] [Updated] (SPARK-1565) Spark examples should be changed given spark-submit

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1565: --- Description: Example:

[jira] [Resolved] (SPARK-1560) PySpark SQL depends on Java 7 only jars

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1560. Resolution: Fixed PySpark SQL depends on Java 7 only jars

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1564: --- Assignee: Andrew Or Add JavaScript into Javadoc to turn ::Experimental:: and such into

[jira] [Updated] (SPARK-1563) Add package-info.java files for all packages that appear in Javadoc

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1563: --- Assignee: Prashant Sharma Add package-info.java files for all packages that appear in

[jira] [Resolved] (SPARK-1567) Add language tabs to quick start guide

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1567. Resolution: Fixed Add language tabs to quick start guide

[jira] [Updated] (SPARK-1554) Update doc overview page to not mention building if you get a pre-built distro

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1554: --- Assignee: Patrick Wendell Update doc overview page to not mention building if you get a

[jira] [Updated] (SPARK-1579) PySpark should distinguish expected IOExceptions from unexpected ones in the worker

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1579: --- Description: I chatted with [~adav] a bit about this. Right now we drop IOExceptions because

[jira] [Updated] (SPARK-800) Improve Quickstart Docs to Make Full Deployment More Clear

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-800: -- Reporter: Patrick Wendell (was: Patrick Cogan) Improve Quickstart Docs to Make Full

[jira] [Updated] (SPARK-800) Improve Quickstart Docs to Make Full Deployment More Clear

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-800: -- Assignee: Patrick Wendell (was: Patrick Cogan) Improve Quickstart Docs to Make Full

[jira] [Resolved] (SPARK-800) Improve Quickstart Docs to Make Full Deployment More Clear

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-800. --- Resolution: Fixed Fix Version/s: 1.0.0 This has been fixed with the recent changes to

[jira] [Updated] (SPARK-1119) Make examples and assembly jar naming consistent between maven/sbt

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1119: --- Description: Right now it's somewhat different. Also it should be consistent with what the

[jira] [Updated] (SPARK-1281) Partitioning in ALS

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1281: --- Assignee: Tor Myklebust Partitioning in ALS --- Key:

[jira] [Resolved] (SPARK-1538) SparkUI forgets about all persisted RDD's not directly associated with the Stage

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1538. Resolution: Fixed Assignee: Andrew Or SparkUI forgets about all persisted RDD's not

[jira] [Commented] (SPARK-1376) In the yarn-cluster submitter, rename args option to arg

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977757#comment-13977757 ] Patrick Wendell commented on SPARK-1376: There was follow up work on this by

[jira] [Resolved] (SPARK-1494) Hive Dependencies being checked by MIMA

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1494. Resolution: Fixed Hive Dependencies being checked by MIMA

[jira] [Updated] (SPARK-1494) Hive Dependencies being checked by MIMA

2014-04-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1494: --- Fix Version/s: 1.0.0 Hive Dependencies being checked by MIMA

[jira] [Commented] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977897#comment-13977897 ] Patrick Wendell commented on SPARK-1480:

[jira] [Resolved] (SPARK-1119) Make examples and assembly jar naming consistent between maven/sbt

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1119. Resolution: Fixed Assignee: Patrick Wendell Make examples and assembly jar naming

[jira] [Updated] (SPARK-1119) Make examples and assembly jar naming consistent between maven/sbt

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1119: --- Description: Right now it's somewhat different. Also it should be consistent with what the

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS is not getting propagated

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978612#comment-13978612 ] Patrick Wendell commented on SPARK-1588: The approach in spark-submit is to

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS is not getting propagated

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978703#comment-13978703 ] Patrick Wendell commented on SPARK-1588: Btw - SPARK_JAVA_OPTS is officially

[jira] [Assigned] (SPARK-1619) Spark shell should use spark-submit

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1619: -- Assignee: Patrick Wendell Spark shell should use spark-submit

[jira] [Updated] (SPARK-1619) Spark shell should use spark-submit

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1619: --- Priority: Blocker (was: Major) Spark shell should use spark-submit

[jira] [Created] (SPARK-1619) Spark shell should use spark-submit

2014-04-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1619: -- Summary: Spark shell should use spark-submit Key: SPARK-1619 URL: https://issues.apache.org/jira/browse/SPARK-1619 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-1489) Fix the HistoryServer view acls

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1489. Resolution: Fixed Fix Version/s: 1.0.0 Fix the HistoryServer view acls

[jira] [Created] (SPARK-1623) Broadcast cleaner should use getCononicalPath when deleting files by name

2014-04-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1623: -- Summary: Broadcast cleaner should use getCononicalPath when deleting files by name Key: SPARK-1623 URL: https://issues.apache.org/jira/browse/SPARK-1623 Project:

[jira] [Resolved] (SPARK-1584) Upgrade Flume dependency to 1.4.0

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1584. Resolution: Fixed Assignee: Ted Malaska (was: Sandy Ryza) Upgrade Flume dependency

[jira] [Created] (SPARK-1626) Update Spark YARN docs to use spark-submit

2014-04-25 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1626: -- Summary: Update Spark YARN docs to use spark-submit Key: SPARK-1626 URL: https://issues.apache.org/jira/browse/SPARK-1626 Project: Spark Issue Type:

[jira] [Updated] (SPARK-1625) Ensure all legacy YARN options are supported with spark-submit

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1625: --- Component/s: YARN Ensure all legacy YARN options are supported with spark-submit

[jira] [Updated] (SPARK-1621) Update Chill to 0.3.6

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1621: --- Issue Type: Dependency upgrade (was: Improvement) Update Chill to 0.3.6

[jira] [Resolved] (SPARK-1582) Job cancellation does not interrupt threads

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1582. Resolution: Fixed Fix Version/s: 1.0.0 Job cancellation does not interrupt threads

[jira] [Resolved] (SPARK-1590) Recommend to use FindBugs

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1590. Resolution: Not a Problem Assignee: Shixiong Zhu [~zsxwing] I'm marking this as not

[jira] [Commented] (SPARK-1590) Recommend to use FindBugs

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980735#comment-13980735 ] Patrick Wendell commented on SPARK-1590: I agree with this course of action.

[jira] [Commented] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when using deps jar

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980740#comment-13980740 ] Patrick Wendell commented on SPARK-1604: I'm not sure why you're including both

[jira] [Resolved] (SPARK-1632) Avoid boxing in ExternalAppendOnlyMap compares

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1632. Resolution: Fixed Fix Version/s: 1.0.0 Avoid boxing in ExternalAppendOnlyMap

[jira] [Assigned] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1606: -- Assignee: Patrick Wendell spark-submit needs `--arg` for every application parameter

[jira] [Commented] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981851#comment-13981851 ] Patrick Wendell commented on SPARK-1606: I submitted a PR here that adds the

[jira] [Comment Edited] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981851#comment-13981851 ] Patrick Wendell edited comment on SPARK-1606 at 4/26/14 2:26 AM:

[jira] [Commented] (SPARK-1647) Prevent data loss when Streaming driver goes down

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982155#comment-13982155 ] Patrick Wendell commented on SPARK-1647: Is there a a particular design in mind

[jira] [Closed] (SPARK-1643) hql(show tables) throw an exception

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-1643. -- Resolution: Cannot Reproduce This is incomplete, there is not mention of an exception. Please

[jira] [Updated] (SPARK-1629) Spark Core missing commons-lang dependence

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1629: --- Priority: Minor (was: Major) Spark Core missing commons-lang dependence

[jira] [Updated] (SPARK-1629) Spark should inline use of commons-lang `SystemUtils.IS_OS_WINDOWS`

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1629: --- Description: Right now we use this but don't depend on it explicitly (which is wrong). We

[jira] [Updated] (SPARK-1467) Make StorageLevel.apply() factory methods developer API's

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1467: --- Summary: Make StorageLevel.apply() factory methods developer API's (was: Make

[jira] [Commented] (SPARK-1622) Expose input split(s) accessed by a task in UI or logs

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982163#comment-13982163 ] Patrick Wendell commented on SPARK-1622: I think it would be good to have a

[jira] [Resolved] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1606. Resolution: Fixed Test comment spark-submit needs `--arg` for every application

[jira] [Reopened] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1606: spark-submit needs `--arg` for every application parameter

[jira] [Reopened] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1606: spark-submit needs `--arg` for every application parameter

[jira] [Closed] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-1606. -- Resolution: Fixed Fix Version/s: (was: 1.0.0) 1.1.0

[jira] [Resolved] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1606. Resolution: Fixed Testing automated closing of JIRA's spark-submit needs `--arg` for

[jira] [Updated] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1606: --- Fix Version/s: (was: 1.1.0) spark-submit needs `--arg` for every application parameter

[jira] [Reopened] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1606: spark-submit needs `--arg` for every application parameter

[jira] [Resolved] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1606. Resolution: Fixed Testing automated closing of JIRA's spark-submit needs `--arg` for

[jira] [Reopened] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1606: spark-submit needs `--arg` for every application parameter

[jira] [Issue Comment Deleted] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1606: --- Comment: was deleted (was: Testing links [https://testlink.com] and new lines in comment

[jira] [Reopened] (SPARK-1609) Executor fails to start when Command.extraJavaOptions contains multiple Java options

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1609: Executor fails to start when Command.extraJavaOptions contains multiple Java options

[jira] [Commented] (SPARK-1609) Executor fails to start when Command.extraJavaOptions contains multiple Java options

2014-04-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982193#comment-13982193 ] Patrick Wendell commented on SPARK-1609: This was not actually closed - I was

[jira] [Created] (SPARK-1648) Support closing JIRA's as part of merge script

2014-04-26 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1648: -- Summary: Support closing JIRA's as part of merge script Key: SPARK-1648 URL: https://issues.apache.org/jira/browse/SPARK-1648 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1647) Prevent data loss when Streaming driver goes down

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982200#comment-13982200 ] Patrick Wendell commented on SPARK-1647: Ah okay - I wasn't asking about timing

[jira] [Resolved] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1606. Resolution: Fixed spark-submit needs `--arg` for every application parameter

[jira] [Updated] (SPARK-1650) Correctly identify maven project version in distribution script

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1650: --- Assignee: Rahul Singhal Correctly identify maven project version in distribution script

[jira] [Resolved] (SPARK-1648) Support closing JIRA's as part of merge script

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1648. Resolution: Fixed Issue resolved by pull request 570

[jira] [Resolved] (SPARK-1145) Memory mapping with many small blocks can cause JVM allocation failures

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1145. Resolution: Fixed Issue resolved by pull request 43

[jira] [Updated] (SPARK-1654) Spark shell doesn't correctly pass quoted arguments to spark-submit

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1654: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-1652 Spark shell doesn't correctly

[jira] [Updated] (SPARK-1609) Executor fails to start when Command.extraJavaOptions contains multiple Java options

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1609: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-1652 Executor fails to start when

[jira] [Resolved] (SPARK-1609) Executor fails to start when Command.extraJavaOptions contains multiple Java options

2014-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1609. Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.0.0

[jira] [Resolved] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-04-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1652. Resolution: Fixed Fixes and improvements for spark-submit/configs

[jira] [Resolved] (SPARK-1657) Spark submit should fail gracefully if YARN support not enabled

2014-04-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1657. Resolution: Fixed Spark submit should fail gracefully if YARN support not enabled

[jira] [Resolved] (SPARK-1625) Ensure all legacy YARN options are supported with spark-submit

2014-04-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1625. Resolution: Duplicate Ensure all legacy YARN options are supported with spark-submit

[jira] [Updated] (SPARK-1549) Add python support to spark-submit script

2014-04-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1549: --- Priority: Blocker (was: Major) Add python support to spark-submit script

[jira] [Resolved] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x when not using YARN

2014-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1441. Resolution: Fixed Fix Version/s: 1.0.0 Compile Spark Core error with Hadoop 0.23.x

<    1   2   3   4   5   6   7   8   9   10   >