[jira] [Updated] (SPARK-1661) the result of querying table created with RegexSerDe is all null

[ https://issues.apache.org/jira/browse/SPARK-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] likunjian updated SPARK-1661: - Attachment: log.txt all content > the result of querying table created with RegexSerDe is all null > ---

[jira] [Updated] (SPARK-1661) the result of querying table created with RegexSerDe is all null

[ https://issues.apache.org/jira/browse/SPARK-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] likunjian updated SPARK-1661: - Description: the result of querying table created with RegexSerDe is all null when i query the ta

[jira] [Created] (SPARK-1661) the result of querying table created with RegexSerDe is all null

likunjian created SPARK-1661: Summary: the result of querying table created with RegexSerDe is all null Key: SPARK-1661 URL: https://issues.apache.org/jira/browse/SPARK-1661 Project: Spark Issue

[jira] [Commented] (SPARK-1394) calling system.platform on worker raises IOError

[ https://issues.apache.org/jira/browse/SPARK-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984070#comment-13984070 ] Idan Zalzberg commented on SPARK-1394: -- If you have an __init__.py you are sure to g

[jira] [Resolved] (SPARK-1491) maven hadoop-provided profile fails to build

[ https://issues.apache.org/jira/browse/SPARK-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1491. Resolution: Fixed Fix Version/s: 1.0.0 > maven hadoop-provided profile fails to buil

[jira] [Commented] (SPARK-1491) maven hadoop-provided profile fails to build

[ https://issues.apache.org/jira/browse/SPARK-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984069#comment-13984069 ] Patrick Wendell commented on SPARK-1491: Fixed by : https://github.com/apache/spar

[jira] [Commented] (SPARK-1394) calling system.platform on worker raises IOError

[ https://issues.apache.org/jira/browse/SPARK-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984066#comment-13984066 ] Vlad Frolo commented on SPARK-1394: --- I have the same issue with Spark 0.9.1. Is there an

[jira] [Updated] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x when not using YARN

[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1441: --- Assignee: Guoqiang Li > Compile Spark Core error with Hadoop 0.23.x when not using YARN > ---

[jira] [Updated] (SPARK-1491) maven hadoop-provided profile fails to build

[ https://issues.apache.org/jira/browse/SPARK-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1491: --- Assignee: Guoqiang Li > maven hadoop-provided profile fails to build > --

[jira] [Resolved] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x when not using YARN

[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1441. Resolution: Fixed Fix Version/s: 1.0.0 > Compile Spark Core error with Hadoop 0.23.x

[jira] [Assigned] (SPARK-1492) running-on-yarn doc should use spark-submit script for examples

[ https://issues.apache.org/jira/browse/SPARK-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-1492: - Assignee: Sandy Ryza > running-on-yarn doc should use spark-submit script for examples >

[jira] [Commented] (SPARK-1649) DataType should contain nullable bit

[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983985#comment-13983985 ] Andre Schumacher commented on SPARK-1649: - Thinking about it a bit longer.. could

[jira] [Commented] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983971#comment-13983971 ] Hari Shreedharan commented on SPARK-1645: - Yep, that is correct. I'd like to contr

[jira] [Commented] (SPARK-1649) DataType should contain nullable bit

[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983963#comment-13983963 ] Andre Schumacher commented on SPARK-1649: - OK, I now understand that this would be

[jira] [Commented] (SPARK-975) Spark Replay Debugger

[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983905#comment-13983905 ] Cheng Lian commented on SPARK-975: -- Hi [~sarutak], thanks for caring about this. Sorry tha

[jira] [Assigned] (SPARK-1566) Consolidate the Spark Programming Guide with tabs for all languages

[ https://issues.apache.org/jira/browse/SPARK-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh reassigned SPARK-1566: Assignee: Sandeep Singh > Consolidate the Spark Programming Guide with tabs for all languag

[jira] [Resolved] (SPARK-1534) spark-submit for yarn prints warnings even though calling as expected

[ https://issues.apache.org/jira/browse/SPARK-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1534. Resolution: Fixed Fix Version/s: 1.0.0 > spark-submit for yarn prints warnings even

[jira] [Updated] (SPARK-1534) spark-submit for yarn prints warnings even though calling as expected

[ https://issues.apache.org/jira/browse/SPARK-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1534: --- Assignee: Patrick Wendell (was: Kan Zhang) > spark-submit for yarn prints warnings even thou

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983836#comment-13983836 ] Sandy Ryza commented on SPARK-1588: --- PR for an adapted version of Mridul's patch - http

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983811#comment-13983811 ] Ted Malaska commented on SPARK-1642: Will do. :) > Upgrade FlumeInputDStream's Flume

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1564: --- Fix Version/s: (was: 1.0.0) 1.1.0 > Add JavaScript into Javadoc to tur

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983801#comment-13983801 ] Tathagata Das commented on SPARK-1642: -- For future convenience, can you just add a no

[jira] [Commented] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983799#comment-13983799 ] Tathagata Das commented on SPARK-1645: -- Hey [~hshreedharan] Thanks for jotting these

[jira] [Resolved] (SPARK-1496) SparkContext.jarOfClass should return Option instead of a sequence

[ https://issues.apache.org/jira/browse/SPARK-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1496. Resolution: Fixed > SparkContext.jarOfClass should return Option instead of a sequence > --

[jira] [Updated] (SPARK-1549) Add python support to spark-submit script

[ https://issues.apache.org/jira/browse/SPARK-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1549: --- Priority: Blocker (was: Major) > Add python support to spark-submit script > ---

[jira] [Resolved] (SPARK-1602) Cancelled jobs can lead to corrupted cached partitions

[ https://issues.apache.org/jira/browse/SPARK-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-1602. --- Resolution: Fixed > Cancelled jobs can lead to corrupted cached partitions >

[jira] [Resolved] (SPARK-1625) Ensure all legacy YARN options are supported with spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1625. Resolution: Duplicate > Ensure all legacy YARN options are supported with spark-submit > --

[jira] [Resolved] (SPARK-1653) Spark submit should not use SPARK_CLASSPATH internally (creates warnings)

[ https://issues.apache.org/jira/browse/SPARK-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1653. Resolution: Fixed Fix Version/s: 1.0.0 > Spark submit should not use SPARK_CLASSPATH

[jira] [Resolved] (SPARK-1654) Spark shell doesn't correctly pass quoted arguments to spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1654. Resolution: Fixed Issue resolved by pull request 576 [https://github.com/apache/spark/pull/

[jira] [Resolved] (SPARK-1657) Spark submit should fail gracefully if YARN support not enabled

[ https://issues.apache.org/jira/browse/SPARK-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1657. Resolution: Fixed > Spark submit should fail gracefully if YARN support not enabled > -

[jira] [Reopened] (SPARK-1652) Fixes and improvements for spark-submit/configs

[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1652: > Fixes and improvements for spark-submit/configs > ---

[jira] [Resolved] (SPARK-1652) Fixes and improvements for spark-submit/configs

[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1652. Resolution: Fixed > Fixes and improvements for spark-submit/configs > -

[jira] [Updated] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1588: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-1652 > SPARK_JAVA_OPTS and SPARK_YARN_

[jira] [Assigned] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-1588: - Assignee: Sandy Ryza > SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated > -

[jira] [Created] (SPARK-1660) Centralize the definition of property names and default values

Kousuke Saruta created SPARK-1660: - Summary: Centralize the definition of property names and default values Key: SPARK-1660 URL: https://issues.apache.org/jira/browse/SPARK-1660 Project: Spark

[jira] [Commented] (SPARK-1636) Move main methods to examples

[ https://issues.apache.org/jira/browse/SPARK-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983732#comment-13983732 ] Xiangrui Meng commented on SPARK-1636: -- PR: https://github.com/apache/spark/pull/584

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983721#comment-13983721 ] Tathagata Das commented on SPARK-944: - Would be great if you can submit an example soon

[jira] [Commented] (SPARK-975) Spark Replay Debugger

[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983603#comment-13983603 ] Kousuke Saruta commented on SPARK-975: -- Hi [~lian cheng]. Are there any updates on thi

[jira] [Commented] (SPARK-1649) DataType should contain nullable bit

[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983318#comment-13983318 ] Michael Armbrust commented on SPARK-1649: - Why do you think it would be better to

[jira] [Reopened] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niraj Suthar reopened SPARK-1527: - > rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, > rootDir1 > --

[jira] [Commented] (SPARK-1659) improvements spark-submit usage

[ https://issues.apache.org/jira/browse/SPARK-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983197#comment-13983197 ] Guoqiang Li commented on SPARK-1659: ./bin/spark-submit /opt/spark/classes/toona-assem

[jira] [Created] (SPARK-1659) improvements spark-submit usage

Guoqiang Li created SPARK-1659: -- Summary: improvements spark-submit usage Key: SPARK-1659 URL: https://issues.apache.org/jira/browse/SPARK-1659 Project: Spark Issue Type: Sub-task Re

[jira] [Commented] (SPARK-1658) Correctly identify if maven is installed and working

[ https://issues.apache.org/jira/browse/SPARK-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983183#comment-13983183 ] Rahul Singhal commented on SPARK-1658: -- PR: https://github.com/apache/spark/pull/580

[jira] [Created] (SPARK-1658) Correctly identify if maven is installed and working

Rahul Singhal created SPARK-1658: Summary: Correctly identify if maven is installed and working Key: SPARK-1658 URL: https://issues.apache.org/jira/browse/SPARK-1658 Project: Spark Issue Type

[jira] [Commented] (SPARK-1638) Executors fail to come up if "spark.executor.extraJavaOptions" is set

[ https://issues.apache.org/jira/browse/SPARK-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983168#comment-13983168 ] Kalpit Shah commented on SPARK-1638: Yeah, its very likely. I am going to pull the lat

[jira] [Commented] (SPARK-1638) Executors fail to come up if "spark.executor.extraJavaOptions" is set

[ https://issues.apache.org/jira/browse/SPARK-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983156#comment-13983156 ] Sean Owen commented on SPARK-1638: -- Almost certainly a duplicate of https://issues.apache

[jira] [Updated] (SPARK-1638) Executors fail to come up if "spark.executor.extraJavaOptions" is set

[ https://issues.apache.org/jira/browse/SPARK-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kalpit Shah updated SPARK-1638: --- Component/s: (was: Deploy) (was: EC2) Spark Core > Executor

[jira] [Comment Edited] (SPARK-1606) spark-submit needs `--arg` for every application parameter

[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982797#comment-13982797 ] Guoqiang Li edited comment on SPARK-1606 at 4/28/14 7:07 AM: --

[jira] [Commented] (SPARK-1606) spark-submit needs `--arg` for every application parameter

[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982797#comment-13982797 ] Guoqiang Li commented on SPARK-1606: - [SparkSubmitArguments.scala#L287|https://github