[jira] [Resolved] (SPARK-8620) cleanup CodeGenContext

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8620. --- Resolution: Fixed Fix Version/s: 1.5.0 > cleanup CodeGenContext > -- > >

[jira] [Commented] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

2015-06-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602485#comment-14602485 ] Josh Rosen commented on SPARK-8623: --- There's another report of this issue at https://gi

[jira] [Resolved] (SPARK-8648) Documented command not working

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8648. -- Resolution: Not A Problem I think it's easier if you put your text inline rather than in an RTF attachm

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-25 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602477#comment-14602477 ] Olivier Girardot commented on SPARK-8332: - Ok can you print the command line you'r

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-25 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602468#comment-14602468 ] Tao Li commented on SPARK-8332: --- I found that BigDecimalDeserializer will extend StdDeserial

[jira] [Assigned] (SPARK-8652) PySpark tests sometimes forget to check return status of doctest.testmod(), masking failing tests

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8652: --- Assignee: Josh Rosen (was: Apache Spark) > PySpark tests sometimes forget to check return st

[jira] [Assigned] (SPARK-8652) PySpark tests sometimes forget to check return status of doctest.testmod(), masking failing tests

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8652: --- Assignee: Apache Spark (was: Josh Rosen) > PySpark tests sometimes forget to check return st

[jira] [Commented] (SPARK-8652) PySpark tests sometimes forget to check return status of doctest.testmod(), masking failing tests

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602464#comment-14602464 ] Apache Spark commented on SPARK-8652: - User 'JoshRosen' has created a pull request for

[jira] [Created] (SPARK-8652) PySpark tests sometimes forget to check return status of doctest.testmod(), masking failing tests

2015-06-25 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8652: - Summary: PySpark tests sometimes forget to check return status of doctest.testmod(), masking failing tests Key: SPARK-8652 URL: https://issues.apache.org/jira/browse/SPARK-8652

[jira] [Resolved] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8635. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7018 [https://github.com/

[jira] [Commented] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602431#comment-14602431 ] Xiangrui Meng commented on SPARK-8647: -- All MatrixUDT instances are the same. So the

[jira] [Updated] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8647: - Issue Type: Improvement (was: Bug) > Potential issues with the constant hashCode > -

[jira] [Updated] (SPARK-8620) cleanup CodeGenContext

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8620: -- Assignee: Wenchen Fan > cleanup CodeGenContext > -- > > Key: SPARK-8

[jira] [Comment Edited] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-25 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602411#comment-14602411 ] Animesh Baranawal edited comment on SPARK-8636 at 6/26/15 5:13 AM: -

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-25 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602411#comment-14602411 ] Animesh Baranawal commented on SPARK-8636: -- So the condition should be : if (l ==

[jira] [Resolved] (SPARK-8237) misc function: sha2

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8237. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6934 [https://github.com/

[jira] [Commented] (SPARK-8372) History server shows incorrect information for application not started

2015-06-25 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602405#comment-14602405 ] Carson Wang commented on SPARK-8372: [~vanzin] The log path name may also end with an

[jira] [Commented] (SPARK-8588) Could not use concat with UDF in where clause

2015-06-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602401#comment-14602401 ] Wenchen Fan commented on SPARK-8588: cc [~marmbrus] this issue has already been fixed

[jira] [Created] (SPARK-8651) Lasso with SGD not Converging properly

2015-06-25 Thread Albert Azout (JIRA)
Albert Azout created SPARK-8651: --- Summary: Lasso with SGD not Converging properly Key: SPARK-8651 URL: https://issues.apache.org/jira/browse/SPARK-8651 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1859) Linear, Ridge and Lasso Regressions with SGD yield unexpected results

2015-06-25 Thread Albert Azout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602388#comment-14602388 ] Albert Azout commented on SPARK-1859: - Hi this is still an open issue for us. FYI. Any

[jira] [Commented] (SPARK-5161) Parallelize Python test execution

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602369#comment-14602369 ] Apache Spark commented on SPARK-5161: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-5161) Parallelize Python test execution

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5161: --- Assignee: Josh Rosen (was: Apache Spark) > Parallelize Python test execution > -

[jira] [Assigned] (SPARK-5161) Parallelize Python test execution

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5161: --- Assignee: Apache Spark (was: Josh Rosen) > Parallelize Python test execution > -

[jira] [Updated] (SPARK-8650) Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8650: - Summary: Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2 (was: Use spa

[jira] [Assigned] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8650: --- Assignee: (was: Apache Spark) > Use spark.app.name priority when in SparkSQLCLIDriver or

[jira] [Assigned] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8650: --- Assignee: Apache Spark > Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftS

[jira] [Commented] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602361#comment-14602361 ] Apache Spark commented on SPARK-8650: - User 'watermen' has created a pull request for

[jira] [Commented] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver => NPE

2015-06-25 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602353#comment-14602353 ] Xu Chen commented on SPARK-8592: Seems toString cause NPE > CoarseGrainedExecutorBackend

[jira] [Assigned] (SPARK-5161) Parallelize Python test execution

2015-06-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-5161: - Assignee: Josh Rosen > Parallelize Python test execution > - > >

[jira] [Updated] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8650: - Affects Version/s: 1.4.0 > Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2 > --

[jira] [Created] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-8650: Summary: Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2 Key: SPARK-8650 URL: https://issues.apache.org/jira/browse/SPARK-8650 Project: Spark

[jira] [Comment Edited] (SPARK-6355) Spark standalone cluster does not support local:/ url for jar file

2015-06-25 Thread Matthew Brandyberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602072#comment-14602072 ] Matthew Brandyberry edited comment on SPARK-6355 at 6/26/15 1:34 AM: ---

[jira] [Closed] (SPARK-8163) CheckPoint mechanism did not work well when error happened in big streaming

2015-06-25 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus closed SPARK-8163. --- Resolution: Not A Problem Mistake the prolem. > CheckPoint mechanism did not work well when error hap

[jira] [Commented] (SPARK-8648) Documented command not working

2015-06-25 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602225#comment-14602225 ] Sudhakar Thota commented on SPARK-8648: --- I will work on this. > Documented command

[jira] [Assigned] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7739: --- Assignee: Apache Spark > Improve ChiSqSelector example code in the user guide > -

[jira] [Assigned] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7739: --- Assignee: (was: Apache Spark) > Improve ChiSqSelector example code in the user guide > --

[jira] [Commented] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602220#comment-14602220 ] Apache Spark commented on SPARK-7739: - User 'sethah' has created a pull request for th

[jira] [Commented] (SPARK-8649) Mapr repository is not defined properly

2015-06-25 Thread Ashok Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602201#comment-14602201 ] Ashok Kumar commented on SPARK-8649: mapr-repo MapR Repository ht

[jira] [Created] (SPARK-8649) Mapr repository is not defined properly

2015-06-25 Thread Ashok Kumar (JIRA)
Ashok Kumar created SPARK-8649: -- Summary: Mapr repository is not defined properly Key: SPARK-8649 URL: https://issues.apache.org/jira/browse/SPARK-8649 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-8498) Fix NullPointerException in error-handling path in UnsafeShuffleWriter

2015-06-25 Thread Yuri Saito (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602170#comment-14602170 ] Yuri Saito commented on SPARK-8498: --- I think {{sorter.cleanupAfterError()}} throw {{Spar

[jira] [Updated] (SPARK-8648) Documented command not working

2015-06-25 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-8648: -- Attachment: SPARK-8648-1.rtf Documentation > Documented command not working >

[jira] [Created] (SPARK-8648) Documented command not working

2015-06-25 Thread Sudhakar Thota (JIRA)
Sudhakar Thota created SPARK-8648: - Summary: Documented command not working Key: SPARK-8648 URL: https://issues.apache.org/jira/browse/SPARK-8648 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602123#comment-14602123 ] Alok Singh commented on SPARK-8647: --- [~mengxr] [~josephkb] Hi Xiang and Joseph, What

[jira] [Commented] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602117#comment-14602117 ] Alok Singh commented on SPARK-8647: --- I am not sure about the priority . But I put Minor

[jira] [Created] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Alok Singh (JIRA)
Alok Singh created SPARK-8647: - Summary: Potential issues with the constant hashCode Key: SPARK-8647 URL: https://issues.apache.org/jira/browse/SPARK-8647 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8621) crosstab exception when one of the value is empty

2015-06-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602094#comment-14602094 ] Reynold Xin commented on SPARK-8621: That's one way to do it. The other way is to cons

[jira] [Comment Edited] (SPARK-6355) Spark standalone cluster does not support local:/ url for jar file

2015-06-25 Thread Matthew Brandyberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602072#comment-14602072 ] Matthew Brandyberry edited comment on SPARK-6355 at 6/25/15 10:40 PM: --

[jira] [Commented] (SPARK-6355) Spark standalone cluster does not support local:/ url for jar file

2015-06-25 Thread Matthew Brandyberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602072#comment-14602072 ] Matthew Brandyberry commented on SPARK-6355: This appears to fix fixed in 1.4.

[jira] [Comment Edited] (SPARK-6355) Spark standalone cluster does not support local:/ url for jar file

2015-06-25 Thread Matthew Brandyberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602072#comment-14602072 ] Matthew Brandyberry edited comment on SPARK-6355 at 6/25/15 10:31 PM: --

[jira] [Commented] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-06-25 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602051#comment-14602051 ] David Sabater commented on SPARK-8616: -- It looks the issue only appears on 1.3.2, I t

[jira] [Commented] (SPARK-8546) PMML export for Naive Bayes

2015-06-25 Thread Villu Ruusmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602023#comment-14602023 ] Villu Ruusmann commented on SPARK-8546: --- The NB exporter should be easier to impleme

[jira] [Updated] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8066: Shepherd: Michael Armbrust > Add support for connecting to Hive 1.0 (0.14.1) > -

[jira] [Updated] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8067: Assignee: Marcelo Vanzin > Add support for connecting to Hive 1.1 >

[jira] [Updated] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8067: Shepherd: Michael Armbrust > Add support for connecting to Hive 1.1 > --

[jira] [Updated] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8066: Assignee: Marcelo Vanzin > Add support for connecting to Hive 1.0 (0.14.1) > ---

[jira] [Commented] (SPARK-8597) DataFrame partitionBy memory pressure scales extremely poorly

2015-06-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602009#comment-14602009 ] Michael Armbrust commented on SPARK-8597: - Parquet allocates fairly large buffers

[jira] [Updated] (SPARK-8646) PySpark does not run on YARN

2015-06-25 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliet Hougland updated SPARK-8646: --- Attachment: spark1.4-SPARK_HOME-set-PYTHONPATH-set.log spark1.4-SPARK_HOME-set.

[jira] [Created] (SPARK-8646) PySpark does not run on YARN

2015-06-25 Thread Juliet Hougland (JIRA)
Juliet Hougland created SPARK-8646: -- Summary: PySpark does not run on YARN Key: SPARK-8646 URL: https://issues.apache.org/jira/browse/SPARK-8646 Project: Spark Issue Type: Bug Comp

[jira] [Updated] (SPARK-8597) DataFrame partitionBy memory pressure scales extremely poorly

2015-06-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8597: Target Version/s: 1.5.0 Priority: Blocker (was: Critical) > DataFrame partition

[jira] [Created] (SPARK-8645) Incorrect expression analysis with Hive

2015-06-25 Thread Eugene Zhulenev (JIRA)
Eugene Zhulenev created SPARK-8645: -- Summary: Incorrect expression analysis with Hive Key: SPARK-8645 URL: https://issues.apache.org/jira/browse/SPARK-8645 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8644: --- Assignee: Apache Spark (was: Aaron Davidson) > SparkException thrown due to Executor excepti

[jira] [Commented] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601984#comment-14601984 ] Apache Spark commented on SPARK-8644: - User 'aarondav' has created a pull request for

[jira] [Assigned] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8644: --- Assignee: Aaron Davidson (was: Apache Spark) > SparkException thrown due to Executor excepti

[jira] [Created] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-06-25 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-8644: - Summary: SparkException thrown due to Executor exceptions should include caller site in stack trace Key: SPARK-8644 URL: https://issues.apache.org/jira/browse/SPARK-8644

[jira] [Updated] (SPARK-8643) local-cluster may not shutdown SparkContext gracefully

2015-06-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8643: Description: When I was debugging SPARK-8567, I found that when I was using local-cluster, at the end of an

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-06-25 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601923#comment-14601923 ] Shay Rojansky commented on SPARK-7736: -- The problem is simply with the YARN status fo

[jira] [Updated] (SPARK-8643) local-cluster may not shutdown SparkContext gracefully

2015-06-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8643: Attachment: HiveSparkSubmitSuite (SPARK-8368).txt > local-cluster may not shutdown SparkContext gracefully >

[jira] [Created] (SPARK-8643) local-cluster may not shutdown SparkContext gracefully

2015-06-25 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8643: --- Summary: local-cluster may not shutdown SparkContext gracefully Key: SPARK-8643 URL: https://issues.apache.org/jira/browse/SPARK-8643 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-06-25 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601914#comment-14601914 ] Neelesh Srinivas Salian commented on SPARK-7736: Could you add more contex

[jira] [Commented] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601900#comment-14601900 ] Apache Spark commented on SPARK-8567: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601899#comment-14601899 ] Apache Spark commented on SPARK-7287: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-25 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601898#comment-14601898 ] Neelesh Srinivas Salian commented on SPARK-4352: Checking to see if this b

[jira] [Updated] (SPARK-8642) Ungraceful failure when yarn client is not configured.

2015-06-25 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliet Hougland updated SPARK-8642: --- Attachment: yarnretries.log Log file from failed bc of misconfiguration spakr job. counting l

[jira] [Created] (SPARK-8642) Ungraceful failure when yarn client is not configured.

2015-06-25 Thread Juliet Hougland (JIRA)
Juliet Hougland created SPARK-8642: -- Summary: Ungraceful failure when yarn client is not configured. Key: SPARK-8642 URL: https://issues.apache.org/jira/browse/SPARK-8642 Project: Spark Issu

[jira] [Commented] (SPARK-7977) Disallow println

2015-06-25 Thread Jon Alter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601827#comment-14601827 ] Jon Alter commented on SPARK-7977: -- Working on this. > Disallow println > --

[jira] [Commented] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601789#comment-14601789 ] Apache Spark commented on SPARK-8067: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8067: --- Assignee: (was: Apache Spark) > Add support for connecting to Hive 1.1 >

[jira] [Assigned] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8066: --- Assignee: Apache Spark > Add support for connecting to Hive 1.0 (0.14.1) > --

[jira] [Assigned] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8067: --- Assignee: Apache Spark > Add support for connecting to Hive 1.1 > ---

[jira] [Commented] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601788#comment-14601788 ] Apache Spark commented on SPARK-8066: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8066: --- Assignee: (was: Apache Spark) > Add support for connecting to Hive 1.0 (0.14.1) > ---

[jira] [Resolved] (SPARK-8417) spark-class has illegal statement

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8417. -- Resolution: Cannot Reproduce > spark-class has illegal statement > - > >

[jira] [Commented] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601768#comment-14601768 ] Sean Owen commented on SPARK-8639: -- OK, I almost don't see the difference in the first on

[jira] [Commented] (SPARK-7012) Add support for NOT NULL modifier for column definitions on DDLParser

2015-06-25 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601740#comment-14601740 ] Sudhakar Thota commented on SPARK-7012: --- I would like to explore for a solution on t

[jira] [Commented] (SPARK-1635) Java API docs do not show annotation.

2015-06-25 Thread Deron Eriksson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601735#comment-14601735 ] Deron Eriksson commented on SPARK-1635: --- Hi, I'd like to work on this. > Java API d

[jira] [Commented] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601732#comment-14601732 ] Herman van Hovell tot Westerflier commented on SPARK-7712: -- After

[jira] [Updated] (SPARK-8641) Native Spark Window Functions

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8641: - Description: The current Window implementation uses Hive U

[jira] [Updated] (SPARK-8641) Native Spark Window Functions

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8641: - Description: The current Window implementation uses Hive U

[jira] [Created] (SPARK-8641) Native Spark Window Functions

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
Herman van Hovell tot Westerflier created SPARK-8641: Summary: Native Spark Window Functions Key: SPARK-8641 URL: https://issues.apache.org/jira/browse/SPARK-8641 Project: Spark

[jira] [Updated] (SPARK-8640) Window Function Multiple Frame Processing in Single Processing Step

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8640: - Description: The new Window operator is capable of process

[jira] [Updated] (SPARK-8640) Window Function Multiple Frame Processing in Single Processing Step

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8640: - Description: The new Window operator is capable of process

[jira] [Updated] (SPARK-8638) Window Function Performance Improvements

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Summary: Window Function Performance Improvements (was: Sp

[jira] [Created] (SPARK-8640) Window Function Multiple Frame Processing in Single Processing Step

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
Herman van Hovell tot Westerflier created SPARK-8640: Summary: Window Function Multiple Frame Processing in Single Processing Step Key: SPARK-8640 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Created] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

2015-06-25 Thread Rosstin Murphy (JIRA)
Rosstin Murphy created SPARK-8639: - Summary: Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md Key: SPARK-8639 URL: https://issues.apache.org/jira/browse/SPARK-8

[jira] [Commented] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601689#comment-14601689 ] Apache Spark commented on SPARK-8603: - User 'prakashpc' has created a pull request for

[jira] [Commented] (SPARK-8597) DataFrame partitionBy memory pressure scales extremely poorly

2015-06-25 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601687#comment-14601687 ] Matt Cheah commented on SPARK-8597: --- I did some more digging. The memory space is taken

[jira] [Updated] (SPARK-8638) Spark Window Function Performance Improvements

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Description: Improve the performance of Spark Window Funct

[jira] [Updated] (SPARK-8638) Spark Window Function Performance Improvements

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Description: Improve the performance of Spark Window Funct

[jira] [Created] (SPARK-8638) Spark Window Function Performance Improvements

2015-06-25 Thread Herman van Hovell tot Westerflier (JIRA)
Herman van Hovell tot Westerflier created SPARK-8638: Summary: Spark Window Function Performance Improvements Key: SPARK-8638 URL: https://issues.apache.org/jira/browse/SPARK-8638 P

[jira] [Commented] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-06-25 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601678#comment-14601678 ] Matt Cheah commented on SPARK-8167: --- [~joshrosen] any thoughts on this? > Tasks that fa

  1   2   3   >