[jira] [Created] (SPARK-12057) Prevent failure on corrupt JSON records (Spark SQL)

2015-11-30 Thread Ian Macalinao (JIRA)
Ian Macalinao created SPARK-12057: - Summary: Prevent failure on corrupt JSON records (Spark SQL) Key: SPARK-12057 URL: https://issues.apache.org/jira/browse/SPARK-12057 Project: Spark Issue

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032567#comment-15032567 ] Apache Spark commented on SPARK-12000: -- User 'thunterdb' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12000: Assignee: Xiangrui Meng (was: Apache Spark) > `sbt publishLocal` hits a Scala compiler

[jira] [Commented] (SPARK-4944) Table Not Found exception in "Create Table Like registered RDD table"

2015-11-30 Thread Derek Sabry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032545#comment-15032545 ] Derek Sabry commented on SPARK-4944: How might I be assigned to this issue? I would like to to set the

[jira] [Assigned] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12000: Assignee: Apache Spark (was: Xiangrui Meng) > `sbt publishLocal` hits a Scala compiler

[jira] [Reopened] (SPARK-11206) Support SQL UI on the history server

2015-11-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-11206: I'm re-opening this since I am reverting this patch due to the test failures. > Support SQL UI on the

[jira] [Updated] (SPARK-11206) Support SQL UI on the history server

2015-11-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11206: --- Fix Version/s: (was: 1.7.0) > Support SQL UI on the history server >

[jira] [Assigned] (SPARK-11328) Correctly propagate error message in the case of failures when writing parquet

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11328: Assignee: Nong Li (was: Apache Spark) > Correctly propagate error message in the case of

[jira] [Commented] (SPARK-12057) Prevent failure on corrupt JSON records (Spark SQL)

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032473#comment-15032473 ] Apache Spark commented on SPARK-12057: -- User 'simplyianm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11328) Correctly propagate error message in the case of failures when writing parquet

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11328: Assignee: Apache Spark (was: Nong Li) > Correctly propagate error message in the case of

[jira] [Created] (SPARK-12058) Enable KinesisStreamTests in python/pyspark/streaming/tests.py

2015-11-30 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12058: Summary: Enable KinesisStreamTests in python/pyspark/streaming/tests.py Key: SPARK-12058 URL: https://issues.apache.org/jira/browse/SPARK-12058 Project: Spark

[jira] [Updated] (SPARK-12058) Fix KinesisStreamTests in python/pyspark/streaming/tests.py and enable it

2015-11-30 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12058: - Summary: Fix KinesisStreamTests in python/pyspark/streaming/tests.py and enable it (was: Enable

[jira] [Assigned] (SPARK-12057) Prevent failure on corrupt JSON records (Spark SQL)

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12057: Assignee: Apache Spark > Prevent failure on corrupt JSON records (Spark SQL) >

[jira] [Assigned] (SPARK-12057) Prevent failure on corrupt JSON records (Spark SQL)

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12057: Assignee: (was: Apache Spark) > Prevent failure on corrupt JSON records (Spark SQL) >

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032484#comment-15032484 ] Xiangrui Meng commented on SPARK-11988: --- It may be hard to make dependency changes late in the QA

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-30 Thread Villu Ruusmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032498#comment-15032498 ] Villu Ruusmann commented on SPARK-11988: The 'org.glassfish.jaxb:jaxb-runtime' can be safely

[jira] [Commented] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-11-30 Thread R. H. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032500#comment-15032500 ] R. H. commented on SPARK-12048: --- Yes, I have setup the build env, and I am going to test it tomorrow. >

[jira] [Issue Comment Deleted] (SPARK-11932) trackStateByKey throws java.lang.IllegalArgumentException: requirement failed on restarting from checkpoint

2015-11-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11932: -- Comment: was deleted (was: User 'tmnd1991' has created a pull request for this issue:

[jira] [Commented] (SPARK-11603) ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit

2015-11-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032564#comment-15032564 ] Xiangrui Meng commented on SPARK-11603: --- [~dbtsai] Are you still working on this? What is the

[jira] [Created] (SPARK-12044) Fix usage of isnan, isnull, isNaN, isNull, isNotNull

2015-11-30 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12044: --- Summary: Fix usage of isnan, isnull, isNaN, isNull, isNotNull Key: SPARK-12044 URL: https://issues.apache.org/jira/browse/SPARK-12044 Project: Spark Issue

[jira] [Commented] (SPARK-12044) Fix usage of isnan, isnull, isNaN, isNull, isNotNull

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031494#comment-15031494 ] Apache Spark commented on SPARK-12044: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Created] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-11-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12045: -- Summary: Use joda's DateTime to replace Calendar Key: SPARK-12045 URL: https://issues.apache.org/jira/browse/SPARK-12045 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031528#comment-15031528 ] Sean Owen commented on SPARK-12045: --- {{Calendar}} is not for parsing date strings; {{DateFormat}} is.

[jira] [Resolved] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11859. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9886

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-11-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031541#comment-15031541 ] Jeff Zhang commented on SPARK-12045: Working on it. > Use joda's DateTime to replace Calendar >

[jira] [Updated] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11859: -- Assignee: Jacek Laskowski > Regex for master URL for Mesos accepts incorrect zk:// prefix >

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031576#comment-15031576 ] Sean Owen commented on SPARK-12045: --- Yes, I suppose that's what I mean, wherever dates are manipulated

[jira] [Created] (SPARK-12046) Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6

2015-11-30 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12046: -- Summary: Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6 Key: SPARK-12046 URL: https://issues.apache.org/jira/browse/SPARK-12046 Project: Spark

[jira] [Updated] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11997: -- Assignee: Dilip Biswal > NPE when save a DataFrame as parquet and partitioned by long column >

[jira] [Updated] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12028: -- Assignee: Xiao Li > [SQL] get_json_object is unable to return a correct result for null literals >

[jira] [Updated] (SPARK-12035) Add more debug information in include_example tag of Jekyll

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12035: -- Priority: Minor (was: Major) Component/s: Documentation Build > Add more

[jira] [Resolved] (SPARK-12043) wrong comment for "gt" in Column.scala

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12043. --- Resolution: Not A Problem > wrong comment for "gt" in Column.scala >

[jira] [Updated] (SPARK-12043) wrong comment for "gt" in Column.scala

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12043: -- Target Version/s: (was: 1.5.2) Fix Version/s: (was: 1.5.2) Component/s: (was:

[jira] [Updated] (SPARK-11824) WebUI does not render descriptions with 'bad' HTML, throws console error

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11824: -- Labels: starter (was: ) I think it's just a matter of applying {{Utility.escape}} to this string? I

[jira] [Updated] (SPARK-12023) Warnings while packaging spark with maven.

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12023: -- Assignee: Prashant Sharma > Warnings while packaging spark with maven. >

[jira] [Resolved] (SPARK-12023) Warnings while packaging spark with maven.

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12023. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10014

[jira] [Assigned] (SPARK-12046) Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12046: Assignee: Cheng Lian (was: Apache Spark) > Visibility and format issues in

[jira] [Assigned] (SPARK-12046) Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12046: Assignee: Apache Spark (was: Cheng Lian) > Visibility and format issues in

[jira] [Commented] (SPARK-12046) Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031620#comment-15031620 ] Apache Spark commented on SPARK-12046: -- User 'liancheng' has created a pull request for this issue:

[jira] [Created] (SPARK-12051) Can't register UDF from Hive thrift server

2015-11-30 Thread Alex Liu (JIRA)
Alex Liu created SPARK-12051: Summary: Can't register UDF from Hive thrift server Key: SPARK-12051 URL: https://issues.apache.org/jira/browse/SPARK-12051 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-11-30 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032059#comment-15032059 ] Huaxin Gao commented on SPARK-12048: Hi R.H. Are you going to work on this and submit a PR? If not,

[jira] [Created] (SPARK-12050) Support for non-standard krb5.conf via KRB5_CONFIG variable

2015-11-30 Thread Hari Krishna Dara (JIRA)
Hari Krishna Dara created SPARK-12050: - Summary: Support for non-standard krb5.conf via KRB5_CONFIG variable Key: SPARK-12050 URL: https://issues.apache.org/jira/browse/SPARK-12050 Project: Spark

[jira] [Updated] (SPARK-12050) Support for non-standard krb5.conf via KRB5_CONFIG variable

2015-11-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12050: -- Priority: Minor (was: Major) Component/s: Spark Core [~haridsv] please read

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-30 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032058#comment-15032058 ] Timothy Hunter commented on SPARK-12000: Yes, I have this branch with some fixes, but I would

[jira] [Updated] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11997: - Fix Version/s: (was: 2.0.0) > NPE when save a DataFrame as parquet and partitioned by long column >

[jira] [Updated] (SPARK-12050) Support for non-standard krb5.conf via KRB5_CONFIG variable

2015-11-30 Thread Hari Krishna Dara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Krishna Dara updated SPARK-12050: -- Attachment: SPARK-12050-patch.diff Suggested patch for adding support for KRB5_CONFIG

[jira] [Commented] (SPARK-12050) Support for non-standard krb5.conf via KRB5_CONFIG variable

2015-11-30 Thread Hari Krishna Dara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032065#comment-15032065 ] Hari Krishna Dara commented on SPARK-12050: --- [~srowen] Sorry about that, I will go through the

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-11-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Updated] (SPARK-12016) word2vec load model can't use findSynonyms to get words

2015-11-30 Thread yuangang.liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuangang.liu updated SPARK-12016: - Description: I use word2vec.fit to train a word2vecModel and then save the model to file

[jira] [Commented] (SPARK-8503) SizeEstimator returns negative value for recursive data structures

2015-11-30 Thread AJ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031890#comment-15031890 ] AJ commented on SPARK-8503: --- I thought the goal was to estimate the size it will take up on the remote side in

[jira] [Reopened] (SPARK-12016) word2vec load model can't use findSynonyms to get words

2015-11-30 Thread yuangang.liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuangang.liu reopened SPARK-12016: -- sorry for my late update > word2vec load model can't use findSynonyms to get words >

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12053: - Affects Version/s: (was: 1.6.0) > EventLog for completed applications always not found if >

[jira] [Commented] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032235#comment-15032235 ] Teng Qiu commented on SPARK-12053: -- bug found: caused by

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12053: - Description: EventLog for completed applications always not found with following settings in

[jira] [Commented] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032246#comment-15032246 ] Apache Spark commented on SPARK-12053: -- User 'chutium' has created a pull request for this issue:

[jira] [Created] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-12053: Summary: EventLog for completed applications always not found if spark.eventLog.compress is true Key: SPARK-12053 URL: https://issues.apache.org/jira/browse/SPARK-12053

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12053: - Affects Version/s: 1.6.0 > EventLog for completed applications always not found if >

[jira] [Assigned] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12053: Assignee: (was: Apache Spark) > EventLog for completed applications always not found

[jira] [Assigned] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12053: Assignee: Apache Spark > EventLog for completed applications always not found if >

[jira] [Resolved] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11700. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9990

[jira] [Created] (SPARK-12052) DataFrame with self-join fails unless toDF() column aliases provided

2015-11-30 Thread Dean Wampler (JIRA)
Dean Wampler created SPARK-12052: Summary: DataFrame with self-join fails unless toDF() column aliases provided Key: SPARK-12052 URL: https://issues.apache.org/jira/browse/SPARK-12052 Project: Spark

[jira] [Commented] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

2015-11-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032217#comment-15032217 ] Davies Liu commented on SPARK-12032: [~marmbrus] Do you have some idea how to fix this? I had not

[jira] [Created] (SPARK-12054) Consider nullable in codegen

2015-11-30 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12054: -- Summary: Consider nullable in codegen Key: SPARK-12054 URL: https://issues.apache.org/jira/browse/SPARK-12054 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-4681) Turn on executor level blacklisting by default

2015-11-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout reassigned SPARK-4681: - Assignee: Kay Ousterhout (was: Davies Liu) > Turn on executor level blacklisting by

[jira] [Updated] (SPARK-4681) Turn on executor level blacklisting by default

2015-11-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-4681: -- Summary: Turn on executor level blacklisting by default (was: Turn on host level blacklisting

[jira] [Created] (SPARK-12055) TimSort failing with error when writing a partitioned data set

2015-11-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-12055: Summary: TimSort failing with error when writing a partitioned data set Key: SPARK-12055 URL: https://issues.apache.org/jira/browse/SPARK-12055 Project: Spark

[jira] [Resolved] (SPARK-11982) Improve performance of CartesianProduct

2015-11-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11982. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9969

[jira] [Commented] (SPARK-4681) Turn on executor level blacklisting by default

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032350#comment-15032350 ] Apache Spark commented on SPARK-4681: - User 'kayousterhout' has created a pull request for this issue:

[jira] [Assigned] (SPARK-4681) Turn on executor level blacklisting by default

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4681: --- Assignee: Kay Ousterhout (was: Apache Spark) > Turn on executor level blacklisting by

[jira] [Assigned] (SPARK-4681) Turn on executor level blacklisting by default

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4681: --- Assignee: Apache Spark (was: Kay Ousterhout) > Turn on executor level blacklisting by

[jira] [Commented] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032403#comment-15032403 ] Michael Armbrust commented on SPARK-12032: -- The standard algorithm for join reordering should

[jira] [Commented] (SPARK-5106) Make Web UI automatically refresh/update displayed data

2015-11-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032419#comment-15032419 ] Steve Loughran commented on SPARK-5106: --- The discussion on the PR has essentially concluded that

[jira] [Created] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

2015-11-30 Thread Anderson de Andrade (JIRA)
Anderson de Andrade created SPARK-12056: --- Summary: NewHadoopRDD: TaskAttemptContext should be created only after calling setConf. Key: SPARK-12056 URL: https://issues.apache.org/jira/browse/SPARK-12056

[jira] [Commented] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032439#comment-15032439 ] Apache Spark commented on SPARK-12056: -- User 'adeandrade' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12056: Assignee: Apache Spark > NewHadoopRDD: TaskAttemptContext should be created only after

[jira] [Assigned] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12056: Assignee: (was: Apache Spark) > NewHadoopRDD: TaskAttemptContext should be created

[jira] [Updated] (SPARK-11328) Correctly propagate error message in the case of failures when writing parquet

2015-11-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11328: - Assignee: Nong Li > Correctly propagate error message in the case of failures when writing parquet >

[jira] [Updated] (SPARK-11328) Correctly propagate error message in the case of failures when writing parquet

2015-11-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11328: - Target Version/s: 1.6.0 Priority: Critical (was: Major) > Correctly propagate error message

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11553: - Labels: releasenotes (was: ) > row.getInt(i) if row[i]=null returns 0 >

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032887#comment-15032887 ] Xiao Li commented on SPARK-12030: - [SPARK-7542][SQL] Support off-heap index/sort buffer

[jira] [Comment Edited] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032939#comment-15032939 ] Xiao Li edited comment on SPARK-12030 at 12/1/15 2:16 AM: -- Let me post a simple

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032939#comment-15032939 ] Xiao Li commented on SPARK-12030: - Let me post a simple case that can trigger the data corruption. The

[jira] [Assigned] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12067: Assignee: (was: Apache Spark) > Fix usage of isnan, isnull, isnotnull of Column and

[jira] [Commented] (SPARK-6521) Bypass network shuffle read if both endpoints are local

2015-11-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033016#comment-15033016 ] Takeshi Yamamuro commented on SPARK-6521: - Performance of the current Spark heavily depends on

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12053: --- Assignee: Kousuke Saruta > EventLog for completed applications always not found if >

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12053: --- Assignee: (was: Kousuke Saruta) > EventLog for completed applications always not found

[jira] [Resolved] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12053. Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 > EventLog for

[jira] [Resolved] (SPARK-11960) User guide section for streaming a/b testing

2015-11-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11960. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10005

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032724#comment-15032724 ] Xiao Li commented on SPARK-12030: - I believe I already found which PRs introduced the regression.

[jira] [Updated] (SPARK-12059) Standalone Master assertion error

2015-11-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12059: -- Description: {code} 15/11/30 09:55:04 ERROR Inbox: Ignoring error java.lang.AssertionError: assertion

[jira] [Commented] (SPARK-12059) Standalone Master assertion error

2015-11-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032806#comment-15032806 ] Saisai Shao commented on SPARK-12059: - Thanks a lot [~andrewor14], I will look into this issue. >

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032817#comment-15032817 ] Josh Rosen commented on SPARK-12000: This ticket describes a few closely-related yet distinct doc

[jira] [Commented] (SPARK-12063) Group by Column Number identifier is not successfully parsed

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032828#comment-15032828 ] Apache Spark commented on SPARK-12063: -- User 'dereksabryfb' has created a pull request for this

[jira] [Assigned] (SPARK-12063) Group by Column Number identifier is not successfully parsed

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12063: Assignee: Apache Spark > Group by Column Number identifier is not successfully parsed >

[jira] [Assigned] (SPARK-12063) Group by Column Number identifier is not successfully parsed

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12063: Assignee: (was: Apache Spark) > Group by Column Number identifier is not successfully

[jira] [Created] (SPARK-12064) Make the SqlParser as trait for better integrated with extensions

2015-11-30 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-12064: - Summary: Make the SqlParser as trait for better integrated with extensions Key: SPARK-12064 URL: https://issues.apache.org/jira/browse/SPARK-12064 Project: Spark

[jira] [Resolved] (SPARK-12037) Executors use heartbeatReceiverRef to report heartbeats and task metrics that might not be initialized and leads to NullPointerException

2015-11-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12037. --- Resolution: Fixed Assignee: Nan Zhu Fix Version/s: 1.6.0 Target

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032857#comment-15032857 ] Davies Liu commented on SPARK-12030: [~smilegator] Could you post the related PRs here? So we can

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032877#comment-15032877 ] Michael Armbrust commented on SPARK-11966: -- Have you seen

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Issue Type: Improvement (was: Bug) > JSON representation of nested StructTypes could be

  1   2   3   >