[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-10-14 Thread Balaji Krish (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957661#comment-14957661 ] Balaji Krish commented on SPARK-10528: -- Following steps solved my problem 1. Open C

[jira] [Assigned] (SPARK-11111) Fast null-safe join

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Davies Liu (was: Apache Spark) > Fast null-safe join > --- > >

[jira] [Assigned] (SPARK-11111) Fast null-safe join

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Apache Spark (was: Davies Liu) > Fast null-safe join > --- > >

[jira] [Commented] (SPARK-11111) Fast null-safe join

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957669#comment-14957669 ] Apache Spark commented on SPARK-1: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-10538) java.lang.NegativeArraySizeException during join

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10538: Target Version/s: 1.6.0 (was: 1.5.2) > java.lang.NegativeArraySizeException during join >

[jira] [Created] (SPARK-11112) DAG visualization: display RDD callsite

2015-10-14 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2: - Summary: DAG visualization: display RDD callsite Key: SPARK-2 URL: https://issues.apache.org/jira/browse/SPARK-2 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11112) DAG visualization: display RDD callsite

2015-10-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7463 > DAG visualization: display RDD ca

[jira] [Commented] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957721#comment-14957721 ] Jakob Odersky commented on SPARK-0: --- exactly what I got, I'll take a look at it

[jira] [Updated] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-0: Assignee: Jakob Odersky > Scala 2.11 build fails due to compiler errors > -

[jira] [Updated] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-0: Priority: Critical (was: Major) > Scala 2.11 build fails due to compiler errors >

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2015-10-14 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957731#comment-14957731 ] Alexis Seigneurin commented on SPARK-10925: --- Well, technically, it's not a dupl

[jira] [Created] (SPARK-11113) Remove DeveloperApi annotation from private classes

2015-10-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-3: --- Summary: Remove DeveloperApi annotation from private classes Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11113) Remove DeveloperApi annotation from private classes

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3: Description: For a variety of reasons, we tagged a bunch of internal classes in the execution pack

[jira] [Commented] (SPARK-11113) Remove DeveloperApi annotation from private classes

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957776#comment-14957776 ] Apache Spark commented on SPARK-3: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11113) Remove DeveloperApi annotation from private classes

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark (was: Reynold Xin) > Remove DeveloperApi annotation from private c

[jira] [Assigned] (SPARK-11113) Remove DeveloperApi annotation from private classes

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Reynold Xin (was: Apache Spark) > Remove DeveloperApi annotation from private c

[jira] [Commented] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957779#comment-14957779 ] Apache Spark commented on SPARK-4: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4: Assignee: Apache Spark (was: Davies Liu) > Add getOrCreate for SparkContext/SQLContext fo

[jira] [Created] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

2015-10-14 Thread Davies Liu (JIRA)
Davies Liu created SPARK-4: -- Summary: Add getOrCreate for SparkContext/SQLContext for Python Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue Type

[jira] [Assigned] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4: Assignee: Davies Liu (was: Apache Spark) > Add getOrCreate for SparkContext/SQLContext fo

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-14 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957806#comment-14957806 ] Alex Liu commented on SPARK-11067: -- Let's keep this ticket simply fix the exception. We

[jira] [Created] (SPARK-11115) IPv6 regression

2015-10-14 Thread Thomas Dudziak (JIRA)
Thomas Dudziak created SPARK-5: -- Summary: IPv6 regression Key: SPARK-5 URL: https://issues.apache.org/jira/browse/SPARK-5 Project: Spark Issue Type: Bug Components: Spa

[jira] [Created] (SPARK-11116) Initial API Draft

2015-10-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6: Summary: Initial API Draft Key: SPARK-6 URL: https://issues.apache.org/jira/browse/SPARK-6 Project: Spark Issue Type: Sub-task Re

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957926#comment-14957926 ] Michael Armbrust commented on SPARK-: - [~sandyr] did you look at the test case

[jira] [Commented] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957935#comment-14957935 ] Apache Spark commented on SPARK-10534: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10534: Assignee: (was: Apache Spark) > ORDER BY clause allows only columns that are present i

[jira] [Assigned] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10534: Assignee: Apache Spark > ORDER BY clause allows only columns that are present in SELECT st

[jira] [Commented] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957940#comment-14957940 ] Apache Spark commented on SPARK-11078: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11078: Assignee: Andrew Or (was: Apache Spark) > Ensure spilling tests are actually spilling > -

[jira] [Assigned] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11078: Assignee: Apache Spark (was: Andrew Or) > Ensure spilling tests are actually spilling > -

[jira] [Created] (SPARK-11117) PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows

2015-10-14 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-7: -- Summary: PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows Key: SPARK-7 URL: https://issues.apache.org/jira/browse/SPARK-7

[jira] [Assigned] (SPARK-11117) PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7: Assignee: Apache Spark (was: Cheng Lian) > PhysicalRDD.outputsUnsafeRows should return tr

[jira] [Assigned] (SPARK-11117) PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7: Assignee: Cheng Lian (was: Apache Spark) > PhysicalRDD.outputsUnsafeRows should return tr

[jira] [Commented] (SPARK-11117) PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957951#comment-14957951 ] Apache Spark commented on SPARK-7: -- User 'liancheng' has created a pull request

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957965#comment-14957965 ] Hyukjin Kwon commented on SPARK-11103: -- In this case, this should be fine because fi

[jira] [Resolved] (SPARK-10104) Consolidate different forms of table identifiers

2015-10-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10104. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8453 [https://github.c

[jira] [Assigned] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-0: Assignee: Apache Spark (was: Jakob Odersky) > Scala 2.11 build fails due to compiler erro

[jira] [Assigned] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-0: Assignee: Jakob Odersky (was: Apache Spark) > Scala 2.11 build fails due to compiler erro

[jira] [Commented] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957984#comment-14957984 ] Apache Spark commented on SPARK-0: -- User 'jodersky' has created a pull request f

[jira] [Resolved] (SPARK-11113) Remove DeveloperApi annotation from private classes

2015-10-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3. - Resolution: Fixed Fix Version/s: 1.6.0 > Remove DeveloperApi annotation from private class

[jira] [Resolved] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

2015-10-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10829. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8916 [https://github.c

[jira] [Created] (SPARK-11118) PredictionModel.transform is calling incorrect transformSchema method

2015-10-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-8: - Summary: PredictionModel.transform is calling incorrect transformSchema method Key: SPARK-8 URL: https://issues.apache.org/jira/browse/SPARK-8 Proje

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958022#comment-14958022 ] Sandy Ryza commented on SPARK-: --- bq. The problem with doing this using a registry (l

[jira] [Assigned] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-11051: - Assignee: Andrew Or > NullPointerException when action called on localCheckpointed RDD (that was

[jira] [Created] (SPARK-11119) cleanup unsafe array and map

2015-10-14 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9: --- Summary: cleanup unsafe array and map Key: SPARK-9 URL: https://issues.apache.org/jira/browse/SPARK-9 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11051: -- Assignee: Liang-Chi Hsieh (was: Andrew Or) > NullPointerException when action called on localCheckpoin

[jira] [Closed] (SPARK-11118) PredictionModel.transform is calling incorrect transformSchema method

2015-10-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-8. - Resolution: Invalid Oops, cancel that. The issue I was running into must be from elsewhe

[jira] [Assigned] (SPARK-10984) Simplify *MemoryManager class structure

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10984: Assignee: Apache Spark (was: Josh Rosen) > Simplify *MemoryManager class structure >

[jira] [Commented] (SPARK-10984) Simplify *MemoryManager class structure

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958044#comment-14958044 ] Apache Spark commented on SPARK-10984: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-10984) Simplify *MemoryManager class structure

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10984: Assignee: Josh Rosen (was: Apache Spark) > Simplify *MemoryManager class structure >

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2015-10-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958054#comment-14958054 ] Xiao Li commented on SPARK-10925: - I have not tried Spark 1.4, but inner joining 2 tables

[jira] [Comment Edited] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956988#comment-14956988 ] Hyukjin Kwon edited comment on SPARK-11103 at 10/15/15 12:13 AM: --

[jira] [Resolved] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

2015-10-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11017. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9038 [https://github.com/a

[jira] [Created] (SPARK-11120) maxNumExecutorFailures defaults to 3 under dynamic allocation

2015-10-14 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-11120: - Summary: maxNumExecutorFailures defaults to 3 under dynamic allocation Key: SPARK-11120 URL: https://issues.apache.org/jira/browse/SPARK-11120 Project: Spark

[jira] [Commented] (SPARK-11115) IPv6 regression

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958078#comment-14958078 ] Patrick Wendell commented on SPARK-5: - The title of this says "Regression" -

[jira] [Updated] (SPARK-11115) Host verification is not correct for IPv6

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5: Summary: Host verification is not correct for IPv6 (was: IPv6 regression) > Host verificat

[jira] [Comment Edited] (SPARK-11115) IPv6 regression

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958078#comment-14958078 ] Patrick Wendell edited comment on SPARK-5 at 10/15/15 12:38 AM: ---

[jira] [Updated] (SPARK-11111) Fast null-safe join

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1: Component/s: SQL > Fast null-safe join > --- > > Key: SPARK

[jira] [Updated] (SPARK-11092) Add source URLs to API documentation.

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-11092: Assignee: Jakob Odersky > Add source URLs to API documentation. > -

[jira] [Created] (SPARK-11121) Incorrect TaskLocation type

2015-10-14 Thread zhichao-li (JIRA)
zhichao-li created SPARK-11121: -- Summary: Incorrect TaskLocation type Key: SPARK-11121 URL: https://issues.apache.org/jira/browse/SPARK-11121 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-11081: Component/s: Build > Shade Jersey dependency to work around the compatibility issue with Je

[jira] [Assigned] (SPARK-11121) Incorrect TaskLocation type

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11121: Assignee: (was: Apache Spark) > Incorrect TaskLocation type >

[jira] [Commented] (SPARK-11121) Incorrect TaskLocation type

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958101#comment-14958101 ] Apache Spark commented on SPARK-11121: -- User 'zhichao-li' has created a pull request

[jira] [Assigned] (SPARK-11121) Incorrect TaskLocation type

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11121: Assignee: Apache Spark > Incorrect TaskLocation type > --- > >

[jira] [Updated] (SPARK-11056) Improve documentation on how to build Spark efficiently

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-11056: Component/s: Documentation > Improve documentation on how to build Spark efficiently >

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958103#comment-14958103 ] Marcelo Vanzin commented on SPARK-11098: So, while working on another patch in th

[jira] [Updated] (SPARK-11006) Rename NullColumnAccess as NullColumnAccessor

2015-10-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-11006: Component/s: SQL > Rename NullColumnAccess as NullColumnAccessor >

[jira] [Commented] (SPARK-10943) NullType Column cannot be written to Parquet

2015-10-14 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958109#comment-14958109 ] Dilip Biswal commented on SPARK-10943: -- Hi Jason, >From the parquet format page , h

[jira] [Created] (SPARK-11122) Fatal warnings in sbt are not displayed as such

2015-10-14 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-11122: - Summary: Fatal warnings in sbt are not displayed as such Key: SPARK-11122 URL: https://issues.apache.org/jira/browse/SPARK-11122 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11122) Fatal warnings in sbt are not displayed as such

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958147#comment-14958147 ] Apache Spark commented on SPARK-11122: -- User 'jodersky' has created a pull request f

[jira] [Assigned] (SPARK-11122) Fatal warnings in sbt are not displayed as such

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11122: Assignee: (was: Apache Spark) > Fatal warnings in sbt are not displayed as such >

[jira] [Assigned] (SPARK-11122) Fatal warnings in sbt are not displayed as such

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11122: Assignee: Apache Spark > Fatal warnings in sbt are not displayed as such > ---

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958161#comment-14958161 ] Marcelo Vanzin commented on SPARK-10873: BTW this could be a good opportunity to

[jira] [Resolved] (SPARK-11076) Decimal Support for Ceil/Floor

2015-10-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11076. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9086 [https://github.c

[jira] [Created] (SPARK-11123) Inprove HistoryServer with multithread to relay logs

2015-10-14 Thread Xie Tingwen (JIRA)
Xie Tingwen created SPARK-11123: --- Summary: Inprove HistoryServer with multithread to relay logs Key: SPARK-11123 URL: https://issues.apache.org/jira/browse/SPARK-11123 Project: Spark Issue Type

[jira] [Created] (SPARK-11124) JsonParser/Generator should be closed for resource reycle

2015-10-14 Thread Navis (JIRA)
Navis created SPARK-11124: - Summary: JsonParser/Generator should be closed for resource reycle Key: SPARK-11124 URL: https://issues.apache.org/jira/browse/SPARK-11124 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11124) JsonParser/Generator should be closed for resource recycle

2015-10-14 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-11124: -- Summary: JsonParser/Generator should be closed for resource recycle (was: JsonParser/Generator should be close

[jira] [Assigned] (SPARK-11124) JsonParser/Generator should be closed for resource recycle

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11124: Assignee: Apache Spark > JsonParser/Generator should be closed for resource recycle >

[jira] [Commented] (SPARK-11124) JsonParser/Generator should be closed for resource recycle

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958293#comment-14958293 ] Apache Spark commented on SPARK-11124: -- User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-11124) JsonParser/Generator should be closed for resource recycle

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11124: Assignee: (was: Apache Spark) > JsonParser/Generator should be closed for resource rec

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958309#comment-14958309 ] Marcelo Vanzin commented on SPARK-11098: Nevermind (too much). After thinking a l

[jira] [Commented] (SPARK-6724) Model import/export for FPGrowth

2015-10-14 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958374#comment-14958374 ] Meethu Mathew commented on SPARK-6724: -- I am not able to take this PR forward. Can so

[jira] [Commented] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

2015-10-14 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958386#comment-14958386 ] Jihong MA commented on SPARK-10953: --- [~mengxr] merged PR9038. below are the avg elapse

[jira] [Commented] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

2015-10-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958397#comment-14958397 ] Jeff Zhang commented on SPARK-11125: Will create pull request soon. > Unreadable ex

[jira] [Created] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

2015-10-14 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11125: -- Summary: Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set Key: SPARK-11125 URL: https://issues.apache.org/jira/br

[jira] [Assigned] (SPARK-11119) cleanup unsafe array and map

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9: Assignee: (was: Apache Spark) > cleanup unsafe array and map > ---

[jira] [Commented] (SPARK-11119) cleanup unsafe array and map

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958403#comment-14958403 ] Apache Spark commented on SPARK-9: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11119) cleanup unsafe array and map

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9: Assignee: Apache Spark > cleanup unsafe array and map > > >

[jira] [Created] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11126: Summary: A memory leak in SQLListener._stageIdToStageMetrics Key: SPARK-11126 URL: https://issues.apache.org/jira/browse/SPARK-11126 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11126: Assignee: Apache Spark > A memory leak in SQLListener._stageIdToStageMetrics > ---

[jira] [Assigned] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11126: Assignee: (was: Apache Spark) > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Commented] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958408#comment-14958408 ] Apache Spark commented on SPARK-11126: -- User 'zsxwing' has created a pull request fo

[jira] [Created] (SPARK-11127) Upgrade Kinesis Client Library to the latest stable version

2015-10-14 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11127: - Summary: Upgrade Kinesis Client Library to the latest stable version Key: SPARK-11127 URL: https://issues.apache.org/jira/browse/SPARK-11127 Project: Spark

<    1   2