[jira] [Resolved] (SPARK-14879) Move CreateMetastoreDataSource and CreateMetastoreDataSourceAsSelect to sql/core

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14879. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12645

[jira] [Resolved] (SPARK-14833) Refactor StreamTests to test for source fault-tolerance correctly.

2016-04-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14833. -- Resolution: Fixed Fix Version/s: 2.0.0 > Refactor StreamTests to test for source

[jira] [Created] (SPARK-14882) Programming Guide Improvements

2016-04-23 Thread Ben McCann (JIRA)
Ben McCann created SPARK-14882: -- Summary: Programming Guide Improvements Key: SPARK-14882 URL: https://issues.apache.org/jira/browse/SPARK-14882 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-14838) Implement statistics in SerializeFromObject to avoid failure when estimating sizeInBytes for ObjectType

2016-04-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14838: --- Assignee: Liang-Chi Hsieh > Implement statistics in SerializeFromObject to avoid failure when

[jira] [Resolved] (SPARK-14838) Implement statistics in SerializeFromObject to avoid failure when estimating sizeInBytes for ObjectType

2016-04-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14838. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12599

[jira] [Updated] (SPARK-14874) Remove the obsolete Batch representation

2016-04-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-14874: -- Summary: Remove the obsolete Batch representation (was: Cleanup the useless Batch class) > Remove

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Description: Since our parser defined based on antlr 4 can parse data type. We can remove

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Description: Since our parser defined based on antlr 4 can parse data type (see CatalystSqlParser), we

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Priority: Major (was: Blocker) > Remove org.apache.spark.sql.catalyst.parser.DataTypeParser >

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Issue Type: Sub-task (was: Bug) Parent: SPARK-14776 > Remove

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Description: Since our parser defined based on antlr 4 can parse data type. We can remove

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Summary: Remove org.apache.spark.sql.catalyst.parser.DataTypeParser (was: DDLParser should accept

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Description: Since our parser defined based on antlr 4 can parse data type. We will not need to have

[jira] [Updated] (SPARK-14591) Remove org.apache.spark.sql.catalyst.parser.DataTypeParser

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Description: Since our parser defined based on antlr 4 can parse data type. We will not need to hav e

[jira] [Updated] (SPARK-14591) DDLParser should accept decimal(precision)

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14591: - Priority: Blocker (was: Major) > DDLParser should accept decimal(precision) >

[jira] [Commented] (SPARK-14591) DDLParser should accept decimal(precision)

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255430#comment-15255430 ] Yin Huai commented on SPARK-14591: -- [~hvanhovell] Where do we define those reserved keywords? >

[jira] [Commented] (SPARK-4298) The spark-submit cannot read Main-Class from Manifest.

2016-04-23 Thread Jimit Kamlesh Raithatha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255429#comment-15255429 ] Jimit Kamlesh Raithatha commented on SPARK-4298: Brennon / Friends, Any chance this issue

[jira] [Assigned] (SPARK-14881) pyspark and sparkR shell default log level should match spark-shell/Scala

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14881: Assignee: Apache Spark > pyspark and sparkR shell default log level should match

[jira] [Commented] (SPARK-14881) pyspark and sparkR shell default log level should match spark-shell/Scala

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255427#comment-15255427 ] Apache Spark commented on SPARK-14881: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-14881) pyspark and sparkR shell default log level should match spark-shell/Scala

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14881: Assignee: (was: Apache Spark) > pyspark and sparkR shell default log level should

[jira] [Updated] (SPARK-14881) pyspark and sparkR shell default log level should match spark-shell/Scala

2016-04-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-14881: - Summary: pyspark and sparkR shell default log level should match spark-shell/Scala (was:

[jira] [Updated] (SPARK-14881) PySpark and sparkR shell default log level should match spark-shell/Scala

2016-04-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-14881: - Description: Scala spark-shell defaults to log level WARN. pyspark and sparkR should match that

[jira] [Created] (SPARK-14881) PySpark and sparkR shell default log level should match spark-shell/Scala

2016-04-23 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-14881: Summary: PySpark and sparkR shell default log level should match spark-shell/Scala Key: SPARK-14881 URL: https://issues.apache.org/jira/browse/SPARK-14881 Project:

[jira] [Commented] (SPARK-13831) TPC-DS Query 35 fails with the following compile error

2016-04-23 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255426#comment-15255426 ] Roy Cecil commented on SPARK-13831: --- @Herman, thanks. I am validating the fix. > TPC-DS Query 35 fails

[jira] [Commented] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255424#comment-15255424 ] Apache Spark commented on SPARK-12148: -- User 'felixcheung' has created a pull request for this

[jira] [Updated] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-04-23 Thread Ahmed Mahran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Mahran updated SPARK-14880: - Description: The current implementation of (Stochastic) Gradient Descent performs one

[jira] [Created] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-04-23 Thread Ahmed Mahran (JIRA)
Ahmed Mahran created SPARK-14880: Summary: Parallel Gradient Descent with less map-reduce shuffle overhead Key: SPARK-14880 URL: https://issues.apache.org/jira/browse/SPARK-14880 Project: Spark

[jira] [Assigned] (SPARK-14878) Support Trim characters in the string trim function

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14878: Assignee: Apache Spark > Support Trim characters in the string trim function >

[jira] [Commented] (SPARK-14878) Support Trim characters in the string trim function

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255420#comment-15255420 ] Apache Spark commented on SPARK-14878: -- User 'kevinyu98' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14878) Support Trim characters in the string trim function

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14878: Assignee: (was: Apache Spark) > Support Trim characters in the string trim function >

[jira] [Resolved] (SPARK-14877) Remove HiveMetastoreTypes class

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14877. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12644

[jira] [Assigned] (SPARK-14879) Move CreateMetastoreDataSource and CreateMetastoreDataSourceAsSelect to sql/core

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14879: Assignee: Yin Huai (was: Apache Spark) > Move CreateMetastoreDataSource and

[jira] [Assigned] (SPARK-14879) Move CreateMetastoreDataSource and CreateMetastoreDataSourceAsSelect to sql/core

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14879: Assignee: Apache Spark (was: Yin Huai) > Move CreateMetastoreDataSource and

[jira] [Commented] (SPARK-14879) Move CreateMetastoreDataSource and CreateMetastoreDataSourceAsSelect to sql/core

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255403#comment-15255403 ] Apache Spark commented on SPARK-14879: -- User 'yhuai' has created a pull request for this issue:

[jira] [Created] (SPARK-14879) Move CreateMetastoreDataSource and CreateMetastoreDataSourceAsSelect to sql/core

2016-04-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-14879: Summary: Move CreateMetastoreDataSource and CreateMetastoreDataSourceAsSelect to sql/core Key: SPARK-14879 URL: https://issues.apache.org/jira/browse/SPARK-14879 Project:

[jira] [Created] (SPARK-14878) Support Trim characters in the string trim function

2016-04-23 Thread kevin yu (JIRA)
kevin yu created SPARK-14878: Summary: Support Trim characters in the string trim function Key: SPARK-14878 URL: https://issues.apache.org/jira/browse/SPARK-14878 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14877) Remove HiveMetastoreTypes class

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14877: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveMetastoreTypes class >

[jira] [Commented] (SPARK-14877) Remove HiveMetastoreTypes class

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255388#comment-15255388 ] Apache Spark commented on SPARK-14877: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14877) Remove HiveMetastoreTypes class

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14877: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveMetastoreTypes class >

[jira] [Created] (SPARK-14877) Remove HiveMetastoreTypes class

2016-04-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14877: --- Summary: Remove HiveMetastoreTypes class Key: SPARK-14877 URL: https://issues.apache.org/jira/browse/SPARK-14877 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-14876) SparkSession should be case insensitive by default

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14876: Assignee: Apache Spark (was: Reynold Xin) > SparkSession should be case insensitive by

[jira] [Commented] (SPARK-14876) SparkSession should be case insensitive by default

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255382#comment-15255382 ] Apache Spark commented on SPARK-14876: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14876) SparkSession should be case insensitive by default

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14876: Assignee: Reynold Xin (was: Apache Spark) > SparkSession should be case insensitive by

[jira] [Created] (SPARK-14876) SparkSession should be case insensitive by default

2016-04-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14876: --- Summary: SparkSession should be case insensitive by default Key: SPARK-14876 URL: https://issues.apache.org/jira/browse/SPARK-14876 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-14846) Driver process fails to terminate when graceful shutdown is used

2016-04-23 Thread Mattias Aspholm (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255375#comment-15255375 ] Mattias Aspholm edited comment on SPARK-14846 at 4/23/16 8:23 PM: --

[jira] [Resolved] (SPARK-14865) When creating a view, we should verify both the input SQL and the generated SQL

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14865. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12633

[jira] [Commented] (SPARK-14846) Driver process fails to terminate when graceful shutdown is used

2016-04-23 Thread Mattias Aspholm (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255375#comment-15255375 ] Mattias Aspholm commented on SPARK-14846: - Yes, you're right of course. Sorry about that. I'm

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255363#comment-15255363 ] Reynold Xin commented on SPARK-14654: - I see. The merge function isn't supposed to be called by the

[jira] [Resolved] (SPARK-14869) Don't mask exceptions in ResolveRelations

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14869. - Resolution: Fixed Fix Version/s: 2.0.0 > Don't mask exceptions in ResolveRelations >

[jira] [Resolved] (SPARK-14872) Restructure commands.scala

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14872. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12636

[jira] [Resolved] (SPARK-14871) Disable StatsReportListener to declutter output

2016-04-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14871. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12635

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255359#comment-15255359 ] holdenk commented on SPARK-14654: - So ACC isn't the internal buffer type, rather its the type of the

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255357#comment-15255357 ] Reynold Xin commented on SPARK-14654: - No it can't be private spark because it needs to be

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255356#comment-15255356 ] holdenk commented on SPARK-14654: - Since we're talking about average accumulators anyways - what would

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255355#comment-15255355 ] holdenk commented on SPARK-14654: - If were only going to do Long and Double for the easy creation on the

[jira] [Updated] (SPARK-14867) Remove `--force` option in `build/mvn`.

2016-04-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14867: -- Priority: Major (was: Trivial) Description: Currently, `build/mvn` provides a

[jira] [Assigned] (SPARK-14729) Implement an existing cluster manager with New ExternalClusterManager interface

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14729: Assignee: Apache Spark > Implement an existing cluster manager with New

[jira] [Assigned] (SPARK-14729) Implement an existing cluster manager with New ExternalClusterManager interface

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14729: Assignee: (was: Apache Spark) > Implement an existing cluster manager with New

[jira] [Commented] (SPARK-14729) Implement an existing cluster manager with New ExternalClusterManager interface

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255340#comment-15255340 ] Apache Spark commented on SPARK-14729: -- User 'hbhanawat' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-14694) Thrift Server + Hive Metastore + Kerberos doesn't work

2016-04-23 Thread zhangguancheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255036#comment-15255036 ] zhangguancheng edited comment on SPARK-14694 at 4/23/16 6:50 PM: - Content

[jira] [Updated] (SPARK-14594) Improve error messages for RDD API

2016-04-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-14594: -- Assignee: Felix Cheung > Improve error messages for RDD API >

[jira] [Resolved] (SPARK-14594) Improve error messages for RDD API

2016-04-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14594. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Comment Edited] (SPARK-14654) New accumulator API

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255312#comment-15255312 ] Reynold Xin edited comment on SPARK-14654 at 4/23/16 6:01 PM: -- I don't get

[jira] [Comment Edited] (SPARK-14654) New accumulator API

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255312#comment-15255312 ] Reynold Xin edited comment on SPARK-14654 at 4/23/16 6:02 PM: -- I don't get

[jira] [Comment Edited] (SPARK-14654) New accumulator API

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255312#comment-15255312 ] Reynold Xin edited comment on SPARK-14654 at 4/23/16 5:54 PM: -- I don't get

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255312#comment-15255312 ] Reynold Xin commented on SPARK-14654: - I don't get what you are trying to accomplish. It seems like

[jira] [Resolved] (SPARK-14873) Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14873. - Resolution: Fixed Fix Version/s: 2.0.0 > Java sampleByKey methods take ju.Map but with

[jira] [Commented] (SPARK-14654) New accumulator API

2016-04-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255291#comment-15255291 ] holdenk commented on SPARK-14654: - You wouldn't know if you want a counter or overage, but the same

[jira] [Assigned] (SPARK-14850) VectorUDT/MatrixUDT should take primitive arrays without boxing

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14850: Assignee: Apache Spark > VectorUDT/MatrixUDT should take primitive arrays without boxing

[jira] [Commented] (SPARK-14850) VectorUDT/MatrixUDT should take primitive arrays without boxing

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255282#comment-15255282 ] Apache Spark commented on SPARK-14850: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14850) VectorUDT/MatrixUDT should take primitive arrays without boxing

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14850: Assignee: (was: Apache Spark) > VectorUDT/MatrixUDT should take primitive arrays

[jira] [Commented] (SPARK-14864) [MLLIB] Implement Doc2Vec

2016-04-23 Thread Peter Mountanos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255275#comment-15255275 ] Peter Mountanos commented on SPARK-14864: - [~prudenko] [~cqnguyen] I noticed previous discussion

[jira] [Commented] (SPARK-14856) Returning batch unexpected from wide table

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255261#comment-15255261 ] Apache Spark commented on SPARK-14856: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-14875) OutputWriterFactory.newInstance shouldn't be private[sql]

2016-04-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255249#comment-15255249 ] Cheng Lian commented on SPARK-14875: Checked with [~cloud_fan], it was accidentally made private

[jira] [Commented] (SPARK-14875) OutputWriterFactory.newInstance shouldn't be private[sql]

2016-04-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255248#comment-15255248 ] Cheng Lian commented on SPARK-14875: [~marmbrus] Is there any reason why we made it private in Spark

[jira] [Created] (SPARK-14875) OutputWriterFactory.newInstance shouldn't be private[sql]

2016-04-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14875: -- Summary: OutputWriterFactory.newInstance shouldn't be private[sql] Key: SPARK-14875 URL: https://issues.apache.org/jira/browse/SPARK-14875 Project: Spark Issue

[jira] [Updated] (SPARK-14874) Cleanup the useless Batch class

2016-04-23 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-14874: -- Summary: Cleanup the useless Batch class (was: Remove the useless Batch class) > Cleanup the useless

[jira] [Assigned] (SPARK-14874) Remove the useless Batch class

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14874: Assignee: Apache Spark > Remove the useless Batch class > --

[jira] [Commented] (SPARK-14874) Remove the useless Batch class

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255236#comment-15255236 ] Apache Spark commented on SPARK-14874: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14874) Remove the useless Batch class

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14874: Assignee: (was: Apache Spark) > Remove the useless Batch class >

[jira] [Created] (SPARK-14874) Remove the useless Batch class

2016-04-23 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14874: - Summary: Remove the useless Batch class Key: SPARK-14874 URL: https://issues.apache.org/jira/browse/SPARK-14874 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-14846) Driver process fails to terminate when graceful shutdown is used

2016-04-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255223#comment-15255223 ] Sean Owen commented on SPARK-14846: --- No, that's not what methods like awaitNanos do in the JDK classes.

[jira] [Assigned] (SPARK-14873) Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14873: Assignee: Sean Owen (was: Apache Spark) > Java sampleByKey methods take ju.Map but with

[jira] [Commented] (SPARK-14873) Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255221#comment-15255221 ] Apache Spark commented on SPARK-14873: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14873) Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14873: Assignee: Apache Spark (was: Sean Owen) > Java sampleByKey methods take ju.Map but with

[jira] [Updated] (SPARK-14873) Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object

2016-04-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14873: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11806 > Java sampleByKey methods take ju.Map

[jira] [Created] (SPARK-14873) Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object

2016-04-23 Thread Sean Owen (JIRA)
Sean Owen created SPARK-14873: - Summary: Java sampleByKey methods take ju.Map but with Scala Double values; results in type Object Key: SPARK-14873 URL: https://issues.apache.org/jira/browse/SPARK-14873

[jira] [Assigned] (SPARK-14872) Restructure commands.scala

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14872: Assignee: Reynold Xin (was: Apache Spark) > Restructure commands.scala >

[jira] [Commented] (SPARK-14872) Restructure commands.scala

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255194#comment-15255194 ] Apache Spark commented on SPARK-14872: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14872) Restructure commands.scala

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14872: Assignee: Apache Spark (was: Reynold Xin) > Restructure commands.scala >

[jira] [Created] (SPARK-14872) Restructure commands.scala

2016-04-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14872: --- Summary: Restructure commands.scala Key: SPARK-14872 URL: https://issues.apache.org/jira/browse/SPARK-14872 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-14871) Disable StatsReportListener to declutter output

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14871: Assignee: Apache Spark (was: Reynold Xin) > Disable StatsReportListener to declutter

[jira] [Assigned] (SPARK-14871) Disable StatsReportListener to declutter output

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14871: Assignee: Reynold Xin (was: Apache Spark) > Disable StatsReportListener to declutter

[jira] [Commented] (SPARK-14871) Disable StatsReportListener to declutter output

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255187#comment-15255187 ] Apache Spark commented on SPARK-14871: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-14871) Disable StatsReportListener to declutter output

2016-04-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14871: --- Summary: Disable StatsReportListener to declutter output Key: SPARK-14871 URL: https://issues.apache.org/jira/browse/SPARK-14871 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14594) Improve error messages for RDD API

2016-04-23 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255186#comment-15255186 ] Marco Gaido commented on SPARK-14594: - Yes, I do believe that this is what is happening > Improve

[jira] [Resolved] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2016-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12148. - Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0 > SparkR: rename

[jira] [Created] (SPARK-14870) NPE in generate aggregate

2016-04-23 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14870: -- Summary: NPE in generate aggregate Key: SPARK-14870 URL: https://issues.apache.org/jira/browse/SPARK-14870 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-14869) Don't mask exceptions in ResolveRelations

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14869: Assignee: Apache Spark (was: Reynold Xin) > Don't mask exceptions in ResolveRelations >

[jira] [Assigned] (SPARK-14869) Don't mask exceptions in ResolveRelations

2016-04-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14869: Assignee: Reynold Xin (was: Apache Spark) > Don't mask exceptions in ResolveRelations >

  1   2   >