[jira] [Assigned] (SPARK-9983) Local physical operators for query execution

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-9983: -- Assignee: Reynold Xin (was: Shixiong Zhu) > Local physical operators for query execution > ---

[jira] [Updated] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12636: Target Version/s: 2.0.0 Issue Type: Improvement (was: Bug) > Expose API on UnsafeRowReco

[jira] [Updated] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12636: Assignee: Nong Li > Expose API on UnsafeRowRecordReader to just run on files >

[jira] [Updated] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12644: Assignee: Nong Li > Vectorize/Batch decode parquet > -- > >

[jira] [Updated] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12644: Issue Type: Improvement (was: Bug) > Vectorize/Batch decode parquet >

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

2016-01-04 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082596#comment-15082596 ] Kazuaki Ishizaki commented on SPARK-3785: - [~rxin][~srowen] thank you for your dir

[jira] [Updated] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12644: Target Version/s: 2.0.0 > Vectorize/Batch decode parquet > -- > >

[jira] [Closed] (SPARK-12620) Proposal of GPU exploitation for Spark

2016-01-04 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki closed SPARK-12620. Move to SPARK-3875. > Proposal of GPU exploitation for Spark > ---

[jira] [Commented] (SPARK-12620) Proposal of GPU exploitation for Spark

2016-01-04 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082589#comment-15082589 ] Kazuaki Ishizaki commented on SPARK-12620: -- I will close this, and continue a di

[jira] [Created] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-04 Thread Nong Li (JIRA)
Nong Li created SPARK-12644: --- Summary: Vectorize/Batch decode parquet Key: SPARK-12644 URL: https://issues.apache.org/jira/browse/SPARK-12644 Project: Spark Issue Type: Bug Components: SQ

[jira] [Resolved] (SPARK-12568) Add BINARY to Encoders

2016-01-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12568. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10516 [htt

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082562#comment-15082562 ] Shixiong Zhu commented on SPARK-6166: - [~mridulm80] Thanks for your clarification. I s

[jira] [Assigned] (SPARK-12643) Set lib directory for antlr

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12643: Assignee: (was: Apache Spark) > Set lib directory for antlr >

[jira] [Commented] (SPARK-12643) Set lib directory for antlr

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082540#comment-15082540 ] Apache Spark commented on SPARK-12643: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-12643) Set lib directory for antlr

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12643: Assignee: Apache Spark > Set lib directory for antlr > --- > >

[jira] [Created] (SPARK-12643) Set lib directory for antlr

2016-01-04 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-12643: --- Summary: Set lib directory for antlr Key: SPARK-12643 URL: https://issues.apache.org/jira/browse/SPARK-12643 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12642) improve the hash expression to be decoupled from unsafe row

2016-01-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12642: --- Summary: improve the hash expression to be decoupled from unsafe row Key: SPARK-12642 URL: https://issues.apache.org/jira/browse/SPARK-12642 Project: Spark I

[jira] [Commented] (SPARK-12626) MLlib 2.0 Roadmap

2016-01-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082520#comment-15082520 ] yuhao yang commented on SPARK-12626: Great list. Maybe we can create an Umbrella jira

[jira] [Updated] (SPARK-12567) Add aes_{encrypt,decrypt} UDFs

2016-01-04 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang updated SPARK-12567: -- Affects Version/s: (was: 2.0.0) Target Version/s: 2.0.0 > Add aes_{encrypt,decrypt} UDFs > ---

[jira] [Commented] (SPARK-12566) GLM model family, link function support

2016-01-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082504#comment-15082504 ] yuhao yang commented on SPARK-12566: I'm interested. Just want to know if this is R s

[jira] [Resolved] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12625. - Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0 > SparkR is using d

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082491#comment-15082491 ] Reynold Xin commented on SPARK-11857: - cc [~dragos] / [~tnachen] do we still want to

[jira] [Updated] (SPARK-12641) Remove unused code related to Hadoop 0.23

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12641: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Remove unused code related t

[jira] [Commented] (SPARK-12641) Remove unused code related to Hadoop 0.23

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082487#comment-15082487 ] Apache Spark commented on SPARK-12641: -- User 'sarutak' has created a pull request fo

[jira] [Assigned] (SPARK-12641) Remove unused code related to Hadoop 0.23

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12641: Assignee: (was: Apache Spark) > Remove unused code related to Hadoop 0.23 > --

[jira] [Assigned] (SPARK-12641) Remove unused code related to Hadoop 0.23

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12641: Assignee: Apache Spark > Remove unused code related to Hadoop 0.23 > -

[jira] [Created] (SPARK-12641) Remove unused code related to Hadoop 0.23

2016-01-04 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-12641: -- Summary: Remove unused code related to Hadoop 0.23 Key: SPARK-12641 URL: https://issues.apache.org/jira/browse/SPARK-12641 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-12640) Add benchmarks to measure the speed ups of UnsafeRowParquetReaderReader.

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12640: Assignee: Apache Spark > Add benchmarks to measure the speed ups of UnsafeRowParquetReader

[jira] [Assigned] (SPARK-12640) Add benchmarks to measure the speed ups of UnsafeRowParquetReaderReader.

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12640: Assignee: (was: Apache Spark) > Add benchmarks to measure the speed ups of UnsafeRowPa

[jira] [Commented] (SPARK-12640) Add benchmarks to measure the speed ups of UnsafeRowParquetReaderReader.

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082451#comment-15082451 ] Apache Spark commented on SPARK-12640: -- User 'nongli' has created a pull request for

[jira] [Commented] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082436#comment-15082436 ] Apache Spark commented on SPARK-12480: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-12640) Add benchmarks to measure the speed ups of UnsafeRowParquetReaderReader.

2016-01-04 Thread Nong Li (JIRA)
Nong Li created SPARK-12640: --- Summary: Add benchmarks to measure the speed ups of UnsafeRowParquetReaderReader. Key: SPARK-12640 URL: https://issues.apache.org/jira/browse/SPARK-12640 Project: Spark

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

2016-01-04 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082384#comment-15082384 ] Ajesh Kumar commented on SPARK-12622: - I think we should throw exception "File file:/

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2016-01-04 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082357#comment-15082357 ] Russell Alexander Spitzer commented on SPARK-11661: --- Yeah sure, np http

[jira] [Updated] (SPARK-12639) Improve Explain for DataSources with Handled Predicate Pushdowns

2016-01-04 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Alexander Spitzer updated SPARK-12639: -- Description: SPARK-11661 improves handling of predicate pushdowns but h

[jira] [Created] (SPARK-12639) Improve Explain for DataSources with Handled Predicate Pushdowns

2016-01-04 Thread Russell Alexander Spitzer (JIRA)
Russell Alexander Spitzer created SPARK-12639: - Summary: Improve Explain for DataSources with Handled Predicate Pushdowns Key: SPARK-12639 URL: https://issues.apache.org/jira/browse/SPARK-12639

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-01-04 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082354#comment-15082354 ] Mridul Muralidharan commented on SPARK-6166: /CC [~tgraves] who might be inter

[jira] [Assigned] (SPARK-12638) Parameter explaination not very accurate for rdd function "aggregate"

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12638: Assignee: Apache Spark > Parameter explaination not very accurate for rdd function "aggreg

[jira] [Commented] (SPARK-12638) Parameter explaination not very accurate for rdd function "aggregate"

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082310#comment-15082310 ] Apache Spark commented on SPARK-12638: -- User 'Wenpei' has created a pull request for

[jira] [Assigned] (SPARK-12638) Parameter explaination not very accurate for rdd function "aggregate"

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12638: Assignee: (was: Apache Spark) > Parameter explaination not very accurate for rdd funct

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082309#comment-15082309 ] Shivaram Venkataraman commented on SPARK-12609: --- Yeah that would be good bu

[jira] [Created] (SPARK-12638) Parameter explaination not very accurate for rdd function "aggregate"

2016-01-04 Thread Tommy Yu (JIRA)
Tommy Yu created SPARK-12638: Summary: Parameter explaination not very accurate for rdd function "aggregate" Key: SPARK-12638 URL: https://issues.apache.org/jira/browse/SPARK-12638 Project: Spark

[jira] [Resolved] (SPARK-12480) add Hash expression that can calculate hash value for a group of expressions

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12480. - Resolution: Fixed Assignee: Wenchen Fan (was: Apache Spark) Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-12600) Remove deprecated methods in SQL / DataFrames

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082263#comment-15082263 ] Apache Spark commented on SPARK-12600: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

2016-01-04 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082237#comment-15082237 ] yucai commented on SPARK-12196: --- Hi wei, I think maybe both item could be implemented in se

[jira] [Comment Edited] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

2016-01-04 Thread Kyle Sutton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068572#comment-15068572 ] Kyle Sutton edited comment on SPARK-6476 at 1/5/16 2:09 AM: Th

[jira] [Resolved] (SPARK-12600) Remove deprecated methods in SQL / DataFrames

2016-01-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12600. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10559 [htt

[jira] [Commented] (SPARK-12637) Print stage info of finished stages properly

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082212#comment-15082212 ] Apache Spark commented on SPARK-12637: -- User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-12637) Print stage info of finished stages properly

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12637: Assignee: (was: Apache Spark) > Print stage info of finished stages properly > ---

[jira] [Assigned] (SPARK-12637) Print stage info of finished stages properly

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12637: Assignee: Apache Spark > Print stage info of finished stages properly > --

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-01-04 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082191#comment-15082191 ] Mridul Muralidharan commented on SPARK-6166: The resource usage incurred per

[jira] [Commented] (SPARK-12574) Move parser from hive module to catalyst (or sql-core) module

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082190#comment-15082190 ] Apache Spark commented on SPARK-12574: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-12574) Move parser from hive module to catalyst (or sql-core) module

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12574: Assignee: Apache Spark > Move parser from hive module to catalyst (or sql-core) module > -

[jira] [Assigned] (SPARK-12573) Add acknowledge that the parser was initially from Hive

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12573: Assignee: Apache Spark (was: Herman van Hovell) > Add acknowledge that the parser was ini

[jira] [Commented] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082188#comment-15082188 ] Apache Spark commented on SPARK-12625: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12625: Assignee: (was: Apache Spark) > SparkR is using deprecated APIs >

[jira] [Assigned] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12625: Assignee: Apache Spark > SparkR is using deprecated APIs > ---

[jira] [Assigned] (SPARK-12573) Add acknowledge that the parser was initially from Hive

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12573: Assignee: Herman van Hovell (was: Apache Spark) > Add acknowledge that the parser was ini

[jira] [Assigned] (SPARK-12574) Move parser from hive module to catalyst (or sql-core) module

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12574: Assignee: (was: Apache Spark) > Move parser from hive module to catalyst (or sql-core)

[jira] [Commented] (SPARK-12573) Add acknowledge that the parser was initially from Hive

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082189#comment-15082189 ] Apache Spark commented on SPARK-12573: -- User 'hvanhovell' has created a pull request

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082177#comment-15082177 ] Apache Spark commented on SPARK-3873: - User 'vanzin' has created a pull request for th

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

2016-01-04 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082175#comment-15082175 ] Jayadevan M commented on SPARK-12622: - [~abridgett]@Adrian Bridgett do you think is

[jira] [Resolved] (SPARK-12293) Support UnsafeRow in LocalTableScan

2016-01-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12293. Resolution: Fixed Assignee: Davies Liu (was: Liang-Chi Hsieh) Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12292) Support UnsafeRow in Generate

2016-01-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12292. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > Support UnsafeRow in

[jira] [Resolved] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2016-01-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12289. Resolution: Fixed Assignee: Davies Liu (was: Apache Spark) Fix Version/s: 2.0.0 >

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082164#comment-15082164 ] Shixiong Zhu commented on SPARK-6166: - [~mridulm80] AFAIK, Netty is able to support th

[jira] [Commented] (SPARK-8171) Support Javascript-based infinite scrolling in Spark log viewers

2016-01-04 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082162#comment-15082162 ] Alex Bozarth commented on SPARK-8171: - I'm looking into some possible solutions for th

[jira] [Created] (SPARK-12637) Print stage info of finished stages properly

2016-01-04 Thread Navis (JIRA)
Navis created SPARK-12637: - Summary: Print stage info of finished stages properly Key: SPARK-12637 URL: https://issues.apache.org/jira/browse/SPARK-12637 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12450) Un-persist broadcasted variables in KMeans

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12450: Assignee: (was: Apache Spark) > Un-persist broadcasted variables in KMeans > -

[jira] [Assigned] (SPARK-12450) Un-persist broadcasted variables in KMeans

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12450: Assignee: Apache Spark > Un-persist broadcasted variables in KMeans >

[jira] [Commented] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

2016-01-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082085#comment-15082085 ] Saisai Shao commented on SPARK-12516: - Thanks a lot [~vanzin] for your reply. Looks l

[jira] [Commented] (SPARK-12431) add local checkpointing to GraphX

2016-01-04 Thread Edward Seidl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082081#comment-15082081 ] Edward Seidl commented on SPARK-12431: -- here's a patch demonstrating what I'm on abo

[jira] [Resolved] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12509. - Resolution: Fixed Assignee: Narine Kokhlikyan Fix Version/s: 2.0.0 > Fix error me

[jira] [Assigned] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12636: Assignee: Apache Spark > Expose API on UnsafeRowRecordReader to just run on files > --

[jira] [Commented] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082036#comment-15082036 ] Apache Spark commented on SPARK-12636: -- User 'nongli' has created a pull request for

[jira] [Assigned] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12636: Assignee: (was: Apache Spark) > Expose API on UnsafeRowRecordReader to just run on fil

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2016-01-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12363: -- Shepherd: Joseph K. Bradley > PowerIterationClustering test case failed if we deprecate

[jira] [Updated] (SPARK-12589) result row size is wrong in UnsafeRowParquetRecordReader

2016-01-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12589: - Assignee: Nong Li > result row size is wrong in UnsafeRowParquetRecordReader > --

[jira] [Resolved] (SPARK-12589) result row size is wrong in UnsafeRowParquetRecordReader

2016-01-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12589. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request 1

[jira] [Created] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

2016-01-04 Thread Nong Li (JIRA)
Nong Li created SPARK-12636: --- Summary: Expose API on UnsafeRowRecordReader to just run on files Key: SPARK-12636 URL: https://issues.apache.org/jira/browse/SPARK-12636 Project: Spark Issue Type: Bu

[jira] [Comment Edited] (SPARK-12624) When schema is specified, we should treat undeclared fields as null (in Python)

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081935#comment-15081935 ] Reynold Xin edited comment on SPARK-12624 at 1/4/16 10:43 PM: -

[jira] [Commented] (SPARK-12624) When schema is specified, we should treat undeclared fields as null (in Python)

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081935#comment-15081935 ] Reynold Xin commented on SPARK-12624: - Maybe do it for Row only for now? > When sch

[jira] [Created] (SPARK-12635) More efficient (column batch) serialization for Python/R

2016-01-04 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12635: --- Summary: More efficient (column batch) serialization for Python/R Key: SPARK-12635 URL: https://issues.apache.org/jira/browse/SPARK-12635 Project: Spark Issue

[jira] [Commented] (SPARK-12624) When schema is specified, we should treat undeclared fields as null (in Python)

2016-01-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081932#comment-15081932 ] Davies Liu commented on SPARK-12624: [~rxin] The RDD or list could be just tuple, how

[jira] [Resolved] (SPARK-12541) Support rollup/cube in SQL query

2016-01-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12541. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10522 [https://github.

[jira] [Commented] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081905#comment-15081905 ] Reynold Xin commented on SPARK-12625: - [~felixcheung] that should be it. Thanks! >

[jira] [Commented] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081903#comment-15081903 ] Felix Cheung commented on SPARK-12625: -- Is this the complete set of API to be remove

[jira] [Commented] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

2016-01-04 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081902#comment-15081902 ] Bryan Cutler commented on SPARK-12631: -- I'll start on this one, so if anyone else wa

[jira] [Updated] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

2016-01-04 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-12633: - Remaining Estimate: 1h Original Estimate: 1h > Make Parameter Descriptions Consistent for Py

[jira] [Updated] (SPARK-12634) Make Parameter Descriptions Consistent for PySpark MLlib Tree

2016-01-04 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-12634: - Remaining Estimate: 1h Original Estimate: 1h > Make Parameter Descriptions Consistent for Py

[jira] [Updated] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

2016-01-04 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-12631: - Remaining Estimate: 1h Original Estimate: 1h > Make Parameter Descriptions Consistent for Py

[jira] [Updated] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

2016-01-04 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-12632: - Remaining Estimate: 1h Original Estimate: 1h > Make Parameter Descriptions Consistent for Py

[jira] [Created] (SPARK-12634) Make Parameter Descriptions Consistent for PySpark MLlib Tree

2016-01-04 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-12634: Summary: Make Parameter Descriptions Consistent for PySpark MLlib Tree Key: SPARK-12634 URL: https://issues.apache.org/jira/browse/SPARK-12634 Project: Spark

[jira] [Created] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

2016-01-04 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-12633: Summary: Make Parameter Descriptions Consistent for PySpark MLlib Regression Key: SPARK-12633 URL: https://issues.apache.org/jira/browse/SPARK-12633 Project: Spark

[jira] [Created] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

2016-01-04 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-12632: Summary: Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation Key: SPARK-12632 URL: https://issues.apache.org/jira/browse/SPARK-12632 Proje

[jira] [Created] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

2016-01-04 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-12631: Summary: Make Parameter Descriptions Consistent for PySpark MLlib Clustering Key: SPARK-12631 URL: https://issues.apache.org/jira/browse/SPARK-12631 Project: Spark

[jira] [Created] (SPARK-12630) Make Parameter Descriptions Consistent for PySpark MLlib Classification

2016-01-04 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-12630: Summary: Make Parameter Descriptions Consistent for PySpark MLlib Classification Key: SPARK-12630 URL: https://issues.apache.org/jira/browse/SPARK-12630 Project: Spar

[jira] [Updated] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

2016-01-04 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12629: -- Description: There are several issues with the DataFrame's saveAsTable method in SparkR

[jira] [Updated] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

2016-01-04 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12629: -- Description: There are several issues with the DataFrame's saveAsTable method in SparkR

[jira] [Assigned] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

2016-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12629: Assignee: (was: Apache Spark) > SparkR: DataFrame's saveAsTable method has issues with

  1   2   3   >