[jira] [Assigned] (SPARK-12506) Push down WHERE clause arithmetic operator to JDBC layer

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12506: Assignee: Apache Spark > Push down WHERE clause arithmetic operator to JDBC layer > --

[jira] [Commented] (SPARK-5948) Support writing to partitioned table for the Parquet data source

2015-12-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073596#comment-15073596 ] Cheng Lian commented on SPARK-5948: --- It's the HadoopFsRelation based Parquet data source

[jira] [Comment Edited] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073573#comment-15073573 ] yucai edited comment on SPARK-12196 at 12/29/15 7:31 AM: - Hello W

[jira] [Updated] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is s

[jira] [Updated] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is s

[jira] [Updated] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

2015-12-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12526: -- Assignee: Sen Fang > `ifelse`, `when`, `otherwise` unable to take Column as val

[jira] [Assigned] (SPARK-12548) Add more exceptions to Guava relocation

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12548: Assignee: Apache Spark > Add more exceptions to Guava relocation > ---

[jira] [Resolved] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

2015-12-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12526. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12548) Add more exceptions to Guava relocation

2015-12-28 Thread microhello (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] microhello updated SPARK-12548: --- Description: When I use [facebook/swift|https://github.com/facebook/swift] with spark 1.5.2, throw

[jira] [Updated] (SPARK-12548) Add more exceptions to Guava relocation

2015-12-28 Thread microhello (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] microhello updated SPARK-12548: --- Description: When I use [facebook/swift|https://github.com/facebook/swift] with spark 1.5.2, throw

[jira] [Updated] (SPARK-12548) Add more exceptions to Guava relocation

2015-12-28 Thread microhello (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] microhello updated SPARK-12548: --- Description: When I use [facebook/swift|https://github.com/facebook/swift] with spark 1.5.2, throw

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073573#comment-15073573 ] yucai commented on SPARK-12196: --- Hello Wei, nice to know you :). Some explanation about our

[jira] [Created] (SPARK-12548) Add more exceptions to Guava relocation

2015-12-28 Thread microhello (JIRA)
microhello created SPARK-12548: -- Summary: Add more exceptions to Guava relocation Key: SPARK-12548 URL: https://issues.apache.org/jira/browse/SPARK-12548 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5948) Support writing to partitioned table for the Parquet data source

2015-12-28 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073551#comment-15073551 ] Yash Datta commented on SPARK-5948: --- Can you please mention which change resolved this o

[jira] [Assigned] (SPARK-12355) Implement unhandledFilter interface for Parquet

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12355: Assignee: Apache Spark > Implement unhandledFilter interface for Parquet > ---

[jira] [Assigned] (SPARK-12355) Implement unhandledFilter interface for Parquet

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12355: Assignee: (was: Apache Spark) > Implement unhandledFilter interface for Parquet >

[jira] [Assigned] (SPARK-12355) Implement unhandledFilter interface for Parquet

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12355: Assignee: (was: Apache Spark) > Implement unhandledFilter interface for Parquet >

[jira] [Assigned] (SPARK-12355) Implement unhandledFilter interface for Parquet

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12355: Assignee: Apache Spark > Implement unhandledFilter interface for Parquet > ---

[jira] [Updated] (SPARK-12542) Support intersect/except in SQL

2015-12-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12542: Component/s: SQL > Support intersect/except in SQL > --- > > Ke

[jira] [Updated] (SPARK-12545) Support exists condition

2015-12-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12545: Component/s: SQL > Support exists condition > > > Key: SPARK-12545

[jira] [Updated] (SPARK-12544) Support window functions in SQLContext

2015-12-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12544: Component/s: SQL > Support window functions in SQLContext > -- > >

[jira] [Updated] (SPARK-12541) Support rollup/cube/povit in SQL query

2015-12-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12541: Component/s: SQL > Support rollup/cube/povit in SQL query > -- > >

[jira] [Updated] (SPARK-12543) Support subquery in select/where/having

2015-12-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12543: Component/s: SQL > Support subquery in select/where/having > --- > >

[jira] [Updated] (SPARK-11394) PostgreDialect cannot handle BYTE types

2015-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11394: - Assignee: Takeshi Yamamuro > PostgreDialect cannot handle BYTE types > --

[jira] [Resolved] (SPARK-11394) PostgreDialect cannot handle BYTE types

2015-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11394. -- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 This issue has been resolved by

[jira] [Commented] (SPARK-12355) Implement unhandledFilter interface for Parquet

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073504#comment-15073504 ] Apache Spark commented on SPARK-12355: -- User 'HyukjinKwon' has created a pull reques

[jira] [Resolved] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12547. - Resolution: Fixed Fix Version/s: 2.0.0 > Tighten scala style checker enforcement for UDF r

[jira] [Assigned] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12547: Assignee: Apache Spark (was: Reynold Xin) > Tighten scala style checker enforcement for U

[jira] [Assigned] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12547: Assignee: Reynold Xin (was: Apache Spark) > Tighten scala style checker enforcement for U

[jira] [Assigned] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12547: Assignee: Reynold Xin (was: Apache Spark) > Tighten scala style checker enforcement for U

[jira] [Assigned] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12547: Assignee: Apache Spark (was: Reynold Xin) > Tighten scala style checker enforcement for U

[jira] [Commented] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073457#comment-15073457 ] Apache Spark commented on SPARK-12547: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

2015-12-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073430#comment-15073430 ] Saisai Shao commented on SPARK-11782: - I just verified with latest master branch, see

[jira] [Created] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12547: --- Summary: Tighten scala style checker enforcement for UDF registration Key: SPARK-12547 URL: https://issues.apache.org/jira/browse/SPARK-12547 Project: Spark I

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread wei wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073386#comment-15073386 ] wei wu commented on SPARK-12196: Yes, Hao. The local dir path format "[SSD]file:///") may

[jira] [Comment Edited] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread wei wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073386#comment-15073386 ] wei wu edited comment on SPARK-12196 at 12/29/15 2:31 AM: -- Yes,

[jira] [Assigned] (SPARK-12512) WithColumn does not work on multiple column with special character

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12512: Assignee: Apache Spark > WithColumn does not work on multiple column with special characte

[jira] [Commented] (SPARK-12492) SQL page of Spark-sql is always blank

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073378#comment-15073378 ] meiyoula commented on SPARK-12492: -- [~srowen], I still met this problem using the latest

[jira] [Reopened] (SPARK-12492) SQL page of Spark-sql is always blank

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula reopened SPARK-12492: -- Still has this problem > SQL page of Spark-sql is always blank > -- >

[jira] [Updated] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-12493: - Attachment: IE version.png > Can't open "details" span of ExecutionsPage in IE11 > --

[jira] [Updated] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-12493: - Description: Reproduce steps: 1. sbin/start-thriftserver.sh 2. Beeline connect to thriftserver, and run "

[jira] [Commented] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073349#comment-15073349 ] Shixiong Zhu commented on SPARK-12511: -- Is it possible that your sending loop preven

[jira] [Commented] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073344#comment-15073344 ] Shixiong Zhu commented on SPARK-12511: -- Has not yet figured out the root cause. Here

[jira] [Comment Edited] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073344#comment-15073344 ] Shixiong Zhu edited comment on SPARK-12511 at 12/29/15 1:33 AM: ---

[jira] [Commented] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073342#comment-15073342 ] meiyoula commented on SPARK-12493: -- [~sowen]I think it's simply to reproduce this proble

[jira] [Reopened] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula reopened SPARK-12493: -- > Can't open "details" span of ExecutionsPage in IE11 > ---

[jira] [Comment Edited] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073342#comment-15073342 ] meiyoula edited comment on SPARK-12493 at 12/29/15 1:31 AM: [

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

2015-12-28 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073341#comment-15073341 ] Sun Rui commented on SPARK-12239: - Instead of case-by-case fix, I would prefer the latter

[jira] [Resolved] (SPARK-12522) Add the missing the document string for the SQL configuration

2015-12-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12522. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Add the missing the do

[jira] [Created] (SPARK-12546) Writing to partitioned parquet table can fail with OOM

2015-12-28 Thread Nong Li (JIRA)
Nong Li created SPARK-12546: --- Summary: Writing to partitioned parquet table can fail with OOM Key: SPARK-12546 URL: https://issues.apache.org/jira/browse/SPARK-12546 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12490) Don't use Javascript for web UI's paginated table navigation controls

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-12490: -- Assignee: Josh Rosen (was: Apache Spark) > Don't use Javascript for web UI's paginated table

[jira] [Resolved] (SPARK-12490) Don't use Javascript for web UI's paginated table navigation controls

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12490. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10441 [https://github.

[jira] [Updated] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12511: --- Assignee: Shixiong Zhu > streaming driver with checkpointing unable to finalize leading to OOM >

[jira] [Created] (SPARK-12545) Support exists condition

2015-12-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12545: -- Summary: Support exists condition Key: SPARK-12545 URL: https://issues.apache.org/jira/browse/SPARK-12545 Project: Spark Issue Type: New Feature Repo

[jira] [Created] (SPARK-12544) Support window functions in SQLContext

2015-12-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12544: -- Summary: Support window functions in SQLContext Key: SPARK-12544 URL: https://issues.apache.org/jira/browse/SPARK-12544 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12543) Support subquery in select/where/having

2015-12-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12543: -- Summary: Support subquery in select/where/having Key: SPARK-12543 URL: https://issues.apache.org/jira/browse/SPARK-12543 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12542) Support intersect/except in SQL

2015-12-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12542: -- Summary: Support intersect/except in SQL Key: SPARK-12542 URL: https://issues.apache.org/jira/browse/SPARK-12542 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12541) Support rollup/cube/povit in SQL query

2015-12-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12541: -- Summary: Support rollup/cube/povit in SQL query Key: SPARK-12541 URL: https://issues.apache.org/jira/browse/SPARK-12541 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073300#comment-15073300 ] Cazen Lee commented on SPARK-12537: --- Hi Owen. Thank you very much for detail review. Y

[jira] [Created] (SPARK-12540) Support all TPCDS queries

2015-12-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12540: -- Summary: Support all TPCDS queries Key: SPARK-12540 URL: https://issues.apache.org/jira/browse/SPARK-12540 Project: Spark Issue Type: Epic Components:

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-28 Thread Anandraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073246#comment-15073246 ] Anandraj edited comment on SPARK-12494 at 12/28/15 11:11 PM: -

[jira] [Updated] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-28 Thread Anandraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anandraj updated SPARK-12494: - Attachment: vectors1.tar.gz Sample data for reproducing the K-Means error in yarn cluster mode. Program

[jira] [Resolved] (SPARK-12489) Fix minor issues found by Findbugs

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12489. -- Resolution: Fixed Assignee: Shixiong Zhu > Fix minor issues found by Findbugs > -

[jira] [Updated] (SPARK-12489) Fix minor issues found by Findbugs

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12489: - Affects Version/s: 1.6.0 > Fix minor issues found by Findbugs > -

[jira] [Updated] (SPARK-12489) Fix minor issues found by Findbugs

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12489: - Fix Version/s: 2.0.0 1.6.1 > Fix minor issues found by Findbugs >

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

2015-12-28 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073236#comment-15073236 ] Ilya Ganelin commented on SPARK-12488: -- I'll submit a dataset that causes this when

[jira] [Resolved] (SPARK-12525) Fix compiler warnings in Kinesis ASL module due to @transient annotations

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12525. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10479 [https://github.

[jira] [Assigned] (SPARK-12525) Fix compiler warnings in Kinesis ASL module due to @transient annotations

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-12525: -- Assignee: Josh Rosen (was: Apache Spark) > Fix compiler warnings in Kinesis ASL module due to

[jira] [Closed] (SPARK-5742) Network over RDMA

2015-12-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-5742. -- Resolution: Later This is something excellent to explore. However, I'm going to close the ticket as "la

[jira] [Resolved] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12491. -- Resolution: Duplicate Fix Version/s: 1.6.0 1.5.3 > UDAF result differs in SQL

[jira] [Commented] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073194#comment-15073194 ] Jonathan Kelly commented on SPARK-10789: An alternative to this change could be t

[jira] [Issue Comment Deleted] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated SPARK-10789: --- Comment: was deleted (was: Here's another patch that can be applied to v1.6.0.) > Cluster mo

[jira] [Commented] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073193#comment-15073193 ] Jonathan Kelly commented on SPARK-10789: Here's another patch that can be applied

[jira] [Updated] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated SPARK-10789: --- Attachment: SPARK-10789.v1.6.0.diff Here's another patch that can be applied to v1.6.0. > Cl

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Tristan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073191#comment-15073191 ] Tristan commented on SPARK-12491: - 1.6.0rc4 works in cluster mode also. Thank you! > UDA

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073187#comment-15073187 ] Joseph K. Bradley commented on SPARK-12488: --- I don't see what could be causing

[jira] [Assigned] (SPARK-12486) Executors are not always terminated successfully by the worker.

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12486: Assignee: Apache Spark > Executors are not always terminated successfully by the worker. >

[jira] [Updated] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12494: -- Priority: Major (was: Blocker) > Array out of bound Exception in KMeans Yarn Mode > --

[jira] [Closed] (SPARK-12531) Add median and mode to Summary statistics

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12531. - Resolution: Duplicate > Add median and mode to Summary statistics > -

[jira] [Commented] (SPARK-12531) Add median and mode to Summary statistics

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073159#comment-15073159 ] Joseph K. Bradley commented on SPARK-12531: --- [~gauravkumar37] The current plan

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073146#comment-15073146 ] Herman van Hovell commented on SPARK-12491: --- I just tried the latest 1.5 branch

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-28 Thread Tim Preece (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073145#comment-15073145 ] Tim Preece commented on SPARK-12319: Hi, The failing test is already checked in. It i

[jira] [Resolved] (SPARK-12441) Fixing missingInput in all Logical/Physical operators

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12441. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10393 [htt

[jira] [Resolved] (SPARK-7727) Avoid inner classes in RuleExecutor

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7727. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10174 [https:

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

2015-12-28 Thread Sen Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073138#comment-15073138 ] Sen Fang commented on SPARK-12239: -- Thanks [~sunrui] for your suggestions. Both sound ve

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-12424: -- Assignee: Kousuke Saruta > The implementation of ParamMap#filter is wrong. > -

[jira] [Updated] (SPARK-12424) The implementation of ParamMap#filter is wrong.

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12424: --- Fix Version/s: 2.0.0 1.6.1 > The implementation of ParamMap#filter is wron

[jira] [Resolved] (SPARK-12424) The implementation of ParamMap#filter is wrong.

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12424. Resolution: Fixed > The implementation of ParamMap#filter is wrong. > -

[jira] [Updated] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12517: --- Assignee: yaron weinsberg > No default RDD name for ones created by sc.textFile > --

[jira] [Resolved] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12517. Resolution: Fixed > No default RDD name for ones created by sc.textFile >

[jira] [Updated] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12517: --- Target Version/s: 1.6.1, 2.0.0 (was: 1.5.1, 1.5.2) > No default RDD name for ones created by

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073125#comment-15073125 ] Yin Huai commented on SPARK-12491: -- https://github.com/apache/spark/commit/5e603a51c09a9

[jira] [Commented] (SPARK-5885) Add VectorAssembler

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073123#comment-15073123 ] Joseph K. Bradley commented on SPARK-5885: -- I'd currently recommend using DataFra

[jira] [Resolved] (SPARK-12287) Support UnsafeRow in MapPartitions/MapGroups/CoGroup

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12287. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10398 [htt

[jira] [Updated] (SPARK-12287) Support UnsafeRow in MapPartitions/MapGroups/CoGroup

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12287: - Assignee: Xiao Li > Support UnsafeRow in MapPartitions/MapGroups/CoGroup > --

[jira] [Updated] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12517: --- Fix Version/s: 2.0.0 1.6.1 > No default RDD name for ones created by sc.te

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073099#comment-15073099 ] Michael Armbrust commented on SPARK-12319: -- Do you want to open a PR with your f

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12319: - Target Version/s: 2.0.0 > Address endian specific problems surfaced in 1.6 >

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Tristan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073098#comment-15073098 ] Tristan commented on SPARK-12491: - Confirmed: Second 'show' of the problematic query work

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073092#comment-15073092 ] Herman van Hovell commented on SPARK-12491: --- I did some testing on a spark clus

  1   2   >