[jira] [Updated] (SPARK-12326) Move GBT implementation from spark.mllib to spark.ml

2016-03-03 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-12326: --- Assignee: Seth Hendrickson > Move GBT implementation from spark.mllib to spark.ml >

[jira] [Commented] (SPARK-10610) Using AppName instead of AppId in the name of all metrics

2016-03-03 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179507#comment-15179507 ] Pete Robbins commented on SPARK-10610: -- I think the appId is an important piece of information when

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-03-03 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179491#comment-15179491 ] Mark Grover commented on SPARK-13670: - cc [~vanzin] as fyi. I ran into this when I was running

[jira] [Commented] (SPARK-13669) Job will always fail in the external shuffle service unavailable situation

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179485#comment-15179485 ] Saisai Shao commented on SPARK-13669: - Hi [~imranr], I think you fixed this issue (SPARK-9439) and

[jira] [Updated] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-03-03 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-13670: Description: There's a particular snippet in spark-class

[jira] [Created] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-03-03 Thread Mark Grover (JIRA)
Mark Grover created SPARK-13670: --- Summary: spark-class doesn't bubble up error from launcher command Key: SPARK-13670 URL: https://issues.apache.org/jira/browse/SPARK-13670 Project: Spark

[jira] [Created] (SPARK-13669) Job will always fail in the external shuffle service unavailable situation

2016-03-03 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-13669: --- Summary: Job will always fail in the external shuffle service unavailable situation Key: SPARK-13669 URL: https://issues.apache.org/jira/browse/SPARK-13669 Project:

[jira] [Resolved] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13652. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-13639) Statistics.colStats(rdd).mean and variance should handle NaN in the input vectors

2016-03-03 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179447#comment-15179447 ] Nick Pentreath commented on SPARK-13639: For SPARK-13568, we can take one of two approaches: 1.

[jira] [Assigned] (SPARK-13642) Properly handle signal kill of ApplicationMaster

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13642: Assignee: (was: Apache Spark) > Properly handle signal kill of ApplicationMaster >

[jira] [Commented] (SPARK-13642) Properly handle signal kill of ApplicationMaster

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179400#comment-15179400 ] Apache Spark commented on SPARK-13642: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13642) Properly handle signal kill of ApplicationMaster

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13642: Assignee: Apache Spark > Properly handle signal kill of ApplicationMaster >

[jira] [Updated] (SPARK-13642) Properly handle signal kill of ApplicationMaster

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13642: Summary: Properly handle signal kill of ApplicationMaster (was: Different finishing state between

[jira] [Commented] (SPARK-13650) Usage of the window() function on DStream

2016-03-03 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179347#comment-15179347 ] Mario Briggs commented on SPARK-13650: -- Running locally on my MAC, here is the output {quote}

[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

2016-03-03 Thread Zhong Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179339#comment-15179339 ] Zhong Wang commented on SPARK-13337: The current join method with usingColumns argument generates

[jira] [Assigned] (SPARK-13668) Reorder filter/join predicates to short-circuit isNotNull checks

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13668: Assignee: Apache Spark > Reorder filter/join predicates to short-circuit isNotNull checks

[jira] [Assigned] (SPARK-13668) Reorder filter/join predicates to short-circuit isNotNull checks

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13668: Assignee: (was: Apache Spark) > Reorder filter/join predicates to short-circuit

[jira] [Commented] (SPARK-13668) Reorder filter/join predicates to short-circuit isNotNull checks

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179318#comment-15179318 ] Apache Spark commented on SPARK-13668: -- User 'sameeragarwal' has created a pull request for this

[jira] [Updated] (SPARK-13668) Reorder filter/join predicates to short-circuit isNotNull checks

2016-03-03 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-13668: --- Description: If a filter predicate or a join condition consists of `IsNotNull` checks, we

[jira] [Created] (SPARK-13668) Reorder filter/join predicates to short-circuit isNotNull checks

2016-03-03 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-13668: -- Summary: Reorder filter/join predicates to short-circuit isNotNull checks Key: SPARK-13668 URL: https://issues.apache.org/jira/browse/SPARK-13668 Project: Spark

[jira] [Created] (SPARK-13667) Support for specifying custom date format for date and timestamp types

2016-03-03 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-13667: Summary: Support for specifying custom date format for date and timestamp types Key: SPARK-13667 URL: https://issues.apache.org/jira/browse/SPARK-13667 Project:

[jira] [Resolved] (SPARK-13647) also check if numeric value is within allowed range in _verify_type

2016-03-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13647. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11492

[jira] [Assigned] (SPARK-13626) SparkConf deprecation log messages are printed multiple times

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13626: Assignee: Apache Spark > SparkConf deprecation log messages are printed multiple times >

[jira] [Assigned] (SPARK-13626) SparkConf deprecation log messages are printed multiple times

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13626: Assignee: (was: Apache Spark) > SparkConf deprecation log messages are printed

[jira] [Commented] (SPARK-13626) SparkConf deprecation log messages are printed multiple times

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179276#comment-15179276 ] Apache Spark commented on SPARK-13626: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179254#comment-15179254 ] Jeff Zhang commented on SPARK-13587: SPARK-13081 is almost done. But for this ticket, I definitely

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179253#comment-15179253 ] Juliet Hougland commented on SPARK-13587: - That is wonderful. Let me know if you'd like me to

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179251#comment-15179251 ] Jeff Zhang commented on SPARK-13587: Actually I have created this ticket several weeks ago

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179250#comment-15179250 ] Juliet Hougland commented on SPARK-13587: - I made a comment related to this below. TLDR I think

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179247#comment-15179247 ] Juliet Hougland commented on SPARK-13587: - Currently the way users specify the workers' python

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

2016-03-03 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179241#comment-15179241 ] Gayathri Murali commented on SPARK-13641: - [~xusen] I can remove c_feature from Vector Assembler

[jira] [Commented] (SPARK-13639) Statistics.colStats(rdd).mean and variance should handle NaN in the input vectors

2016-03-03 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179227#comment-15179227 ] yuhao yang commented on SPARK-13639: We perhaps can find some other way for SPARK-13568. I just need

[jira] [Assigned] (SPARK-13665) Initial separation of concerns

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13665: Assignee: Apache Spark (was: Michael Armbrust) > Initial separation of concerns >

[jira] [Commented] (SPARK-13665) Initial separation of concerns

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179224#comment-15179224 ] Apache Spark commented on SPARK-13665: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13665) Initial separation of concerns

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13665: Assignee: Michael Armbrust (was: Apache Spark) > Initial separation of concerns >

[jira] [Comment Edited] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179157#comment-15179157 ] huangyu edited comment on SPARK-13652 at 3/4/16 3:09 AM: - I think the doc is

[jira] [Created] (SPARK-13666) Annoying warnings from SQLConf in log output

2016-03-03 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-13666: -- Summary: Annoying warnings from SQLConf in log output Key: SPARK-13666 URL: https://issues.apache.org/jira/browse/SPARK-13666 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13531: Assignee: (was: Apache Spark) > Some DataFrame joins stopped working with

[jira] [Commented] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179201#comment-15179201 ] Apache Spark commented on SPARK-13531: -- User 'zuowang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13531: Assignee: Apache Spark > Some DataFrame joins stopped working with

[jira] [Comment Edited] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179157#comment-15179157 ] huangyu edited comment on SPARK-13652 at 3/4/16 2:53 AM: - I think the docs are

[jira] [Created] (SPARK-13665) Initial separation of concerns

2016-03-03 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13665: Summary: Initial separation of concerns Key: SPARK-13665 URL: https://issues.apache.org/jira/browse/SPARK-13665 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13664) Simplify and Speedup HadoopFSRelation

2016-03-03 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13664: Summary: Simplify and Speedup HadoopFSRelation Key: SPARK-13664 URL: https://issues.apache.org/jira/browse/SPARK-13664 Project: Spark Issue Type:

[jira] [Created] (SPARK-13663) Upgrade Snappy Java to 1.1.2.1

2016-03-03 Thread Ted Yu (JIRA)
Ted Yu created SPARK-13663: -- Summary: Upgrade Snappy Java to 1.1.2.1 Key: SPARK-13663 URL: https://issues.apache.org/jira/browse/SPARK-13663 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179186#comment-15179186 ] huangyu edited comment on SPARK-13652 at 3/4/16 2:39 AM: - I used your patch and

[jira] [Commented] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179186#comment-15179186 ] huangyu commented on SPARK-13652: - I use your patch and it worked, great!! > TransportClient.sendRpcSync

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-03-03 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179180#comment-15179180 ] Gayathri Murali commented on SPARK-13629: - [~josephkb] In the case of discrete probabilistic

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

2016-03-03 Thread Jisoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179173#comment-15179173 ] Jisoo Kim commented on SPARK-12221: --- I made this backward-compatible, so it should be able to read

[jira] [Commented] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179157#comment-15179157 ] huangyu commented on SPARK-13652: - I think it is about fetching stream rather than sendRpc >

[jira] [Comment Edited] (SPARK-13642) Different finishing state between Spark and YARN

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179102#comment-15179102 ] Saisai Shao edited comment on SPARK-13642 at 3/4/16 1:45 AM: - Hi [~tgraves],

[jira] [Resolved] (SPARK-13415) Visualize subquery in SQL web UI

2016-03-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13415. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11417

[jira] [Updated] (SPARK-13642) Different finishing state between Spark and YARN

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13642: Summary: Different finishing state between Spark and YARN (was: Inconsistent finishing state

[jira] [Commented] (SPARK-13642) Inconsistent finishing state between driver and AM

2016-03-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179102#comment-15179102 ] Saisai Shao commented on SPARK-13642: - Hi [~tgraves], thanks a lot for your comments. I think here

[jira] [Commented] (SPARK-13601) Invoke task failure callbacks before calling outputstream.close()

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179078#comment-15179078 ] Apache Spark commented on SPARK-13601: -- User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-12877) TrainValidationSplit is missing in pyspark.ml.tuning

2016-03-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12877: -- Assignee: Jeremy > TrainValidationSplit is missing in pyspark.ml.tuning >

[jira] [Updated] (SPARK-11861) Expose feature importances API for decision trees

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11861: -- Shepherd: Joseph K. Bradley Assignee: Seth Hendrickson Target

[jira] [Assigned] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13633: Assignee: Andrew Or (was: Apache Spark) > Move parser classes to

[jira] [Assigned] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13633: Assignee: Apache Spark (was: Andrew Or) > Move parser classes to

[jira] [Commented] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179033#comment-15179033 ] Apache Spark commented on SPARK-13633: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-12721) SQL generation support for script transformation

2016-03-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12721: Comment: was deleted (was: A PR is submitted https://github.com/apache/spark/pull/11503) > SQL generation

[jira] [Comment Edited] (SPARK-13068) Extend pyspark ml paramtype conversion to support lists

2016-03-03 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179016#comment-15179016 ] Seth Hendrickson edited comment on SPARK-13068 at 3/4/16 12:32 AM: --- I

[jira] [Assigned] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13631: Assignee: (was: Apache Spark) > getPreferredLocations race condition in spark 1.6.0?

[jira] [Assigned] (SPARK-12721) SQL generation support for script transformation

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12721: Assignee: (was: Apache Spark) > SQL generation support for script transformation >

[jira] [Commented] (SPARK-12721) SQL generation support for script transformation

2016-03-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179017#comment-15179017 ] Xiao Li commented on SPARK-12721: - A PR is submitted https://github.com/apache/spark/pull/11503 > SQL

[jira] [Commented] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179019#comment-15179019 ] Apache Spark commented on SPARK-13631: -- User 'a1k0n' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12721) SQL generation support for script transformation

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12721: Assignee: Apache Spark > SQL generation support for script transformation >

[jira] [Commented] (SPARK-12721) SQL generation support for script transformation

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179018#comment-15179018 ] Apache Spark commented on SPARK-12721: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13631: Assignee: Apache Spark > getPreferredLocations race condition in spark 1.6.0? >

[jira] [Commented] (SPARK-13068) Extend pyspark ml paramtype conversion to support lists

2016-03-03 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179016#comment-15179016 ] Seth Hendrickson commented on SPARK-13068: -- I think these are good and valid points. I will give

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179012#comment-15179012 ] Jeff Zhang commented on SPARK-13587: Thanks for the feedback [~j_houg]. Yes, that's why I make the

[jira] [Commented] (SPARK-13601) Invoke task failure callbacks before calling outputstream.close()

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179011#comment-15179011 ] Apache Spark commented on SPARK-13601: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-13662) [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore

2016-03-03 Thread Evan Chan (JIRA)
Evan Chan created SPARK-13662: - Summary: [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore Key: SPARK-13662 URL: https://issues.apache.org/jira/browse/SPARK-13662 Project: Spark

[jira] [Commented] (SPARK-13631) getPreferredLocations race condition in spark 1.6.0?

2016-03-03 Thread Andy Sloane (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178980#comment-15178980 ] Andy Sloane commented on SPARK-13631: - Hm. I see, it's just a coincidence that a thread tends to get

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178883#comment-15178883 ] Jeff Zhang commented on SPARK-13587: Thanks for letting me know this. > Support virtualenv in

[jira] [Assigned] (SPARK-13659) Remove returnValues from BlockStore APIs

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13659: Assignee: Apache Spark (was: Josh Rosen) > Remove returnValues from BlockStore APIs >

[jira] [Assigned] (SPARK-13659) Remove returnValues from BlockStore APIs

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13659: Assignee: Josh Rosen (was: Apache Spark) > Remove returnValues from BlockStore APIs >

[jira] [Created] (SPARK-13661) Avoid the copy of UnsafeRow in HashedRelation

2016-03-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13661: -- Summary: Avoid the copy of UnsafeRow in HashedRelation Key: SPARK-13661 URL: https://issues.apache.org/jira/browse/SPARK-13661 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13659) Remove returnValues from BlockStore APIs

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178869#comment-15178869 ] Apache Spark commented on SPARK-13659: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-13660) CommitFailureTestRelationSuite floods the logs with garbage

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13660: - Labels: starter (was: ) > CommitFailureTestRelationSuite floods the logs with garbage >

[jira] [Created] (SPARK-13660) CommitFailureTestRelationSuite floods the logs with garbage

2016-03-03 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13660: Summary: CommitFailureTestRelationSuite floods the logs with garbage Key: SPARK-13660 URL: https://issues.apache.org/jira/browse/SPARK-13660 Project: Spark

[jira] [Commented] (SPARK-12877) TrainValidationSplit is missing in pyspark.ml.tuning

2016-03-03 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178867#comment-15178867 ] Jeremy commented on SPARK-12877: Hi Xiangrui, Commenting! > TrainValidationSplit is missing in

[jira] [Resolved] (SPARK-13584) ContinuousQueryManagerSuite floods the logs with garbage

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13584. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 >

[jira] [Updated] (SPARK-13635) Enable LimitPushdown optimizer rule because we have whole-stage codegen for Limit

2016-03-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13635: --- Assignee: Liang-Chi Hsieh > Enable LimitPushdown optimizer rule because we have whole-stage codegen

[jira] [Assigned] (SPARK-13657) Can't parse very long AND/OR expression

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13657: Assignee: Davies Liu (was: Apache Spark) > Can't parse very long AND/OR expression >

[jira] [Assigned] (SPARK-13657) Can't parse very long AND/OR expression

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13657: Assignee: Apache Spark (was: Davies Liu) > Can't parse very long AND/OR expression >

[jira] [Commented] (SPARK-13657) Can't parse very long AND/OR expression

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178862#comment-15178862 ] Apache Spark commented on SPARK-13657: -- User 'davies' has created a pull request for this issue:

[jira] [Created] (SPARK-13659) Remove returnValues from BlockStore APIs

2016-03-03 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13659: -- Summary: Remove returnValues from BlockStore APIs Key: SPARK-13659 URL: https://issues.apache.org/jira/browse/SPARK-13659 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13658) BooleanSimplification rule is slow with large boolean expressions

2016-03-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13658: -- Summary: BooleanSimplification rule is slow with large boolean expressions Key: SPARK-13658 URL: https://issues.apache.org/jira/browse/SPARK-13658 Project: Spark

[jira] [Resolved] (SPARK-13632) Create new o.a.s.sql.execution.commands package

2016-03-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13632. - Resolution: Fixed Fix Version/s: 2.0.0 > Create new o.a.s.sql.execution.commands package

[jira] [Assigned] (SPARK-13577) Allow YARN to handle multiple jars, archive when uploading Spark dependencies

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13577: Assignee: Apache Spark > Allow YARN to handle multiple jars, archive when uploading Spark

[jira] [Assigned] (SPARK-13577) Allow YARN to handle multiple jars, archive when uploading Spark dependencies

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13577: Assignee: (was: Apache Spark) > Allow YARN to handle multiple jars, archive when

[jira] [Commented] (SPARK-13577) Allow YARN to handle multiple jars, archive when uploading Spark dependencies

2016-03-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178831#comment-15178831 ] Apache Spark commented on SPARK-13577: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-12347) Write script to run all MLlib examples for testing

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178803#comment-15178803 ] Joseph K. Bradley commented on SPARK-12347: --- 1. As in the JIRA description, there would need to

[jira] [Commented] (SPARK-13068) Extend pyspark ml paramtype conversion to support lists

2016-03-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178794#comment-15178794 ] Joseph K. Bradley commented on SPARK-13068: --- I like the idea of automatic casting when

[jira] [Resolved] (SPARK-13599) Groovy-all ends up in spark-assembly if hive profile set

2016-03-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13599. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 2.0.0 > Groovy-all

[jira] [Created] (SPARK-13657) Can't parse very long AND/OR expression

2016-03-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13657: -- Summary: Can't parse very long AND/OR expression Key: SPARK-13657 URL: https://issues.apache.org/jira/browse/SPARK-13657 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13652: - Summary: TransportClient.sendRpcSync returns wrong results (was: spark netty network issue) >

[jira] [Commented] (SPARK-13652) spark netty network issue

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178723#comment-15178723 ] Shixiong Zhu commented on SPARK-13652: -- Updated "Affects Version/s". This bug only exists in 1.6.0

[jira] [Updated] (SPARK-13652) spark netty network issue

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13652: - Affects Version/s: (was: 1.5.2) (was: 1.5.1)

[jira] [Updated] (SPARK-13652) spark netty network issue

2016-03-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13652: - Affects Version/s: 1.2.2 1.3.1 1.4.1 > spark netty

  1   2   3   >