[jira] [Updated] (SPARK-9092) Make --num-executors compatible with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9092: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Make --num-executors compatible

[jira] [Commented] (SPARK-6442) MLlib Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629320#comment-14629320 ] Sean Owen commented on SPARK-6442: -- [~mengxr] for Commons Math, and point #2: actually th

[jira] [Resolved] (SPARK-8807) Add between operator in SparkR

[ https://issues.apache.org/jira/browse/SPARK-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8807. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 735

[jira] [Updated] (SPARK-8807) Add between operator in SparkR

[ https://issues.apache.org/jira/browse/SPARK-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8807: - Assignee: Liang-Chi Hsieh > Add between operator in SparkR > -

[jira] [Resolved] (SPARK-8972) Incorrect result for rollup

[ https://issues.apache.org/jira/browse/SPARK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8972. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7343 [https://github.com/apac

[jira] [Updated] (SPARK-8972) Incorrect result for rollup

[ https://issues.apache.org/jira/browse/SPARK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8972: Assignee: Cheng Hao > Incorrect result for rollup > --- > > Key: SPA

[jira] [Comment Edited] (SPARK-6442) MLlib Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629225#comment-14629225 ] Rahul Palamuttam edited comment on SPARK-6442 at 7/16/15 5:46 AM: --

[jira] [Comment Edited] (SPARK-6442) MLlib Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629225#comment-14629225 ] Rahul Palamuttam edited comment on SPARK-6442 at 7/16/15 5:43 AM: --

[jira] [Comment Edited] (SPARK-6442) MLlib Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629225#comment-14629225 ] Rahul Palamuttam edited comment on SPARK-6442 at 7/16/15 5:33 AM: --

[jira] [Commented] (SPARK-6442) MLlib Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629225#comment-14629225 ] Rahul Palamuttam commented on SPARK-6442: - I think instead of breeze, nd4j from de

[jira] [Resolved] (SPARK-9061) Fix and re-enable ignored tests in ExpressionTypeCheckingSuite

[ https://issues.apache.org/jira/browse/SPARK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9061. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > Fix and re-enable ign

[jira] [Resolved] (SPARK-9068) refactor the implicit type cast code

[ https://issues.apache.org/jira/browse/SPARK-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9068. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > refactor the implicit

[jira] [Updated] (SPARK-9068) refactor the implicit type cast code

[ https://issues.apache.org/jira/browse/SPARK-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9068: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-8947 > refactor the implicit type cast

[jira] [Commented] (SPARK-6442) MLlib Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629182#comment-14629182 ] Xiangrui Meng commented on SPARK-6442: -- If there existed some linear algebra library

[jira] [Resolved] (SPARK-8245) string function: format_number

[ https://issues.apache.org/jira/browse/SPARK-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8245. Resolution: Fixed Fix Version/s: 1.5.0 > string function: format_number > ---

[jira] [Resolved] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8800. - Resolution: Invalid https://github.com/apache/spark/pull/7212 has been reverted by https://github.com/apa

[jira] [Reopened] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-8800: - > Spark SQL Decimal Division operation loss of precision/scale when type is > defined as DecimalType.Unlimite

[jira] [Resolved] (SPARK-8677) Decimal divide operation throws ArithmeticException

[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8677. - Resolution: Invalid https://github.com/apache/spark/pull/7056 has been reverted by https://github.com/apa

[jira] [Reopened] (SPARK-8677) Decimal divide operation throws ArithmeticException

[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-8677: - > Decimal divide operation throws ArithmeticException > --- >

[jira] [Updated] (SPARK-9018) Implement a generic Stopwatch utility for ML algorithms

[ https://issues.apache.org/jira/browse/SPARK-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9018: - Summary: Implement a generic Stopwatch utility for ML algorithms (was: Implement a generic Timer

[jira] [Commented] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629154#comment-14629154 ] Yin Huai commented on SPARK-8359: - https://github.com/apache/spark/pull/6814 has been reve

[jira] [Reopened] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-8359: - Assignee: (was: Liang-Chi Hsieh) > Spark SQL Decimal type precision loss on multiplication > ---

[jira] [Resolved] (SPARK-9060) Revert SPARK-8359, SPARK-8800, and SPARK-8677

[ https://issues.apache.org/jira/browse/SPARK-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9060. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7426 [https://github.com/apac

[jira] [Updated] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8359: Fix Version/s: (was: 1.5.0) > Spark SQL Decimal type precision loss on multiplication >

[jira] [Resolved] (SPARK-9018) Implement a generic Timer utility for ML algorithms

[ https://issues.apache.org/jira/browse/SPARK-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9018. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7415 [https://githu

[jira] [Updated] (SPARK-7751) Add @since to stable and experimental methods in MLlib

[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7751: - Description: This is useful to check whether a feature exists in some version of Spark. This is a

[jira] [Updated] (SPARK-6573) Convert inbound NaN values as null

[ https://issues.apache.org/jira/browse/SPARK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6573: -- Assignee: (was: Davies Liu) > Convert inbound NaN values as null > -

[jira] [Resolved] (SPARK-9051) SortMergeCompatibilitySuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9051. --- Resolution: Not A Problem > SortMergeCompatibilitySuite is flaky > --

[jira] [Commented] (SPARK-9051) SortMergeCompatibilitySuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629138#comment-14629138 ] Davies Liu commented on SPARK-9051: --- So, let's close this. > SortMergeCompatibilitySuit

[jira] [Commented] (SPARK-9022) UnsafeProject

[ https://issues.apache.org/jira/browse/SPARK-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629131#comment-14629131 ] Apache Spark commented on SPARK-9022: - User 'davies' has created a pull request for th

[jira] [Resolved] (SPARK-8774) Add R model formula with basic support as a transformer

[ https://issues.apache.org/jira/browse/SPARK-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8774. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7381 [https://githu

[jira] [Commented] (SPARK-9044) Updated RDD name does not reflect under "Storage" tab

[ https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629122#comment-14629122 ] Wenjie Zhang commented on SPARK-9044: - Based on what you have said, you might want to

[jira] [Commented] (SPARK-9044) Updated RDD name does not reflect under "Storage" tab

[ https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629119#comment-14629119 ] Zhang, Liye commented on SPARK-9044: It doesn't matter where *RDDInfo* belongs to whic

[jira] [Commented] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629116#comment-14629116 ] Wenchen Fan commented on SPARK-9082: Will fix it soon. > Filter using non-determinist

[jira] [Commented] (SPARK-8230) complex function: size

[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629107#comment-14629107 ] Cheng Hao commented on SPARK-8230: -- [~pedrorodriguez], actually [~TarekAuel] set a good e

[jira] [Commented] (SPARK-9051) SortMergeCompatibilitySuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629105#comment-14629105 ] Adrian Wang commented on SPARK-9051: Just find that Michael has revert it and SPARK-69

[jira] [Issue Comment Deleted] (SPARK-8646) PySpark does not run on YARN if master not provided in command line

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8646: Comment: was deleted (was: yes, when we set master=yarn-client on pyspark/SparkContext.py, it do not

[jira] [Created] (SPARK-9092) Make --num-executors compatible with dynamic allocation

Niranjan Padmanabhan created SPARK-9092: --- Summary: Make --num-executors compatible with dynamic allocation Key: SPARK-9092 URL: https://issues.apache.org/jira/browse/SPARK-9092 Project: Spark

[jira] [Commented] (SPARK-9051) SortMergeCompatibilitySuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629104#comment-14629104 ] Adrian Wang commented on SPARK-9051: This might have something to do with SPARK-9027 ,

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN if master not provided in command line

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629103#comment-14629103 ] Lianhui Wang commented on SPARK-8646: - yes, when we set master=yarn-client on pyspark/

[jira] [Commented] (SPARK-8230) complex function: size

[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629079#comment-14629079 ] Pedro Rodriguez commented on SPARK-8230: Moving to here instead of mailing list.

[jira] [Updated] (SPARK-9091) Add the codec interface to DStream.

[ https://issues.apache.org/jira/browse/SPARK-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-9091: Description: Add description later. > Add the codec interface to DStream. >

[jira] [Created] (SPARK-9091) Add the codec interface to DStream.

SaintBacchus created SPARK-9091: --- Summary: Add the codec interface to DStream. Key: SPARK-9091 URL: https://issues.apache.org/jira/browse/SPARK-9091 Project: Spark Issue Type: Bug Com

[jira] [Assigned] (SPARK-8925) Add @since tags to mllib.util

[ https://issues.apache.org/jira/browse/SPARK-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8925: --- Assignee: (was: Apache Spark) > Add @since tags to mllib.util > -

[jira] [Assigned] (SPARK-8925) Add @since tags to mllib.util

[ https://issues.apache.org/jira/browse/SPARK-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8925: --- Assignee: Apache Spark > Add @since tags to mllib.util > - > >

[jira] [Commented] (SPARK-8925) Add @since tags to mllib.util

[ https://issues.apache.org/jira/browse/SPARK-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629041#comment-14629041 ] Apache Spark commented on SPARK-8925: - User 'sthota2014' has created a pull request fo

[jira] [Assigned] (SPARK-9090) Fix definition of residual in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9090: --- Assignee: (was: Apache Spark) > Fix definition of residual in LinearRegressionSummary > -

[jira] [Assigned] (SPARK-9090) Fix definition of residual in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9090: --- Assignee: Apache Spark > Fix definition of residual in LinearRegressionSummary >

[jira] [Commented] (SPARK-9090) Fix definition of residual in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629034#comment-14629034 ] Apache Spark commented on SPARK-9090: - User 'feynmanliang' has created a pull request

[jira] [Resolved] (SPARK-6602) Replace direct use of Akka with Spark RPC interface

[ https://issues.apache.org/jira/browse/SPARK-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6602. Resolution: Fixed > Replace direct use of Akka with Spark RPC interface > --

[jira] [Commented] (SPARK-6602) Replace direct use of Akka with Spark RPC interface

[ https://issues.apache.org/jira/browse/SPARK-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629025#comment-14629025 ] Shixiong Zhu commented on SPARK-6602: - Sure. I think it's done. > Replace direct use

[jira] [Commented] (SPARK-9090) Fix definition of residual in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629019#comment-14629019 ] Feynman Liang commented on SPARK-9090: -- Working on this. > Fix definition of residua

[jira] [Created] (SPARK-9090) Fix definition of residual in LinearRegressionSummary

Feynman Liang created SPARK-9090: Summary: Fix definition of residual in LinearRegressionSummary Key: SPARK-9090 URL: https://issues.apache.org/jira/browse/SPARK-9090 Project: Spark Issue Typ

[jira] [Created] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

Amar Goradia created SPARK-9089: --- Summary: Failing to run simple job on Spark Standalone Cluster Key: SPARK-9089 URL: https://issues.apache.org/jira/browse/SPARK-9089 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-9088) spark-class should ignore driver-memory when running in YARN cluster mode.

[ https://issues.apache.org/jira/browse/SPARK-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Balog resolved SPARK-9088. --- Resolution: Duplicate > spark-class should ignore driver-memory when running in YARN cluster mode. > -

[jira] [Resolved] (SPARK-9086) Remove BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9086. Resolution: Fixed Fix Version/s: 1.5.0 > Remove BinaryNode from TreeNode > --

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629009#comment-14629009 ] Robert Beauchemin commented on SPARK-9078: -- If there were also a way to get table

[jira] [Updated] (SPARK-8646) PySpark does not run on YARN if master not provided in command line

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-8646: -- Summary: PySpark does not run on YARN if master not provided in command line (was: PySpark does

[jira] [Comment Edited] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628971#comment-14628971 ] Juliet Hougland edited comment on SPARK-8646 at 7/16/15 12:03 AM: --

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628971#comment-14628971 ] Juliet Hougland commented on SPARK-8646: Yea, it works fine if I add that arg. The

[jira] [Assigned] (SPARK-9085) Remove LeafNode, UnaryNode, BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9085: --- Assignee: Apache Spark > Remove LeafNode, UnaryNode, BinaryNode from TreeNode > -

[jira] [Assigned] (SPARK-9085) Remove LeafNode, UnaryNode, BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9085: --- Assignee: (was: Apache Spark) > Remove LeafNode, UnaryNode, BinaryNode from TreeNode > --

[jira] [Commented] (SPARK-9085) Remove LeafNode, UnaryNode, BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628966#comment-14628966 ] Apache Spark commented on SPARK-9085: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628959#comment-14628959 ] Marcelo Vanzin commented on SPARK-8646: --- I think I know what's going on. Since you'r

[jira] [Created] (SPARK-9088) spark-class should ignore driver-memory when running in YARN cluster mode.

Doug Balog created SPARK-9088: - Summary: spark-class should ignore driver-memory when running in YARN cluster mode. Key: SPARK-9088 URL: https://issues.apache.org/jira/browse/SPARK-9088 Project: Spark

[jira] [Created] (SPARK-9087) Broken SQL on where condition involving timestamp and time string.

Paul Wu created SPARK-9087: -- Summary: Broken SQL on where condition involving timestamp and time string. Key: SPARK-9087 URL: https://issues.apache.org/jira/browse/SPARK-9087 Project: Spark Issue

[jira] [Comment Edited] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628947#comment-14628947 ] Juliet Hougland edited comment on SPARK-8646 at 7/15/15 11:46 PM: --

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628947#comment-14628947 ] Juliet Hougland commented on SPARK-8646: The failure happens at the point that I n

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628927#comment-14628927 ] Marcelo Vanzin commented on SPARK-8646: --- [~j_houg], could you share the exact code y

[jira] [Commented] (SPARK-9046) Decimal type support improvement

[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628922#comment-14628922 ] Yin Huai commented on SPARK-9046: - [~rtreffer] Yes, you are right. Although our schema has

[jira] [Updated] (SPARK-9084) Add in support for realtime data predictions using ML PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9084: - Component/s: (was: Spark Core) ML > Add in support for realtime data predictions usin

[jira] [Updated] (SPARK-9084) Add in support for realtime data predictions using ML PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9084: - Priority: Minor (was: Critical) > Add in support for realtime data predictions using ML PipelineModel > -

[jira] [Assigned] (SPARK-9086) Remove BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9086: --- Assignee: Reynold Xin (was: Apache Spark) > Remove BinaryNode from TreeNode > --

[jira] [Assigned] (SPARK-9086) Remove BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9086: --- Assignee: Apache Spark (was: Reynold Xin) > Remove BinaryNode from TreeNode > --

[jira] [Updated] (SPARK-9084) Add in support for realtime data predictions using ML PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hollin Wilkins updated SPARK-9084: -- Description: Currently ML provides excellent support for feature manipulation, model selection,

[jira] [Commented] (SPARK-9086) Remove BinaryNode from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628920#comment-14628920 ] Apache Spark commented on SPARK-9086: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-9086) Remove BinaryNode from TreeNode

Reynold Xin created SPARK-9086: -- Summary: Remove BinaryNode from TreeNode Key: SPARK-9086 URL: https://issues.apache.org/jira/browse/SPARK-9086 Project: Spark Issue Type: Sub-task Comp

[jira] [Created] (SPARK-9085) Remove LeafNode, UnaryNode, BinaryNode from TreeNode

Reynold Xin created SPARK-9085: -- Summary: Remove LeafNode, UnaryNode, BinaryNode from TreeNode Key: SPARK-9085 URL: https://issues.apache.org/jira/browse/SPARK-9085 Project: Spark Issue Type: Im

[jira] [Comment Edited] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628912#comment-14628912 ] Yin Huai edited comment on SPARK-9082 at 7/15/15 11:07 PM: --- cc [

[jira] [Created] (SPARK-9084) Add in support for realtime data predictions using ML PipelineModel

Hollin Wilkins created SPARK-9084: - Summary: Add in support for realtime data predictions using ML PipelineModel Key: SPARK-9084 URL: https://issues.apache.org/jira/browse/SPARK-9084 Project: Spark

[jira] [Updated] (SPARK-9083) If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions

[ https://issues.apache.org/jira/browse/SPARK-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9083: Assignee: Wenchen Fan > If order by clause has non-deterministic expressions, we should add a project > to

[jira] [Created] (SPARK-9083) If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions

Yin Huai created SPARK-9083: --- Summary: If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions Key: SPARK-9083 URL: https://issues.apache.org/jira/brows

[jira] [Commented] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628913#comment-14628913 ] Yin Huai commented on SPARK-9082: - [~cloud_fan] Will you have time to fix this? > Filter

[jira] [Commented] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628912#comment-14628912 ] Yin Huai commented on SPARK-9082: - cc [~marmbrus] > Filter using non-deterministic expres

[jira] [Updated] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9082: Assignee: Wenchen Fan > Filter using non-deterministic expressions should not be pushed down > -

[jira] [Created] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

Yin Huai created SPARK-9082: --- Summary: Filter using non-deterministic expressions should not be pushed down Key: SPARK-9082 URL: https://issues.apache.org/jira/browse/SPARK-9082 Project: Spark Iss

[jira] [Updated] (SPARK-8599) Improve non-deterministic expression handling

[ https://issues.apache.org/jira/browse/SPARK-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8599: --- Summary: Improve non-deterministic expression handling (was: Use a Random operator to handle Random d

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628895#comment-14628895 ] Reynold Xin commented on SPARK-9078: It's reasonable to have a field for limit in jdbc

[jira] [Assigned] (SPARK-9016) Make random forest classifier extend Classifier abstraction

[ https://issues.apache.org/jira/browse/SPARK-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9016: --- Assignee: (was: Apache Spark) > Make random forest classifier extend Classifier abstracti

[jira] [Assigned] (SPARK-9016) Make random forest classifier extend Classifier abstraction

[ https://issues.apache.org/jira/browse/SPARK-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9016: --- Assignee: Apache Spark > Make random forest classifier extend Classifier abstraction > --

[jira] [Commented] (SPARK-9016) Make random forest classifier extend Classifier abstraction

[ https://issues.apache.org/jira/browse/SPARK-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628882#comment-14628882 ] Apache Spark commented on SPARK-9016: - User 'holdenk' has created a pull request for t

[jira] [Updated] (SPARK-9080) IsNaN expression

[ https://issues.apache.org/jira/browse/SPARK-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9080: --- Description: Add IsNaN expression to return true if the input double/float value is NaN. was: Add

[jira] [Updated] (SPARK-9080) IsNaN expression

[ https://issues.apache.org/jira/browse/SPARK-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9080: --- Summary: IsNaN expression (was: IsNan expression) > IsNaN expression > > >

[jira] [Created] (SPARK-9081) fillna/dropna should also fill/drop NaN values in addition to null values

Reynold Xin created SPARK-9081: -- Summary: fillna/dropna should also fill/drop NaN values in addition to null values Key: SPARK-9081 URL: https://issues.apache.org/jira/browse/SPARK-9081 Project: Spark

[jira] [Updated] (SPARK-9079) Design NaN semantics

[ https://issues.apache.org/jira/browse/SPARK-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9079: --- Description: 1. What should NaN = NaN return? 2. If we see NaN in the group by key column, should we

[jira] [Updated] (SPARK-8797) Sorting float/double column containing NaNs can lead to "Comparison method violates its general contract!" errors

[ https://issues.apache.org/jira/browse/SPARK-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8797: --- Priority: Critical (was: Major) > Sorting float/double column containing NaNs can lead to "Comparison

[jira] [Updated] (SPARK-9079) Design NaN semantics

[ https://issues.apache.org/jira/browse/SPARK-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9079: --- Summary: Design NaN semantics (was: equality on NaN with NaN should return false) > Design NaN seman

[jira] [Created] (SPARK-9080) IsNan expression

Reynold Xin created SPARK-9080: -- Summary: IsNan expression Key: SPARK-9080 URL: https://issues.apache.org/jira/browse/SPARK-9080 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-9046) Decimal type support improvement

[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628833#comment-14628833 ] Rene Treffer commented on SPARK-9046: - +1, Decimal.Unlimited is a lie. https://docs.o

[jira] [Updated] (SPARK-8797) Sorting float/double column containing NaNs can lead to "Comparison method violates its general contract!" errors

[ https://issues.apache.org/jira/browse/SPARK-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8797: --- Assignee: (was: Josh Rosen) > Sorting float/double column containing NaNs can lead to "Comparison

  1   2   3   >