[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g., s

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g., s

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g., s

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g., specu

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g., specu

[jira] [Created] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
Feng Zhu created SPARK-20250: Summary: Improper OOM error when a task been killed while spilling data Key: SPARK-20250 URL: https://issues.apache.org/jira/browse/SPARK-20250 Project: Spark Issue

[jira] [Updated] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread shaolinliu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shaolinliu updated SPARK-20248: --- Description: When we using thrift server, it is difficult to constrain the user's sql statement;

[jira] [Updated] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread shaolinliu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shaolinliu updated SPARK-20248: --- Description: When we using thrift server, it is difficult to constrain the user's sql statement;

[jira] [Commented] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2017-04-07 Thread sam elamin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960549#comment-15960549 ] sam elamin commented on SPARK-12648: Is anyone working on this? if not then I am happ

[jira] [Commented] (SPARK-20249) Add summary for LinearSVCModel

2017-04-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960540#comment-15960540 ] Jeff Zhang commented on SPARK-20249: Will work on it. > Add summary for LinearSVCMo

[jira] [Created] (SPARK-20249) Add summary for LinearSVCModel

2017-04-07 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-20249: -- Summary: Add summary for LinearSVCModel Key: SPARK-20249 URL: https://issues.apache.org/jira/browse/SPARK-20249 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960537#comment-15960537 ] Nick Pentreath commented on SPARK-4038: --- I don't think there can be a reasonable exp

[jira] [Commented] (SPARK-17716) Hidden Markov Model (HMM)

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960534#comment-15960534 ] Nick Pentreath commented on SPARK-17716: I don't think we can expect sufficient c

[jira] [Commented] (SPARK-3903) Create general data loading method for LabeledPoints

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960531#comment-15960531 ] Nick Pentreath commented on SPARK-3903: --- I think given the move to DataFrames, and t

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960530#comment-15960530 ] Nick Pentreath commented on SPARK-7674: --- Is this JIRA still open? Can it be resolved

[jira] [Commented] (SPARK-12210) Small example that shows how to integrate spark.mllib with spark.ml

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960523#comment-15960523 ] Nick Pentreath commented on SPARK-12210: Is this required any more? I guess we ar

[jira] [Assigned] (SPARK-20076) Python interface for ml.stats.Correlation

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-20076: -- Assignee: Liang-Chi Hsieh > Python interface for ml.stats.Correlation > --

[jira] [Resolved] (SPARK-20076) Python interface for ml.stats.Correlation

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20076. Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17494 [https:/

[jira] [Comment Edited] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960508#comment-15960508 ] guoxiaolongzte edited comment on SPARK-20157 at 4/7/17 8:57 AM: ---

[jira] [Commented] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960508#comment-15960508 ] guoxiaolongzte commented on SPARK-20157: [~srowen] In jobs in web ui,Choose 'sho

[jira] [Updated] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20157: --- Attachment: new.png > In the menu ‘Storage’in Web UI, click the Go button, and shows no pagin

[jira] [Resolved] (SPARK-20108) Spark query is getting failed with exception

2017-04-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20108. -- Resolution: Cannot Reproduce I am resolving this as {{Cannot Reproduce}}. Please reopen if anyo

[jira] [Comment Edited] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen

2017-04-07 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956420#comment-15956420 ] Kazuaki Ishizaki edited comment on SPARK-20184 at 4/7/17 8:29 AM: -

[jira] [Updated] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20005: --- Attachment: before_fix_of_stages.png before_fix_jobs.png after

[jira] [Commented] (SPARK-20228) Random Forest instable results depending on spark.executor.memory

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960471#comment-15960471 ] Sean Owen commented on SPARK-20228: --- Without more detail I'm not sure what to make of i

[jira] [Commented] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960460#comment-15960460 ] Apache Spark commented on SPARK-20005: -- User 'guoxiaolongzte' has created a pull req

[jira] [Assigned] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20005: Assignee: (was: Apache Spark) > There is no "Newline" in UI in describtion >

[jira] [Assigned] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20005: Assignee: Apache Spark > There is no "Newline" in UI in describtion > ---

[jira] [Updated] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2017-04-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-12648: - Affects Version/s: 2.1.0 > UDF with Option[Double] throws ClassCastException > --

[jira] [Resolved] (SPARK-20212) UDFs with Option[Primitive Type] don't work as expected

2017-04-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20212. -- Resolution: Duplicate It sounds a duplicate of SPARK-12648 and I think the fix should be in the

[jira] [Commented] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960456#comment-15960456 ] Sean Owen commented on SPARK-20243: --- Agree. I think this implementation should just syn

[jira] [Resolved] (SPARK-20245) pass output to LogicalRelation directly

2017-04-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20245. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17552 [https://githu

[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960432#comment-15960432 ] Apache Spark commented on SPARK-20246: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-13210) NPE in Sort

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960414#comment-15960414 ] Sean Owen commented on SPARK-13210: --- For anyone seeing this exception, can you run with

[jira] [Resolved] (SPARK-20242) Delay stop of web UI

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20242. --- Resolution: Won't Fix > Delay stop of web UI > > > Key: SPARK-20

<    1   2