[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g.,

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g.,

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g.,

[jira] [Updated] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-20250: - Description: While a task is calling spill() when it receives a killing request from driver (e.g.,

[jira] [Created] (SPARK-20250) Improper OOM error when a task been killed while spilling data

2017-04-07 Thread Feng Zhu (JIRA)
Feng Zhu created SPARK-20250: Summary: Improper OOM error when a task been killed while spilling data Key: SPARK-20250 URL: https://issues.apache.org/jira/browse/SPARK-20250 Project: Spark

[jira] [Updated] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread shaolinliu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shaolinliu updated SPARK-20248: --- Description: When we using thrift server, it is difficult to constrain the user's sql statement;

[jira] [Updated] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread shaolinliu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shaolinliu updated SPARK-20248: --- Description: When we using thrift server, it is difficult to constrain the user's sql statement;

[jira] [Commented] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2017-04-07 Thread sam elamin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960549#comment-15960549 ] sam elamin commented on SPARK-12648: Is anyone working on this? if not then I am happy taking it over

[jira] [Commented] (SPARK-20249) Add summary for LinearSVCModel

2017-04-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960540#comment-15960540 ] Jeff Zhang commented on SPARK-20249: Will work on it. > Add summary for LinearSVCModel >

[jira] [Created] (SPARK-20249) Add summary for LinearSVCModel

2017-04-07 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-20249: -- Summary: Add summary for LinearSVCModel Key: SPARK-20249 URL: https://issues.apache.org/jira/browse/SPARK-20249 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960537#comment-15960537 ] Nick Pentreath commented on SPARK-4038: --- I don't think there can be a reasonable expectation of

[jira] [Commented] (SPARK-17716) Hidden Markov Model (HMM)

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960534#comment-15960534 ] Nick Pentreath commented on SPARK-17716: I don't think we can expect sufficient committer

[jira] [Commented] (SPARK-3903) Create general data loading method for LabeledPoints

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960531#comment-15960531 ] Nick Pentreath commented on SPARK-3903: --- I think given the move to DataFrames, and that we can load

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960530#comment-15960530 ] Nick Pentreath commented on SPARK-7674: --- Is this JIRA still open? Can it be resolved? Or are there

[jira] [Commented] (SPARK-12210) Small example that shows how to integrate spark.mllib with spark.ml

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960523#comment-15960523 ] Nick Pentreath commented on SPARK-12210: Is this required any more? I guess we are close enough

[jira] [Assigned] (SPARK-20076) Python interface for ml.stats.Correlation

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-20076: -- Assignee: Liang-Chi Hsieh > Python interface for ml.stats.Correlation >

[jira] [Resolved] (SPARK-20076) Python interface for ml.stats.Correlation

2017-04-07 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20076. Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17494

[jira] [Comment Edited] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960508#comment-15960508 ] guoxiaolongzte edited comment on SPARK-20157 at 4/7/17 8:57 AM: [~srowen]

[jira] [Commented] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960508#comment-15960508 ] guoxiaolongzte commented on SPARK-20157: [~srowen] In jobs in web ui,Choose 'show' text box,

[jira] [Updated] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20157: --- Attachment: new.png > In the menu ‘Storage’in Web UI, click the Go button, and shows no

[jira] [Resolved] (SPARK-20108) Spark query is getting failed with exception

2017-04-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20108. -- Resolution: Cannot Reproduce I am resolving this as {{Cannot Reproduce}}. Please reopen if

[jira] [Comment Edited] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen

2017-04-07 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956420#comment-15956420 ] Kazuaki Ishizaki edited comment on SPARK-20184 at 4/7/17 8:29 AM: -- If

[jira] [Updated] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20005: --- Attachment: before_fix_of_stages.png before_fix_jobs.png

[jira] [Commented] (SPARK-20228) Random Forest instable results depending on spark.executor.memory

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960471#comment-15960471 ] Sean Owen commented on SPARK-20228: --- Without more detail I'm not sure what to make of it. Just giving

[jira] [Commented] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960460#comment-15960460 ] Apache Spark commented on SPARK-20005: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20005: Assignee: (was: Apache Spark) > There is no "Newline" in UI in describtion >

[jira] [Assigned] (SPARK-20005) There is no "Newline" in UI in describtion

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20005: Assignee: Apache Spark > There is no "Newline" in UI in describtion >

[jira] [Updated] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2017-04-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-12648: - Affects Version/s: 2.1.0 > UDF with Option[Double] throws ClassCastException >

[jira] [Resolved] (SPARK-20212) UDFs with Option[Primitive Type] don't work as expected

2017-04-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20212. -- Resolution: Duplicate It sounds a duplicate of SPARK-12648 and I think the fix should be in

[jira] [Commented] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960456#comment-15960456 ] Sean Owen commented on SPARK-20243: --- Agree. I think this implementation should just synchronize access

[jira] [Resolved] (SPARK-20245) pass output to LogicalRelation directly

2017-04-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20245. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17552

[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960432#comment-15960432 ] Apache Spark commented on SPARK-20246: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-13210) NPE in Sort

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960414#comment-15960414 ] Sean Owen commented on SPARK-13210: --- For anyone seeing this exception, can you run with assertions on

[jira] [Resolved] (SPARK-20242) Delay stop of web UI

2017-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20242. --- Resolution: Won't Fix > Delay stop of web UI > > > Key:

[jira] [Commented] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960371#comment-15960371 ] Apache Spark commented on SPARK-20248: -- User 'shaolinliu' has created a pull request for this issue:

[jira] [Commented] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960335#comment-15960335 ] Apache Spark commented on SPARK-20248: -- User 'shaolinliu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20248: Assignee: Apache Spark > Spark SQL add limit parameter to enhance the reliability. >

[jira] [Assigned] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20248: Assignee: (was: Apache Spark) > Spark SQL add limit parameter to enhance the

[jira] [Assigned] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20246: Assignee: Apache Spark > Should check determinism when pushing predicates down through

[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960329#comment-15960329 ] Apache Spark commented on SPARK-20246: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

2017-04-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20246: Assignee: (was: Apache Spark) > Should check determinism when pushing predicates down

[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

2017-04-07 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960325#comment-15960325 ] Liang-Chi Hsieh commented on SPARK-20246: - For union and window, we don't have the replacement of

[jira] [Created] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

2017-04-07 Thread shaolinliu (JIRA)
shaolinliu created SPARK-20248: -- Summary: Spark SQL add limit parameter to enhance the reliability. Key: SPARK-20248 URL: https://issues.apache.org/jira/browse/SPARK-20248 Project: Spark Issue

<    1   2