[jira] [Commented] (SPARK-10141) Number of tasks on executors still become negative after failures

[ https://issues.apache.org/jira/browse/SPARK-10141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993323#comment-14993323 ] Jay Luan commented on SPARK-10141: -- I am also getting similar errors and Spark UI also s

[jira] [Issue Comment Deleted] (SPARK-11551) Replace example code in ml-features.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Nelamangala updated SPARK-11551: -- Comment: was deleted (was: I am fixing this) > Replace example code in ml-features.md

[jira] [Commented] (SPARK-11551) Replace example code in ml-features.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993354#comment-14993354 ] somil deshmukh commented on SPARK-11551: Pls assign to me ,I would like to work o

[jira] [Commented] (SPARK-11549) Replace example code in mllib-evaluation-metrics.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993367#comment-14993367 ] Vikas Nelamangala commented on SPARK-11549: --- I am working on this > Replace ex

[jira] [Reopened] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] patcharee reopened SPARK-11087: --- I found a scenario where the problem exists > spark.sql.orc.filterPushdown does not work, No ORC pushdow

[jira] [Resolved] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11472. --- Resolution: Not A Problem You can reopen, or just make a new one. > SparkContext creation error afte

[jira] [Commented] (SPARK-11548) Replace example code in mllib-collaborative-filtering.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993393#comment-14993393 ] Apache Spark commented on SPARK-11548: -- User 'rishabhbhardwaj' has created a pull re

[jira] [Assigned] (SPARK-11548) Replace example code in mllib-collaborative-filtering.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11548: Assignee: Apache Spark > Replace example code in mllib-collaborative-filtering.md using in

[jira] [Assigned] (SPARK-11548) Replace example code in mllib-collaborative-filtering.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11548: Assignee: (was: Apache Spark) > Replace example code in mllib-collaborative-filtering.

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993398#comment-14993398 ] patcharee commented on SPARK-11087: --- Hi [~zzhan], the problem actually happens when I g

[jira] [Commented] (SPARK-10141) Number of tasks on executors still become negative after failures

[ https://issues.apache.org/jira/browse/SPARK-10141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993406#comment-14993406 ] Ohad Zadok commented on SPARK-10141: no, from the log I believe it's some kind of com

[jira] [Updated] (SPARK-11530) Return eigenvalues with PCA model

[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christos Iraklis Tsatsoulis updated SPARK-11530: Description: For data scientists & statisticians, PCA is of little

[jira] [Issue Comment Deleted] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] patcharee updated SPARK-11087: -- Comment: was deleted (was: I found a scenario where the problem exists) > spark.sql.orc.filterPushdown

[jira] [Issue Comment Deleted] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] patcharee updated SPARK-11087: -- Comment: was deleted (was: Hi [~zzhan], the problem actually happens when I generates orc file by "sav

[jira] [Commented] (SPARK-11507) Error thrown when using BlockMatrix.add

[ https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993440#comment-14993440 ] Apache Spark commented on SPARK-11507: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-11507) Error thrown when using BlockMatrix.add

[ https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11507: Assignee: (was: Apache Spark) > Error thrown when using BlockMatrix.add >

[jira] [Assigned] (SPARK-11507) Error thrown when using BlockMatrix.add

[ https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11507: Assignee: Apache Spark > Error thrown when using BlockMatrix.add > ---

[jira] [Commented] (SPARK-11551) Replace example code in ml-features.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993452#comment-14993452 ] Xusen Yin commented on SPARK-11551: --- Please go ahead and start doing it. This will assi

[jira] [Commented] (SPARK-11551) Replace example code in ml-features.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993453#comment-14993453 ] Xusen Yin commented on SPARK-11551: --- Please go ahead and start doing it. This will assi

[jira] [Commented] (SPARK-11516) Spark application cannot be found from JSON API even though it exists

[ https://issues.apache.org/jira/browse/SPARK-11516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993457#comment-14993457 ] Charles Yeh commented on SPARK-11516: - This is because it errors when rebuilding the

[jira] [Created] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

Tofigh created SPARK-11553: -- Summary: row.getInt(i) if row[i]=null returns 0 Key: SPARK-11553 URL: https://issues.apache.org/jira/browse/SPARK-11553 Project: Spark Issue Type: Bug Report

[jira] [Created] (SPARK-11554) add map/flatMap to GroupedDataset

Wenchen Fan created SPARK-11554: --- Summary: add map/flatMap to GroupedDataset Key: SPARK-11554 URL: https://issues.apache.org/jira/browse/SPARK-11554 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11554) add map/flatMap to GroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11554: Assignee: Apache Spark > add map/flatMap to GroupedDataset > -

[jira] [Assigned] (SPARK-11554) add map/flatMap to GroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11554: Assignee: (was: Apache Spark) > add map/flatMap to GroupedDataset > --

[jira] [Commented] (SPARK-11554) add map/flatMap to GroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993532#comment-14993532 ] Apache Spark commented on SPARK-11554: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11535) StringIndexer should handle empty String specially

[ https://issues.apache.org/jira/browse/SPARK-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11535: Assignee: Apache Spark > StringIndexer should handle empty String specially >

[jira] [Commented] (SPARK-11535) StringIndexer should handle empty String specially

[ https://issues.apache.org/jira/browse/SPARK-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993546#comment-14993546 ] Apache Spark commented on SPARK-11535: -- User 'pravingadakh' has created a pull reque

[jira] [Assigned] (SPARK-11535) StringIndexer should handle empty String specially

[ https://issues.apache.org/jira/browse/SPARK-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11535: Assignee: (was: Apache Spark) > StringIndexer should handle empty String specially > -

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993565#comment-14993565 ] Jaromir Vanek commented on SPARK-10911: --- I also came across this problem. Is there

[jira] [Comment Edited] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993565#comment-14993565 ] Jaromir Vanek edited comment on SPARK-10911 at 11/6/15 12:15 PM: --

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993612#comment-14993612 ] Sean Owen commented on SPARK-10911: --- Hm, we've had the opposite complaint in other simi

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11553: -- Priority: Minor (was: Major) Can you be more specific? these aren't methods of RDD. What language, etc

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11553: -- Component/s: SQL > row.getInt(i) if row[i]=null returns 0 > -- > >

[jira] [Commented] (SPARK-11530) Return eigenvalues with PCA model

[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993619#comment-14993619 ] Sean Owen commented on SPARK-11530: --- I agree, and it should be fairly easy to get this

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993695#comment-14993695 ] Thomas Graves commented on SPARK-10911: --- If the framework or driver is telling it t

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993706#comment-14993706 ] Sean Owen commented on SPARK-10911: --- I think you're right that the context was a little

[jira] [Created] (SPARK-11555) spark on yarn spark-class --num-workers allows 0 and shouldn't

Thomas Graves created SPARK-11555: - Summary: spark on yarn spark-class --num-workers allows 0 and shouldn't Key: SPARK-11555 URL: https://issues.apache.org/jira/browse/SPARK-11555 Project: Spark

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers allows 0 and shouldn't

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993741#comment-14993741 ] Thomas Graves commented on SPARK-11555: --- Note I think this was broken with change f

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers allows 0 and shouldn't

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993742#comment-14993742 ] Sean Owen commented on SPARK-11555: --- num-executors? I'm sure we've just recently adjust

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993743#comment-14993743 ] Thomas Graves commented on SPARK-10911: --- You could say its a user problem, but its

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993744#comment-14993744 ] Kristina Plazonic commented on SPARK-10935: --- @Xusen, [~mengxr] (and anybody els

[jira] [Created] (SPARK-11556) High spark.executor.memory causes wrong result

Younes created SPARK-11556: -- Summary: High spark.executor.memory causes wrong result Key: SPARK-11556 URL: https://issues.apache.org/jira/browse/SPARK-11556 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11556) High spark.executor.memory causes wrong result

[ https://issues.apache.org/jira/browse/SPARK-11556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11556. --- Resolution: Duplicate Have a look through JIRA first, this one you might have found with the key term

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993751#comment-14993751 ] Sean Owen commented on SPARK-10911: --- Agree, but what about the correctness problem of k

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers allows 0 and shouldn't

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993750#comment-14993750 ] Thomas Graves commented on SPARK-11555: --- I should probably rephrase because after l

[jira] [Updated] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11555: -- Summary: spark on yarn spark-class --num-workers doesn't work (was: spark on yarn spark-class

[jira] [Updated] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11555: -- Description: Using the old spark-class and --num-workers interface, --num-workers parameter is

[jira] [Commented] (SPARK-11556) High spark.executor.memory causes wrong result

[ https://issues.apache.org/jira/browse/SPARK-11556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993759#comment-14993759 ] Younes commented on SPARK-11556: Ah thanks! Didn't find it when I searched before. > Hig

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993760#comment-14993760 ] Sean Owen commented on SPARK-11555: --- To be clear, you are also talking about --num-exec

[jira] [Commented] (SPARK-10533) DataFrame filter is not handling float/double with Scientific Notation 'e' / 'E'

[ https://issues.apache.org/jira/browse/SPARK-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993763#comment-14993763 ] Apache Spark commented on SPARK-10533: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993765#comment-14993765 ] Thomas Graves commented on SPARK-11555: --- No I'm talking about --num-workers, see th

[jira] [Resolved] (SPARK-11511) Creating an InputDStream but not using it throws NPE

[ https://issues.apache.org/jira/browse/SPARK-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11511. --- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 1.7.0 Issue

[jira] [Updated] (SPARK-11511) Creating an InputDStream but not using it throws NPE

[ https://issues.apache.org/jira/browse/SPARK-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11511: -- Assignee: Shixiong Zhu > Creating an InputDStream but not using it throws NPE > ---

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993771#comment-14993771 ] patcharee commented on SPARK-11087: --- Hi, I found a scenario where the predicate does no

[jira] [Comment Edited] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993771#comment-14993771 ] patcharee edited comment on SPARK-11087 at 11/6/15 2:56 PM: H

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993775#comment-14993775 ] Thomas Graves commented on SPARK-11555: --- Note that it is broken with --num-executor

[jira] [Updated] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11555: -- Priority: Minor (was: Major) OK, that still passes through {{ClientArguments.scala}}, which parses nu

[jira] [Updated] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11555: -- Priority: Critical (was: Minor) Oops, somehow my priority change got flicked the wrong way. I think th

[jira] [Updated] (SPARK-11547) Set JDBC fetchSize default value to make it easier to operate

[ https://issues.apache.org/jira/browse/SPARK-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11547: -- Target Version/s: (was: 1.5.1) Priority: Minor (was: Critical) Fix Version/s:

[jira] [Assigned] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-11555: - Assignee: Thomas Graves > spark on yarn spark-class --num-workers doesn't work > ---

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993815#comment-14993815 ] Thomas Graves commented on SPARK-11555: --- To fix this we can simply pass in an optio

[jira] [Commented] (SPARK-10785) Scale QuantileDiscretizer using distributed binning

[ https://issues.apache.org/jira/browse/SPARK-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993885#comment-14993885 ] holdenk commented on SPARK-10785: - I've talked with Rachel who is interested in doing thi

[jira] [Created] (SPARK-11557) Add from/to methods to DataFrameReader/Writer

Xiangrui Meng created SPARK-11557: - Summary: Add from/to methods to DataFrameReader/Writer Key: SPARK-11557 URL: https://issues.apache.org/jira/browse/SPARK-11557 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-11557) Add from/to methods to DataFrameReader/Writer

[ https://issues.apache.org/jira/browse/SPARK-11557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11557. --- Resolution: Won't Fix > Add from/to methods to DataFrameReader/Writer > -

[jira] [Commented] (SPARK-11557) Add from/to methods to DataFrameReader/Writer

[ https://issues.apache.org/jira/browse/SPARK-11557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993901#comment-14993901 ] Xiangrui Meng commented on SPARK-11557: --- `from` is a keyword in Python, making it d

[jira] [Assigned] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11555: Assignee: Thomas Graves (was: Apache Spark) > spark on yarn spark-class --num-workers doe

[jira] [Assigned] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11555: Assignee: Apache Spark (was: Thomas Graves) > spark on yarn spark-class --num-workers doe

[jira] [Commented] (SPARK-11555) spark on yarn spark-class --num-workers doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993966#comment-14993966 ] Apache Spark commented on SPARK-11555: -- User 'tgravescs' has created a pull request

[jira] [Commented] (SPARK-11478) ML StringIndexer return inconsistent schema

[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994007#comment-14994007 ] Joseph K. Bradley commented on SPARK-11478: --- {quote}it is difficult to get the

[jira] [Updated] (SPARK-11531) PySpark SparseVector should have "Found duplicate indices" error message

[ https://issues.apache.org/jira/browse/SPARK-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11531: -- Fix Version/s: (was: 1.6.0) [~Altruion] don't set fix version; it's not fixed > PySpark SparseVect

[jira] [Assigned] (SPARK-11543) spark.ml LogisticRegressionModel should prefer thresholds over threshold

[ https://issues.apache.org/jira/browse/SPARK-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-11543: - Assignee: Xiangrui Meng > spark.ml LogisticRegressionModel should prefer thresholds over

[jira] [Updated] (SPARK-7130) spark.ml RandomForest* should always do bootstrapping

[ https://issues.apache.org/jira/browse/SPARK-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7130: - Target Version/s: (was: 1.6.0) > spark.ml RandomForest* should always do bootstrapping > ---

[jira] [Updated] (SPARK-7106) Support model save/load in Python's FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7106: - Target Version/s: (was: 1.6.0) > Support model save/load in Python's FPGrowth >

[jira] [Updated] (SPARK-8855) Python API for Association Rules

[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8855: - Target Version/s: (was: 1.6.0) > Python API for Association Rules >

[jira] [Updated] (SPARK-7675) PySpark spark.ml Params type conversions

[ https://issues.apache.org/jira/browse/SPARK-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7675: - Target Version/s: (was: 1.6.0) > PySpark spark.ml Params type conversions >

[jira] [Updated] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2429: - Priority: Major (was: Minor) > Hierarchical Implementation of KMeans > --

[jira] [Updated] (SPARK-10906) More efficient SparseMatrix.equals

[ https://issues.apache.org/jira/browse/SPARK-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10906: -- Target Version/s: 1.7.0 (was: 1.6.0) > More efficient SparseMatrix.equals > --

[jira] [Updated] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2429: - Target Version/s: (was: 1.6.0) > Hierarchical Implementation of KMeans > ---

[jira] [Updated] (SPARK-6517) Bisecting k-means clustering

[ https://issues.apache.org/jira/browse/SPARK-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6517: - Target Version/s: 1.6.0 > Bisecting k-means clustering > > >

[jira] [Updated] (SPARK-9578) Stemmer feature transformer

[ https://issues.apache.org/jira/browse/SPARK-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9578: - Target Version/s: (was: 1.6.0) > Stemmer feature transformer > --- > >

[jira] [Updated] (SPARK-6634) Allow replacing columns in Transformers

[ https://issues.apache.org/jira/browse/SPARK-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6634: - Target Version/s: (was: 1.6.0) > Allow replacing columns in Transformers > -

[jira] [Updated] (SPARK-11223) PySpark CrossValidatorModel does not output metrics for every param in paramGrid

[ https://issues.apache.org/jira/browse/SPARK-11223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11223: -- Target Version/s: (was: 1.6.0) > PySpark CrossValidatorModel does not output metrics for ever

[jira] [Updated] (SPARK-7653) ML Pipeline and meta-algs should take random seed param

[ https://issues.apache.org/jira/browse/SPARK-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7653: - Target Version/s: (was: 1.6.0) > ML Pipeline and meta-algs should take random seed param > -

[jira] [Updated] (SPARK-7424) spark.ml classification, regression abstractions should add metadata to output column

[ https://issues.apache.org/jira/browse/SPARK-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7424: - Target Version/s: 1.7.0 (was: 1.6.0) > spark.ml classification, regression abstractions should ad

[jira] [Updated] (SPARK-7159) Support multiclass logistic regression in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7159: - Target Version/s: 1.7.0 (was: 1.6.0) > Support multiclass logistic regression in spark.ml > -

[jira] [Updated] (SPARK-7609) Add standardized checks for (Model, Estimator) unit tests

[ https://issues.apache.org/jira/browse/SPARK-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7609: - Target Version/s: 1.7.0 (was: 1.6.0) > Add standardized checks for (Model, Estimator) unit tests

[jira] [Updated] (SPARK-7146) Should ML sharedParams be a public API?

[ https://issues.apache.org/jira/browse/SPARK-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7146: - Target Version/s: 1.7.0 (was: 1.6.0) > Should ML sharedParams be a public API? >

[jira] [Updated] (SPARK-7376) Python: Add validation functionality to individual Param

[ https://issues.apache.org/jira/browse/SPARK-7376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7376: - Target Version/s: (was: 1.6.0) > Python: Add validation functionality to individual Param >

[jira] [Updated] (SPARK-7609) Add standardized checks for (Model, Estimator) unit tests

[ https://issues.apache.org/jira/browse/SPARK-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7609: - Assignee: (was: Xiangrui Meng) > Add standardized checks for (Model, Estimator) unit tests > -

[jira] [Updated] (SPARK-8516) ML attribute API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8516: - Target Version/s: 1.7.0 (was: 1.6.0) > ML attribute API in PySpark > ---

[jira] [Updated] (SPARK-8515) Improve ML attribute API

[ https://issues.apache.org/jira/browse/SPARK-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8515: - Target Version/s: 1.7.0 (was: 1.6.0) > Improve ML attribute API > > >

[jira] [Updated] (SPARK-6722) Model import/export for StreamingKMeansModel

[ https://issues.apache.org/jira/browse/SPARK-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6722: - Target Version/s: (was: 1.6.0) > Model import/export for StreamingKMeansModel >

[jira] [Updated] (SPARK-8519) Blockify distance computation in k-means

[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8519: - Target Version/s: 1.7.0 (was: 1.6.0) > Blockify distance computation in k-means > ---

[jira] [Updated] (SPARK-8858) Common interface for Frequent Itemsets

[ https://issues.apache.org/jira/browse/SPARK-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8858: - Target Version/s: (was: 1.6.0) > Common interface for Frequent Itemsets > --

[jira] [Updated] (SPARK-8983) ML Tuning Cross-Validation Improvements

[ https://issues.apache.org/jira/browse/SPARK-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8983: - Target Version/s: (was: 1.6.0) > ML Tuning Cross-Validation Improvements > -

[jira] [Updated] (SPARK-10386) Model import/export for PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10386: -- Target Version/s: 1.7.0 (was: 1.6.0) > Model import/export for PrefixSpan > --

[jira] [Updated] (SPARK-10387) Code generation for decision tree

[ https://issues.apache.org/jira/browse/SPARK-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10387: -- Target Version/s: 1.7.0 (was: 1.6.0) > Code generation for decision tree > ---

[jira] [Updated] (SPARK-10232) Decide whether spark.ml Decision Tree and Random Forest can replace spark.mllib implementation

[ https://issues.apache.org/jira/browse/SPARK-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10232: -- Target Version/s: 1.7.0 (was: 1.6.0) > Decide whether spark.ml Decision Tree and Random Forest

[jira] [Updated] (SPARK-10383) Sync example code between API doc and user guide

[ https://issues.apache.org/jira/browse/SPARK-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10383: -- Target Version/s: 1.7.0 (was: 1.6.0) > Sync example code between API doc and user guide >

[jira] [Updated] (SPARK-10785) Scale QuantileDiscretizer using distributed binning

[ https://issues.apache.org/jira/browse/SPARK-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10785: -- Target Version/s: 1.7.0 (was: 1.6.0) > Scale QuantileDiscretizer using distributed binning > -

  1   2   3   >