[jira] [Resolved] (SPARK-6091) Add MulticlassMetrics in PySpark/MLlib

2015-05-10 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6091. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6011 [https://githu

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-05-10 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537078#comment-14537078 ] Eron Wright commented on SPARK-7400: - I tried to implement the UDT, but encountered a

[jira] [Resolved] (SPARK-7345) Spark cannot detect renamed columns using JDBC connector

2015-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7345. Resolution: Fixed Fix Version/s: 1.4.0 1.3.2 Assignee: Oleg Sidork

[jira] [Created] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread yuhao yang (JIRA)
yuhao yang created SPARK-7514: - Summary: Add MinMaxNormalizer to feature transformation Key: SPARK-7514 URL: https://issues.apache.org/jira/browse/SPARK-7514 Project: Spark Issue Type: New Featur

[jira] [Assigned] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7514: --- Assignee: Apache Spark > Add MinMaxNormalizer to feature transformation > ---

[jira] [Commented] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537087#comment-14537087 ] Apache Spark commented on SPARK-7514: - User 'hhbyyh' has created a pull request for th

[jira] [Assigned] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7514: --- Assignee: (was: Apache Spark) > Add MinMaxNormalizer to feature transformation >

[jira] [Updated] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-7514: -- Description: Add a new scaling method to feature component, which is commonly known as min-max normaliz

[jira] [Updated] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-7514: -- Description: Add a new scaling method to feature component, which is commonly known as min-max normaliz

[jira] [Updated] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-7514: -- Description: Add a popular scaling method to feature component, which is commonly known as min-max norm

[jira] [Created] (SPARK-7515) Update documentation for PySpark on YARN with cluster mode

2015-05-10 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-7515: - Summary: Update documentation for PySpark on YARN with cluster mode Key: SPARK-7515 URL: https://issues.apache.org/jira/browse/SPARK-7515 Project: Spark Is

[jira] [Assigned] (SPARK-7515) Update documentation for PySpark on YARN with cluster mode

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7515: --- Assignee: Apache Spark > Update documentation for PySpark on YARN with cluster mode > ---

[jira] [Commented] (SPARK-7515) Update documentation for PySpark on YARN with cluster mode

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537110#comment-14537110 ] Apache Spark commented on SPARK-7515: - User 'sarutak' has created a pull request for t

[jira] [Assigned] (SPARK-7515) Update documentation for PySpark on YARN with cluster mode

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7515: --- Assignee: (was: Apache Spark) > Update documentation for PySpark on YARN with cluster mod

[jira] [Commented] (SPARK-7496) Update Programming guide with Online LDA

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537114#comment-14537114 ] yuhao yang commented on SPARK-7496: --- Hi Joseph, just something I got for your reference,

[jira] [Created] (SPARK-7516) Replace deprecated Data Frame api in Python Docs

2015-05-10 Thread Guancheng Chen (JIRA)
Guancheng Chen created SPARK-7516: - Summary: Replace deprecated Data Frame api in Python Docs Key: SPARK-7516 URL: https://issues.apache.org/jira/browse/SPARK-7516 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7516) Replace deprecated Data Frame api in Python Docs

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7516: --- Assignee: Apache Spark > Replace deprecated Data Frame api in Python Docs > -

[jira] [Assigned] (SPARK-7516) Replace deprecated Data Frame api in Python Docs

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7516: --- Assignee: (was: Apache Spark) > Replace deprecated Data Frame api in Python Docs > --

[jira] [Commented] (SPARK-7516) Replace deprecated Data Frame api in Python Docs

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537128#comment-14537128 ] Apache Spark commented on SPARK-7516: - User 'gchen' has created a pull request for thi

[jira] [Commented] (SPARK-6761) Approximate quantile

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537141#comment-14537141 ] Apache Spark commented on SPARK-6761: - User 'viirya' has created a pull request for th

[jira] [Assigned] (SPARK-6761) Approximate quantile

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6761: --- Assignee: (was: Apache Spark) > Approximate quantile > > >

[jira] [Assigned] (SPARK-6761) Approximate quantile

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6761: --- Assignee: Apache Spark > Approximate quantile > > > Key:

[jira] [Commented] (SPARK-5888) Add OneHotEncoder as a Transformer

2015-05-10 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537168#comment-14537168 ] Herman van Hovell tot Westerflier commented on SPARK-5888: -- Hi,

[jira] [Comment Edited] (SPARK-5888) Add OneHotEncoder as a Transformer

2015-05-10 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537168#comment-14537168 ] Herman van Hovell tot Westerflier edited comment on SPARK-5888 at 5/10/15 1:31 PM:

[jira] [Comment Edited] (SPARK-5888) Add OneHotEncoder as a Transformer

2015-05-10 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537168#comment-14537168 ] Herman van Hovell tot Westerflier edited comment on SPARK-5888 at 5/10/15 1:32 PM:

[jira] [Comment Edited] (SPARK-5888) Add OneHotEncoder as a Transformer

2015-05-10 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537168#comment-14537168 ] Herman van Hovell tot Westerflier edited comment on SPARK-5888 at 5/10/15 1:39 PM:

[jira] [Closed] (SPARK-7090) Introduce LDAOptimizer to LDA to further improve extensibility

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang closed SPARK-7090. - Close the jira as code merged. Thanks for the careful review and important fix. > Introduce LDAOptimizer to L

[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537205#comment-14537205 ] yuhao yang commented on SPARK-7368: --- Hi Zongheng, since the Amplab version is built upon

[jira] [Comment Edited] (SPARK-7368) add QR decomposition for RowMatrix

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537205#comment-14537205 ] yuhao yang edited comment on SPARK-7368 at 5/10/15 2:54 PM: Hi

[jira] [Created] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-7517: - Summary: Rename unsafe module to managedmemory Key: SPARK-7517 URL: https://issues.apache.org/jira/browse/SPARK-7517 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Commented] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537235#comment-14537235 ] Apache Spark commented on SPARK-7517: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Commented] (SPARK-5886) Add StringIndexer

2015-05-10 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537252#comment-14537252 ] Herman van Hovell tot Westerflier commented on SPARK-5886: -- Curre

[jira] [Commented] (SPARK-5885) Add VectorAssembler

2015-05-10 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537267#comment-14537267 ] Herman van Hovell tot Westerflier commented on SPARK-5885: -- Is it

[jira] [Assigned] (SPARK-6092) Add RankingMetrics in PySpark/MLlib

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6092: --- Assignee: Yanbo Liang (was: Apache Spark) > Add RankingMetrics in PySpark/MLlib > --

[jira] [Commented] (SPARK-6092) Add RankingMetrics in PySpark/MLlib

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537271#comment-14537271 ] Apache Spark commented on SPARK-6092: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-6092) Add RankingMetrics in PySpark/MLlib

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6092: --- Assignee: Apache Spark (was: Yanbo Liang) > Add RankingMetrics in PySpark/MLlib > --

[jira] [Issue Comment Deleted] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7517: -- Comment: was deleted (was: User 'JoshRosen' has created a pull request for this issue: https://github.co

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Commented] (SPARK-1132) Persisting Web UI through refactoring the SparkListener interface

2015-05-10 Thread sagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537292#comment-14537292 ] sagar commented on SPARK-1132: -- Hi Team, I see the issue is resolved and Fix Version/s: is -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Commented] (SPARK-5886) Add StringIndexer

2015-05-10 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537295#comment-14537295 ] Xiangrui Meng commented on SPARK-5886: -- You don't need to fit `indexer` first. Try co

[jira] [Commented] (SPARK-5885) Add VectorAssembler

2015-05-10 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537296#comment-14537296 ] Xiangrui Meng commented on SPARK-5885: -- Yes, this sounds good to me. Please create a

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Apache Spark (was: Josh Rosen) > Rename unsafe module to managedmemory > -

[jira] [Commented] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537301#comment-14537301 ] Apache Spark commented on SPARK-7517: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-7517) Rename unsafe module to managedmemory

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7517: --- Assignee: Josh Rosen (was: Apache Spark) > Rename unsafe module to managedmemory > -

[jira] [Commented] (SPARK-7496) Update Programming guide with Online LDA

2015-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537316#comment-14537316 ] Joseph K. Bradley commented on SPARK-7496: -- "LDA takes in a collection of documen

[jira] [Commented] (SPARK-2870) Thorough schema inference directly on RDDs of Python dictionaries

2015-05-10 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537324#comment-14537324 ] Nicholas Chammas commented on SPARK-2870: - cc [~rxin] - Are we still targeting thi

[jira] [Updated] (SPARK-2870) Thorough schema inference directly on RDDs of Python dictionaries

2015-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2870: --- Target Version/s: 1.5.0 (was: 1.4.0) > Thorough schema inference directly on RDDs of Python dictionar

[jira] [Resolved] (SPARK-6924) driver hangs when net is broken

2015-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6924. -- Resolution: Won't Fix Roughly "WontFix" given the PR discussion > driver hangs when net is broken > ---

[jira] [Resolved] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

2015-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6464. -- Resolution: Won't Fix > Add a new transformation of rdd named processCoalesce which was particularly >

[jira] [Resolved] (SPARK-6584) Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of partition's executor location.

2015-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6584. -- Resolution: Won't Fix > Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of > p

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

2015-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537339#comment-14537339 ] Sean Owen commented on SPARK-7504: -- {{SparkContext}} isn't an API for launching a Spark a

[jira] [Commented] (SPARK-7439) Should delete temporary local directories

2015-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537350#comment-14537350 ] Sean Owen commented on SPARK-7439: -- I expect these won't be removed if the JVM fails abru

[jira] [Resolved] (SPARK-7431) PySpark CrossValidatorModel needs to call parent init

2015-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7431. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5968 [https

[jira] [Resolved] (SPARK-7513) Spark connecting cassandra throws NotSerialization error

2015-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7513. -- Resolution: Invalid This is not a Spark class. The problem is simply that it needs to be made serializa

[jira] [Resolved] (SPARK-5521) PCA wrapper for easy transform vectors

2015-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5521. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4304 [https

[jira] [Commented] (SPARK-7439) Should delete temporary local directories

2015-05-10 Thread Prasanna Gautam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537359#comment-14537359 ] Prasanna Gautam commented on SPARK-7439: Ok, that makes sense to me. I think the i

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

2015-05-10 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537369#comment-14537369 ] Zoltán Zvara commented on SPARK-7504: - {{SparkContext}} can be easily configured to op

[jira] [Created] (SPARK-7518) Tests for comparing probability and prediction in binary logistic regression against R

2015-05-10 Thread DB Tsai (JIRA)
DB Tsai created SPARK-7518: -- Summary: Tests for comparing probability and prediction in binary logistic regression against R Key: SPARK-7518 URL: https://issues.apache.org/jira/browse/SPARK-7518 Project: Spa

[jira] [Commented] (SPARK-7518) Tests for comparing probability and prediction in binary logistic regression against R

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537465#comment-14537465 ] Apache Spark commented on SPARK-7518: - User 'dbtsai' has created a pull request for th

[jira] [Assigned] (SPARK-7518) Tests for comparing probability and prediction in binary logistic regression against R

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7518: --- Assignee: (was: Apache Spark) > Tests for comparing probability and prediction in binary

[jira] [Assigned] (SPARK-7518) Tests for comparing probability and prediction in binary logistic regression against R

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7518: --- Assignee: Apache Spark > Tests for comparing probability and prediction in binary logistic re

[jira] [Commented] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537479#comment-14537479 ] Joseph K. Bradley commented on SPARK-7514: -- This looks useful. Just wondering, h

[jira] [Assigned] (SPARK-7496) Update Programming guide with Online LDA

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7496: --- Assignee: Apache Spark > Update Programming guide with Online LDA > -

[jira] [Commented] (SPARK-7496) Update Programming guide with Online LDA

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537480#comment-14537480 ] Apache Spark commented on SPARK-7496: - User 'hhbyyh' has created a pull request for th

[jira] [Assigned] (SPARK-7496) Update Programming guide with Online LDA

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7496: --- Assignee: (was: Apache Spark) > Update Programming guide with Online LDA > --

[jira] [Commented] (SPARK-7496) Update Programming guide with Online LDA

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537482#comment-14537482 ] yuhao yang commented on SPARK-7496: --- Thanks Joseph. PR sent. > Update Programming guide

[jira] [Comment Edited] (SPARK-7462) By default retain group by columns in aggregate

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537494#comment-14537494 ] Patrick Wendell edited comment on SPARK-7462 at 5/11/15 2:08 AM: ---

[jira] [Commented] (SPARK-7462) By default retain group by columns in aggregate

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537494#comment-14537494 ] Patrick Wendell commented on SPARK-7462: [~rxin] since this is a user facing chang

[jira] [Created] (SPARK-7519) There are some bugs in the new WebUI in thrift server

2015-05-10 Thread Yi Tian (JIRA)
Yi Tian created SPARK-7519: -- Summary: There are some bugs in the new WebUI in thrift server Key: SPARK-7519 URL: https://issues.apache.org/jira/browse/SPARK-7519 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7427. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6023 [https

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: (was: 1.4.0) > Publish nightly snapshots of documentation, maven artifacts

[jira] [Assigned] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1517: -- Assignee: Patrick Wendell > Publish nightly snapshots of documentation, maven artifacts

[jira] [Updated] (SPARK-7427) Make sharedParams match in Scala, Python

2015-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7427: - Assignee: Glenn Weidner > Make sharedParams match in Scala, Python > -

[jira] [Created] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7520: -- Summary: Install Jekyll On Jenkins Machines Key: SPARK-7520 URL: https://issues.apache.org/jira/browse/SPARK-7520 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7320) Add rollup and cube support to DataFrame DSL

2015-05-10 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537498#comment-14537498 ] Cheng Hao commented on SPARK-7320: -- After investigation, we need to refactor the GROUPING

[jira] [Resolved] (SPARK-7512) SparkR RDD show method doesn't work after transformations

2015-05-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7512. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 603

[jira] [Commented] (SPARK-7479) SparkR can not work

2015-05-10 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537503#comment-14537503 ] Weizhong commented on SPARK-7479: - OK. Thank you! > SparkR can not work > ---

[jira] [Commented] (SPARK-7393) How to improve Spark SQL performance?

2015-05-10 Thread Liang Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537504#comment-14537504 ] Liang Lee commented on SPARK-7393: -- Sorry, i will turn to mailing list. Thank you! > How

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537507#comment-14537507 ] shane knapp commented on SPARK-7520: yep, i'll get to that on monday. > Install Jekyl

[jira] [Commented] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-05-10 Thread Glenn Weidner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537508#comment-14537508 ] Glenn Weidner commented on SPARK-7425: -- Since this is a 'starter' and I'm still new,

[jira] [Updated] (SPARK-7519) There are some bugs in the new WebUI in thrift server

2015-05-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7519: -- Assignee: Yi Tian > There are some bugs in the new WebUI in thrift server >

[jira] [Created] (SPARK-7521) Allow all required release credentials to be specified with env vars

2015-05-10 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7521: -- Summary: Allow all required release credentials to be specified with env vars Key: SPARK-7521 URL: https://issues.apache.org/jira/browse/SPARK-7521 Project: Spark

[jira] [Commented] (SPARK-7514) Add MinMaxNormalizer to feature transformation

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537527#comment-14537527 ] yuhao yang commented on SPARK-7514: --- Hi Joseph, that a good idea. I did a simple google:

[jira] [Updated] (SPARK-7514) Add MinMaxScaler to feature transformation

2015-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-7514: -- Summary: Add MinMaxScaler to feature transformation (was: Add MinMaxNormalizer to feature transformatio

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537530#comment-14537530 ] Patrick Wendell commented on SPARK-7520: Sounds good - thanks man. This build will

[jira] [Assigned] (SPARK-7519) There are some bugs in the new WebUI in thrift server

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7519: --- Assignee: Apache Spark (was: Yi Tian) > There are some bugs in the new WebUI in thrift serve

[jira] [Assigned] (SPARK-7519) There are some bugs in the new WebUI in thrift server

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7519: --- Assignee: Yi Tian (was: Apache Spark) > There are some bugs in the new WebUI in thrift serve

[jira] [Commented] (SPARK-7519) There are some bugs in the new WebUI in thrift server

2015-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537531#comment-14537531 ] Apache Spark commented on SPARK-7519: - User 'tianyi' has created a pull request for th

[jira] [Commented] (SPARK-7423) spark.ml Classifier predict should not convert vectors to dense format

2015-05-10 Thread George Dittmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537539#comment-14537539 ] George Dittmar commented on SPARK-7423: --- I'd like to try to give this a whirl if no

  1   2   >