[jira] [Updated] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9496: --- Fix Version/s: 1.4.2 > Do not print password in Hive Config > > >

[jira] [Resolved] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9496. Resolution: Fixed Assignee: Tao Wang Fix Version/s: 1.5.0 > Do not print password in

[jira] [Updated] (SPARK-9502) ArrayTypes incorrect for DataFrames Java API

2015-07-30 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-9502: --- Description: With upgrade to 1.4.1 array types for DataFrames were different in our java applications. I have

[jira] [Created] (SPARK-9502) ArrayTypes incorrect for DataFrames Java API

2015-07-30 Thread Kuldeep (JIRA)
Kuldeep created SPARK-9502: -- Summary: ArrayTypes incorrect for DataFrames Java API Key: SPARK-9502 URL: https://issues.apache.org/jira/browse/SPARK-9502 Project: Spark Issue Type: Bug Comp

[jira] [Created] (SPARK-9501) Encryption on RDDs or in-memory/cache on Apache Spark

2015-07-30 Thread Matthew O'Reilly (JIRA)
Matthew O'Reilly created SPARK-9501: --- Summary: Encryption on RDDs or in-memory/cache on Apache Spark Key: SPARK-9501 URL: https://issues.apache.org/jira/browse/SPARK-9501 Project: Spark Iss

[jira] [Commented] (SPARK-9500) Add TernaryExpression to simplify implementations

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648813#comment-14648813 ] Apache Spark commented on SPARK-9500: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-9500) Add TernaryExpression to simplify implementations

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9500: --- Assignee: Davies Liu (was: Apache Spark) > Add TernaryExpression to simplify implementations

[jira] [Assigned] (SPARK-9500) Add TernaryExpression to simplify implementations

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9500: --- Assignee: Apache Spark (was: Davies Liu) > Add TernaryExpression to simplify implementations

[jira] [Created] (SPARK-9500) Add TernaryExpression to simplify implementations

2015-07-30 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9500: - Summary: Add TernaryExpression to simplify implementations Key: SPARK-9500 URL: https://issues.apache.org/jira/browse/SPARK-9500 Project: Spark Issue Type: Sub-tas

[jira] [Resolved] (SPARK-9152) Implement code generation for Like and RLike

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9152. Resolution: Fixed Fix Version/s: 1.5.0 > Implement code generation for Like and RLike > -

[jira] [Resolved] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9214. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7568 [https

[jira] [Resolved] (SPARK-7690) MulticlassClassificationEvaluator for tuning Multiclass Classifiers

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7690. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7475 [https

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648744#comment-14648744 ] Reynold Xin commented on SPARK-8850: [~hvanhovell] I created https://issues.apache.org

[jira] [Updated] (SPARK-9499) Possible file handle leak in spilling/sort code

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9499: --- Assignee: Josh Rosen > Possible file handle leak in spilling/sort code > -

[jira] [Created] (SPARK-9499) Possible file handle leak in spilling/sort code

2015-07-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9499: -- Summary: Possible file handle leak in spilling/sort code Key: SPARK-9499 URL: https://issues.apache.org/jira/browse/SPARK-9499 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9499) Possible file handle leak in spilling/sort code

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9499: --- Priority: Blocker (was: Critical) > Possible file handle leak in spilling/sort code > ---

[jira] [Updated] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-8850: - Attachment: open Dump of all open files after a {{Too Many Files Open}} error. The comman

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648737#comment-14648737 ] Kay Ousterhout commented on SPARK-9497: --- A bunch of thoughts here: The oldest failu

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648729#comment-14648729 ] Reynold Xin commented on SPARK-8850: Can you do a lsof to see what's open? The possibl

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648727#comment-14648727 ] Kay Ousterhout commented on SPARK-9497: --- It looks like this has failed much longer a

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648725#comment-14648725 ] Yin Huai commented on SPARK-9497: - It started to fail about 2 to 3 days ago. Its history o

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648721#comment-14648721 ] Kay Ousterhout commented on SPARK-9497: --- When did you start seeing these failures?

[jira] [Commented] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648715#comment-14648715 ] Yin Huai commented on SPARK-9482: - Seems the failed query is {{select a.key from t3 a left

[jira] [Comment Edited] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648715#comment-14648715 ] Yin Huai edited comment on SPARK-9482 at 7/31/15 4:00 AM: -- Seems

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648714#comment-14648714 ] Herman van Hovell commented on SPARK-8850: -- Hi, I am getting a Too many open fil

[jira] [Updated] (SPARK-9497) Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9497: Labels: flaky-test (was: ) > Flaky test: DistributedSuite failed after the test of "repeatedly failing > t

[jira] [Created] (SPARK-9498) Some statistical information missed when the driver is out of the cluster

2015-07-30 Thread Liang Lee (JIRA)
Liang Lee created SPARK-9498: Summary: Some statistical information missed when the driver is out of the cluster Key: SPARK-9498 URL: https://issues.apache.org/jira/browse/SPARK-9498 Project: Spark

[jira] [Commented] (SPARK-8486) SIFT Feature Transformer

2015-07-30 Thread K S Sreenivasa Raghavan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648712#comment-14648712 ] K S Sreenivasa Raghavan commented on SPARK-8486: Hello, I am

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2015-07-30 Thread K S Sreenivasa Raghavan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648711#comment-14648711 ] K S Sreenivasa Raghavan commented on SPARK-7129: Hello, I am new

[jira] [Updated] (SPARK-9497) Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9497: Summary: Flaky test: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM" (

[jira] [Created] (SPARK-9497) DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9497: --- Summary: DistributedSuite failed after the test of "repeatedly failing task that crashes JVM" Key: SPARK-9497 URL: https://issues.apache.org/jira/browse/SPARK-9497 Project: Spa

[jira] [Commented] (SPARK-9497) DistributedSuite failed after the test of "repeatedly failing task that crashes JVM"

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648710#comment-14648710 ] Yin Huai commented on SPARK-9497: - [~kayousterhout] Seems you added "repeatedly failing ta

[jira] [Assigned] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9496: --- Assignee: (was: Apache Spark) > Do not print password in Hive Config > --

[jira] [Commented] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648705#comment-14648705 ] Apache Spark commented on SPARK-9496: - User 'WangTaoTheTonic' has created a pull reque

[jira] [Assigned] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9496: --- Assignee: Apache Spark > Do not print password in Hive Config > -

[jira] [Created] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Tao Wang (JIRA)
Tao Wang created SPARK-9496: --- Summary: Do not print password in Hive Config Key: SPARK-9496 URL: https://issues.apache.org/jira/browse/SPARK-9496 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-9405) approximateCountDiscting does not work with GroupBy

2015-07-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648694#comment-14648694 ] Michael Armbrust commented on SPARK-9405: - You can't use {{*}} in a count distinct

[jira] [Commented] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-30 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648680#comment-14648680 ] Konstantin Shaposhnikov commented on SPARK-8819: [MSHADE-148] has been fix

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-30 Thread Nam Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648656#comment-14648656 ] Nam Ma commented on SPARK-5133: --- Definitely, Joseph. Please go ahead sending the PR. There a

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648651#comment-14648651 ] Apache Spark commented on SPARK-8064: - User 'marmbrus' has created a pull request for

[jira] [Resolved] (SPARK-8176) date/time function: to_date

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8176. Resolution: Fixed Fix Version/s: 1.5.0 > date/time function: to_date > --

[jira] [Resolved] (SPARK-8197) date/time function: trunc

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8197. Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 1.5.0 > date/time function: t

[jira] [Assigned] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9240: --- Assignee: Apache Spark > Hybrid aggregate operator using unsafe row > ---

[jira] [Assigned] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9240: --- Assignee: (was: Apache Spark) > Hybrid aggregate operator using unsafe row >

[jira] [Commented] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648621#comment-14648621 ] Apache Spark commented on SPARK-9240: - User 'yhuai' has created a pull request for thi

[jira] [Updated] (SPARK-9359) Support IntervalType for Parquet

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9359: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-9431 > Support IntervalType for Parquet

[jira] [Resolved] (SPARK-8943) CalendarIntervalType for time intervals

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8943. Resolution: Fixed Fix Version/s: 1.5.0 > CalendarIntervalType for time intervals > --

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648594#comment-14648594 ] Joseph K. Bradley commented on SPARK-5981: -- This issue was partly solved by [SPAR

[jira] [Updated] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5981: - Target Version/s: (was: 1.5.0) > pyspark ML models should support predict/transform on v

[jira] [Updated] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9490: - Target Version/s: 1.5.0 > MLlib evaluation metrics guide example python code uses deprecat

[jira] [Updated] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9490: - Description: The python examples in the evaluation metrics user guide (MLlib) use "print x

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648583#comment-14648583 ] Joseph K. Bradley commented on SPARK-5895: -- Comment copied from PR about design:

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648582#comment-14648582 ] Joseph K. Bradley commented on SPARK-5895: -- Actually, this sounds like stuff to h

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648575#comment-14648575 ] Joseph K. Bradley commented on SPARK-5895: -- This sounds very useful, but I think

[jira] [Updated] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5895: - Shepherd: Joseph K. Bradley > Add VectorSlicer > > > Key:

[jira] [Updated] (SPARK-8169) Add StopWordsRemover as a transformer

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8169: - Shepherd: Xiangrui Meng > Add StopWordsRemover as a transformer >

[jira] [Commented] (SPARK-8271) string function: soundex

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648566#comment-14648566 ] Apache Spark commented on SPARK-8271: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648565#comment-14648565 ] Joseph K. Bradley commented on SPARK-5133: -- Yes, that's the approach I was planni

[jira] [Resolved] (SPARK-9472) Consistent hadoop config for streaming

2015-07-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9472. -- Resolution: Fixed Assignee: Cody Koeninger Fix Version/s: 1.5.0 > Consistent had

[jira] [Resolved] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9489. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7807 [https://github.com/

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-30 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648552#comment-14648552 ] Jeremy Freeman commented on SPARK-9461: --- Ah, great to hear! > Possibly slightly fla

[jira] [Resolved] (SPARK-9077) Improve error message for decision trees when numExamples < maxCategoriesPerFeature

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9077. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7800 [https

[jira] [Updated] (SPARK-9077) Improve error message for decision trees when numExamples < maxCategoriesPerFeature

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9077: - Shepherd: Joseph K. Bradley Assignee: Sean Owen Target Version/s: 1

[jira] [Resolved] (SPARK-6319) DISTINCT doesn't work for binary type

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6319. Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 1.5.0 > DISTINCT doesn't

[jira] [Updated] (SPARK-6319) Should throw analysis exception when using binary type in groupby/join

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6319: --- Summary: Should throw analysis exception when using binary type in groupby/join (was: DISTINCT doesn'

[jira] [Created] (SPARK-9495) Support prefix generation for date / timestamp data type

2015-07-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9495: -- Summary: Support prefix generation for date / timestamp data type Key: SPARK-9495 URL: https://issues.apache.org/jira/browse/SPARK-9495 Project: Spark Issue Type

[jira] [Resolved] (SPARK-9425) Support DecimalType in UnsafeRow

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9425. Resolution: Fixed Fix Version/s: 1.5.0 > Support DecimalType in UnsafeRow > -

[jira] [Resolved] (SPARK-9469) TungstenSort should not do safe -> unsafe conversion itself

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9469. Resolution: Fixed Fix Version/s: 1.5.0 > TungstenSort should not do safe -> unsafe conversion

[jira] [Resolved] (SPARK-9458) Avoid object allocation in prefix generation

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9458. Resolution: Fixed > Avoid object allocation in prefix generation > -

[jira] [Resolved] (SPARK-7157) Add approximate stratified sampling to DataFrame

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7157. Resolution: Fixed Fix Version/s: 1.5.0 > Add approximate stratified sampling to DataFrame > -

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648543#comment-14648543 ] Joseph K. Bradley commented on SPARK-9461: -- Increasing time-out sounds expensive.

[jira] [Resolved] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9408. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7746 [https://githu

[jira] [Updated] (SPARK-9494) {{spark-ec2 launch}} fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Summary: {{spark-ec2 launch}} fails with anaconda python 3.4 (was: `spark-ec2 launch` fails with anac

[jira] [Comment Edited] (SPARK-9494) 'spark-ec2 launch' fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648513#comment-14648513 ] Stuart Owen edited comment on SPARK-9494 at 7/30/15 11:48 PM: --

[jira] [Updated] (SPARK-9494) 'spark-ec2 launch' fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Summary: 'spark-ec2 launch' fails with anaconda python 3.4 (was: {{spark-ec2 launch}} fails with anac

[jira] [Updated] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Description: Command I used to launch: {code:none} $SPARK_HOME/ec2/spark-ec2 \ -k spark \ -i

[jira] [Commented] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648513#comment-14648513 ] Stuart Owen commented on SPARK-9494: Have not observed any other `spark-ec2` commands

[jira] [Updated] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Description: Command I used to launch: {code:bash} $SPARK_HOME/ec2/spark-ec2 \ -k spark \ -i

[jira] [Updated] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9246: - Assignee: Meihua Wu > DistributedLDAModel predict top docs per topic > ---

[jira] [Created] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
Stuart Owen created SPARK-9494: -- Summary: `spark-ec2 launch` fails with anaconda python 3.4 Key: SPARK-9494 URL: https://issues.apache.org/jira/browse/SPARK-9494 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-9199) Upgrade Tachyon dependency to 0.7.0

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9199. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7577 [https://github.com/

[jira] [Updated] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8742: - Assignee: Hossein Falaki > Improve SparkR error messages for DataFrame API > -

[jira] [Resolved] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8742. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 774

[jira] [Resolved] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9463. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7771 [https://githu

[jira] [Assigned] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9491: --- Assignee: Apache Spark > App running on secure YARN with no HBase config will hang >

[jira] [Assigned] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9491: --- Assignee: (was: Apache Spark) > App running on secure YARN with no HBase config will hang

[jira] [Commented] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648453#comment-14648453 ] Apache Spark commented on SPARK-9491: - User 'vanzin' has created a pull request for th

[jira] [Updated] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9214: - Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target Version/s:

[jira] [Resolved] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6684. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7804 [https

[jira] [Created] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-07-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9493: Summary: Chain logistic regression with isotonic regression under the pipeline API Key: SPARK-9493 URL: https://issues.apache.org/jira/browse/SPARK-9493 Project: Spar

[jira] [Created] (SPARK-9492) LogisticRegression should provide model statistics

2015-07-30 Thread Eric Liang (JIRA)
Eric Liang created SPARK-9492: - Summary: LogisticRegression should provide model statistics Key: SPARK-9492 URL: https://issues.apache.org/jira/browse/SPARK-9492 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-9491: - Summary: App running on secure YARN with no HBase config will hang Key: SPARK-9491 URL: https://issues.apache.org/jira/browse/SPARK-9491 Project: Spark Iss

[jira] [Updated] (SPARK-8671) Add isotonic regression to the pipeline API

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8671: - Assignee: Martin Zapletal > Add isotonic regression to the pipeline API >

[jira] [Resolved] (SPARK-8671) Add isotonic regression to the pipeline API

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8671. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7517 [https://githu

[jira] [Created] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

2015-07-30 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-9490: --- Summary: MLlib evaluation metrics guide example python code uses deprecated print statement Key: SPARK-9490 URL: https://issues.apache.org/jira/browse/SPARK-9490

[jira] [Resolved] (SPARK-9479) ReceiverTrackerSuite fails for maven build

2015-07-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9479. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 > ReceiverTrackerS

[jira] [Commented] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648410#comment-14648410 ] Apache Spark commented on SPARK-8416: - User 'CodingCat' has created a pull request for

[jira] [Assigned] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8416: --- Assignee: (was: Apache Spark) > Thread dump page should highlight Spark executor threads

[jira] [Assigned] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8416: --- Assignee: Apache Spark > Thread dump page should highlight Spark executor threads > -

[jira] [Assigned] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9489: --- Assignee: Josh Rosen (was: Apache Spark) > Remove compatibleWith, meetsRequirements, and nee

  1   2   3   >