[jira] [Commented] (SPARK-11473) R-like summary statistics with intercept for OLS via normal equation solver

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991022#comment-14991022 ] Apache Spark commented on SPARK-11473: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11473) R-like summary statistics with intercept for OLS via normal equation solver

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11473: Assignee: (was: Apache Spark) > R-like summary statistics with intercept for OLS via

[jira] [Assigned] (SPARK-11473) R-like summary statistics with intercept for OLS via normal equation solver

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11473: Assignee: Apache Spark > R-like summary statistics with intercept for OLS via normal

[jira] [Commented] (SPARK-10729) word2vec model save for python

2015-11-04 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991206#comment-14991206 ] Yu Ishikawa commented on SPARK-10729: - Sorry, the cause isn't `@inherit_doc`. I misunderstood.

[jira] [Assigned] (SPARK-11514) Pass random seed to spark.ml DecisionTree*

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11514: Assignee: Apache Spark (was: Yu Ishikawa) > Pass random seed to spark.ml DecisionTree* >

[jira] [Assigned] (SPARK-11514) Pass random seed to spark.ml DecisionTree*

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11514: Assignee: Yu Ishikawa (was: Apache Spark) > Pass random seed to spark.ml DecisionTree* >

[jira] [Commented] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991208#comment-14991208 ] Apache Spark commented on SPARK-2533: - User 'jbonofre' has created a pull request for this issue:

[jira] [Created] (SPARK-11520) RegressionMetrics should support instance weights

2015-11-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11520: - Summary: RegressionMetrics should support instance weights Key: SPARK-11520 URL: https://issues.apache.org/jira/browse/SPARK-11520 Project: Spark

[jira] [Assigned] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4557: --- Assignee: Apache Spark > Spark Streaming' foreachRDD method should accept a

[jira] [Assigned] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4557: --- Assignee: (was: Apache Spark) > Spark Streaming' foreachRDD method should accept a

[jira] [Commented] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991239#comment-14991239 ] Apache Spark commented on SPARK-4557: - User 'BryanCutler' has created a pull request for this issue:

[jira] [Created] (SPARK-11521) LinearRegressionSummary needs to clarify which metrics are weighted

2015-11-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11521: - Summary: LinearRegressionSummary needs to clarify which metrics are weighted Key: SPARK-11521 URL: https://issues.apache.org/jira/browse/SPARK-11521

[jira] [Updated] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11500: - Description: When executing {{sqlContext.read.option("mergeSchema", "true").parquet(pathOne,

[jira] [Resolved] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

2015-11-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11486. Resolution: Fixed Issue resolved by pull request 9383 [https://github.com/apache/spark/pull/9383]

[jira] [Resolved] (SPARK-11425) Improve hybrid aggregation (sort-based after hash-based)

2015-11-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11425. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9383

[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-04 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991258#comment-14991258 ] zhangxiongfei commented on SPARK-11475: --- Hi [~rekhajoshm] Thanks for pointing out my wrong Hive

[jira] [Commented] (SPARK-11507) Error thrown when using BlockMatrix.add

2015-11-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991261#comment-14991261 ] yuhao yang commented on SPARK-11507: Looking into it. Should be a bug. Breeze may remove the extra

[jira] [Comment Edited] (SPARK-11507) Error thrown when using BlockMatrix.add

2015-11-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991261#comment-14991261 ] yuhao yang edited comment on SPARK-11507 at 11/5/15 7:21 AM: - Looking into

[jira] [Created] (SPARK-11524) Support SparkR with Mesos cluster

2015-11-04 Thread Sun Rui (JIRA)
Sun Rui created SPARK-11524: --- Summary: Support SparkR with Mesos cluster Key: SPARK-11524 URL: https://issues.apache.org/jira/browse/SPARK-11524 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-11506) Code Optimization to remove a redundant operation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11506: Assignee: (was: Apache Spark) > Code Optimization to remove a redundant operation >

[jira] [Commented] (SPARK-11506) Code Optimization to remove a redundant operation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990270#comment-14990270 ] Apache Spark commented on SPARK-11506: -- User 'a1singh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11506) Code Optimization to remove a redundant operation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11506: Assignee: Apache Spark > Code Optimization to remove a redundant operation >

[jira] [Commented] (SPARK-11439) Optiomization of creating sparse feature without dense one

2015-11-04 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990273#comment-14990273 ] Nakul Jindal commented on SPARK-11439: -- Yes, this sounds good. Also, for the sake of uniformity, it

[jira] [Commented] (SPARK-11439) Optiomization of creating sparse feature without dense one

2015-11-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990283#comment-14990283 ] holdenk commented on SPARK-11439: - That sounds like a good plan - should be going through BLAS.scala

[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-04 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990310#comment-14990310 ] Rekha Joshi commented on SPARK-11475: - Great [~zhangxiongfei] Glad you do not have issue with

[jira] [Commented] (SPARK-11468) Add R API for stddev/variance

2015-11-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990180#comment-14990180 ] Felix Cheung commented on SPARK-11468: -- I'd like to take this if no one has started yet > Add R API

[jira] [Commented] (SPARK-11474) Options to jdbc load are lower cased

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990193#comment-14990193 ] Apache Spark commented on SPARK-11474: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11474) Options to jdbc load are lower cased

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11474: Assignee: (was: Apache Spark) > Options to jdbc load are lower cased >

[jira] [Assigned] (SPARK-10565) New /api/v1/[path] APIs don't contain as much information as original /json API

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10565: Assignee: (was: Apache Spark) > New /api/v1/[path] APIs don't contain as much

[jira] [Assigned] (SPARK-10565) New /api/v1/[path] APIs don't contain as much information as original /json API

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10565: Assignee: Apache Spark > New /api/v1/[path] APIs don't contain as much information as

[jira] [Assigned] (SPARK-11474) Options to jdbc load are lower cased

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11474: Assignee: Apache Spark > Options to jdbc load are lower cased >

[jira] [Commented] (SPARK-10565) New /api/v1/[path] APIs don't contain as much information as original /json API

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990195#comment-14990195 ] Apache Spark commented on SPARK-10565: -- User 'CharlesYeh' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-11-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11265. Resolution: Fixed Fix Version/s: 1.5.3 > YarnClient can't get tokens to talk to

[jira] [Commented] (SPARK-11439) Optiomization of creating sparse feature without dense one

2015-11-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990241#comment-14990241 ] holdenk commented on SPARK-11439: - So, at first look, I think this could still make sense, using

[jira] [Created] (SPARK-11506) Code Optimization to remove a redundant operation

2015-11-04 Thread Alok (JIRA)
Alok created SPARK-11506: Summary: Code Optimization to remove a redundant operation Key: SPARK-11506 URL: https://issues.apache.org/jira/browse/SPARK-11506 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10975. --- Resolution: Fixed OK if it's resolved by the same change, I think it's close enough to call this

[jira] [Updated] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10975: -- Target Version/s: (was: 1.6.0) Priority: Major (was: Blocker) > Shuffle files left

[jira] [Updated] (SPARK-4684) Add a script to run JDBC server on Windows

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4684: - Target Version/s: (was: 1.6.0) > Add a script to run JDBC server on Windows >

[jira] [Updated] (SPARK-5571) LDA should handle text as well

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5571: - Target Version/s: (was: 1.6.0) > LDA should handle text as well > -- > >

[jira] [Updated] (SPARK-5535) Add parameter for storage levels.

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5535: - Target Version/s: (was: 1.6.0) > Add parameter for storage levels. > -

[jira] [Updated] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3717: - Target Version/s: (was: 1.6.0) > DecisionTree, RandomForest: Partition by feature >

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3181: - Target Version/s: (was: 1.6.0) > Add Robust Regression Algorithm with Huber Estimator >

[jira] [Updated] (SPARK-3665) Java API for GraphX

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3665: - Target Version/s: (was: 1.6.0) I doubt this will ever happen right? > Java API for GraphX >

[jira] [Updated] (SPARK-4285) Transpose RDD[Vector] to column store for ML

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4285: - Target Version/s: (was: 1.6.0) > Transpose RDD[Vector] to column store for ML >

[jira] [Updated] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1655: - Target Version/s: (was: 1.6.0) > In naive Bayes, store conditional probabilities distributively. >

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

2015-11-04 Thread Alex Slusarenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989638#comment-14989638 ] Alex Slusarenko commented on SPARK-1239: > How is this not a major issue for everyone? Daniel, I

[jira] [Commented] (SPARK-11197) Run SQL query on files directly without create a table

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989587#comment-14989587 ] Apache Spark commented on SPARK-11197: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-10978) Allow PrunedFilterScan to eliminate predicates from further evaluation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989604#comment-14989604 ] Apache Spark commented on SPARK-10978: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11265: -- Target Version/s: 1.5.3 Labels: backport-needed (was: ) > YarnClient can't get tokens

[jira] [Updated] (SPARK-11477) support create Dataset from RDD

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11477: -- Assignee: Wenchen Fan > support create Dataset from RDD > --- > >

[jira] [Updated] (SPARK-11278) PageRank fails with unified memory manager

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11278: -- Affects Version/s: (was: 1.5.2) (was: 1.6.0)

[jira] [Updated] (SPARK-8122) ParquetRelation.enableLogForwarding() may fail to configure loggers

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8122: - Target Version/s: (was: 1.6.0) > ParquetRelation.enableLogForwarding() may fail to configure loggers >

[jira] [Updated] (SPARK-10864) SparkUI: app name is hidden if window is resized

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10864: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) Issue Type:

[jira] [Updated] (SPARK-6160) ChiSqSelector should keep test statistic info

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6160: - Target Version/s: (was: 1.6.0) > ChiSqSelector should keep test statistic info >

[jira] [Updated] (SPARK-6517) Bisecting k-means clustering

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6517: - Target Version/s: (was: 1.6.0) Priority: Major (was: Critical) > Bisecting k-means

[jira] [Commented] (SPARK-2629) Improved state management for Spark Streaming

2015-11-04 Thread Adrian Tanase (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989581#comment-14989581 ] Adrian Tanase commented on SPARK-2629: -- Great feature, thanks for driving it! I've left a few

[jira] [Commented] (SPARK-11476) Incorrect function referred to in MLib Random data generation documentation

2015-11-04 Thread Jason Blochowiak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989377#comment-14989377 ] Jason Blochowiak commented on SPARK-11476: -- My apologies - this stemmed from my misunderstanding

[jira] [Updated] (SPARK-11491) Use Scala 2.10.5

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11491: -- Priority: Minor (was: Major) Component/s: Spark Core > Use Scala 2.10.5 > > >

[jira] [Updated] (SPARK-11495) Fix potential socket / file handle leaks identified via static analysis

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11495: -- Component/s: Spark Core > Fix potential socket / file handle leaks identified via static analysis >

[jira] [Resolved] (SPARK-5787) Protect JVM from some not-important exceptions

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5787. -- Resolution: Won't Fix Target Version/s: (was: 1.6.0) I think this is stale or obsolete. >

[jira] [Commented] (SPARK-10420) Implementing Reactive Streams based Spark Streaming Receiver

2015-11-04 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989521#comment-14989521 ] Rodrigo Boavida commented on SPARK-10420: - Hi all, I've touched base about this with Luc, Julian

[jira] [Updated] (SPARK-10653) Remove unnecessary things from SparkEnv

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10653: -- Target Version/s: (was: 1.6.0) > Remove unnecessary things from SparkEnv >

[jira] [Updated] (SPARK-6157) Unrolling with MEMORY_AND_DISK should always release memory

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6157: - Target Version/s: (was: 1.6.0) > Unrolling with MEMORY_AND_DISK should always release memory >

[jira] [Updated] (SPARK-10588) Saving a DataFrame containing only nulls to JSON doesn't work

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10588: -- Target Version/s: (was: 1.6.0) > Saving a DataFrame containing only nulls to JSON doesn't work >

[jira] [Updated] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5992: - Target Version/s: (was: 1.6.0) > Locality Sensitive Hashing (LSH) for MLlib >

[jira] [Updated] (SPARK-6682) Deprecate static train and use builder instead for Scala/Java

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6682: - Target Version/s: (was: 1.6.0) > Deprecate static train and use builder instead for Scala/Java >

[jira] [Updated] (SPARK-6685) Use DSYRK to compute AtA in ALS

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6685: - Target Version/s: (was: 1.6.0) > Use DSYRK to compute AtA in ALS > --- > >

[jira] [Updated] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11499: -- Component/s: Web UI > Spark History Server UI should respect protocol when doing redirection >

[jira] [Updated] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10946: -- Target Version/s: (was: 1.6.0) > JDBC - Use Statement.executeUpdate instead of

[jira] [Updated] (SPARK-7016) Refactor dev/run-tests(-jenkins) from Bash to Python

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7016: - Target Version/s: (was: 1.6.0) > Refactor dev/run-tests(-jenkins) from Bash to Python >

[jira] [Commented] (SPARK-9110) Refactor dev/tests/* scripts into Python

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989458#comment-14989458 ] Sean Owen commented on SPARK-9110: -- Is this one likely to go forward? > Refactor dev/tests/* scripts

[jira] [Updated] (SPARK-4122) Add library to write data back to Kafka

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4122: - Target Version/s: (was: 1.6.0) Is this going to happen or should be closed? the PR hasn't been updated

[jira] [Updated] (SPARK-5027) add SVMWithLBFGS interface in MLLIB

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5027: - Target Version/s: (was: 1.6.0) > add SVMWithLBFGS interface in MLLIB >

[jira] [Updated] (SPARK-4980) Add decay factors to streaming linear methods

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4980: - Target Version/s: (was: 1.6.0) > Add decay factors to streaming linear methods >

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989855#comment-14989855 ] Sean Owen commented on SPARK-3789: -- [~sesshomurai] I'm more commenting on the lack of anyone stepping

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Blank lines should be reserved in

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Target Version/s: 1.6.0 > Blank lines should be reserved in include_example >

[jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env

2015-11-04 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11484: Description: Customer reported a strange UI when running spark application

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Summary: Blank lines should be reserved in include_example (was: Blank line reserved

[jira] [Updated] (SPARK-11380) Replace example code in mllib-frequent-pattern-mining.md using include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11380: -- Assignee: Pravin Gadakh > Replace example code in mllib-frequent-pattern-mining.md using

[jira] [Updated] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10028: -- Assignee: Yu Ishikawa > Add Python API for PrefixSpan > - > >

[jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env

2015-11-04 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11484: Description: Customer reported a strange UI when running spark application

[jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env

2015-11-04 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11484: Description: Customer reported a strange UI when running spark application

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Assignee: Xusen Yin > Blank lines should be reserved in include_example >

[jira] [Commented] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989849#comment-14989849 ] Apache Spark commented on SPARK-10028: -- User 'yu-iskw' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10028: Assignee: (was: Apache Spark) > Add Python API for PrefixSpan >

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Darren Govoni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989807#comment-14989807 ] Darren Govoni commented on SPARK-3789: -- Because the ticket has been open for over a year says nothing

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-11-04 Thread Siddharth Sarda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989804#comment-14989804 ] Siddharth Sarda commented on SPARK-10474: - [~nadenf] What solved your isssue exactly? I am still

[jira] [Comment Edited] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Darren Govoni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989807#comment-14989807 ] Darren Govoni edited comment on SPARK-3789 at 11/4/15 4:14 PM: --- Because the

[jira] [Resolved] (SPARK-9492) LogisticRegression in R should provide model statistics

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9492. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9303

[jira] [Assigned] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10028: Assignee: Apache Spark > Add Python API for PrefixSpan > - >

[jira] [Updated] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10028: -- Shepherd: Xiangrui Meng Target Version/s: 1.6.0 > Add Python API for PrefixSpan >

[jira] [Commented] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-11-04 Thread Neil Jonkers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990025#comment-14990025 ] Neil Jonkers commented on SPARK-5068: - We stil see this issue on Spark 1.5: hive can handle the

[jira] [Commented] (SPARK-11502) Word2VecSuite needs appropriate checks

2015-11-04 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989916#comment-14989916 ] Imran Rashid commented on SPARK-11502: -- cc [~yinxusen] [~srowen] [~mengxr] > Word2VecSuite needs

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Darren Govoni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989940#comment-14989940 ] Darren Govoni commented on SPARK-3789: -- I guess by that logic why does GraphX even exist? The issue

[jira] [Resolved] (SPARK-11485) Make DataFrameHolder and DatasetHolder public

2015-11-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11485. - Resolution: Fixed Fix Version/s: 1.6.0 > Make DataFrameHolder and DatasetHolder public >

[jira] [Created] (SPARK-11502) Word2VecSuite needs appropriate checks

2015-11-04 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-11502: Summary: Word2VecSuite needs appropriate checks Key: SPARK-11502 URL: https://issues.apache.org/jira/browse/SPARK-11502 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-10622) Race condition between scheduler and YARN executor status update

2015-11-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10622. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > Race

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-11-04 Thread Jacob Wellington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989956#comment-14989956 ] Jacob Wellington commented on SPARK-10474: -- I can report that pr 9241 solved my issue as well.

[jira] [Resolved] (SPARK-11490) variance should alias var_samp instead of var_pop

2015-11-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11490. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9449

<    1   2   3   >