[jira] [Commented] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989091#comment-14989091 ] Yanbo Liang commented on SPARK-11478: - I have found the cause of this bug, but not fi

[jira] [Commented] (SPARK-11474) Options to jdbc load are lower cased

2015-11-04 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989094#comment-14989094 ] Huaxin Gao commented on SPARK-11474: Did PR https://github.com/apache/spark/pull/946

[jira] [Issue Comment Deleted] (SPARK-11478) ML StringIndexer return inconsistent schema

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11478: Comment: was deleted (was: I will try to find some clues.) > ML StringIndexer return inconsistent

[jira] [Commented] (SPARK-10656) select(df(*)) fails when a column has special characters

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989162#comment-14989162 ] Apache Spark commented on SPARK-10656: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11263: Assignee: (was: Apache Spark) > lintr Throws Warnings on Commented Code in Documentati

[jira] [Assigned] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11263: Assignee: Apache Spark > lintr Throws Warnings on Commented Code in Documentation > --

[jira] [Commented] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989174#comment-14989174 ] Apache Spark commented on SPARK-11263: -- User 'felixcheung' has created a pull reques

[jira] [Commented] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989203#comment-14989203 ] Sean Owen commented on SPARK-11500: --- Dumb question, but why does the ordering of column

[jira] [Commented] (SPARK-11484) Strange Spark UI issue when running on Oozie uber mode ON

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989211#comment-14989211 ] Sean Owen commented on SPARK-11484: --- Yeah, the PR is what I'm really looking for. I tho

[jira] [Commented] (SPARK-11494) Expose R-like summary statistics in SparkR::glm for linear regression

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989273#comment-14989273 ] Yanbo Liang commented on SPARK-11494: - I think we should support R-like summary stati

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2015-11-04 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989280#comment-14989280 ] Iulian Dragos commented on SPARK-11327: --- I think this is related to (possibly a dup

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989276#comment-14989276 ] Sean Owen commented on SPARK-11472: --- What would you like to see changed in the docs? th

[jira] [Comment Edited] (SPARK-11494) Expose R-like summary statistics in SparkR::glm for linear regression

2015-11-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989273#comment-14989273 ] Yanbo Liang edited comment on SPARK-11494 at 11/4/15 10:34 AM:

[jira] [Updated] (SPARK-2960) Spark executables fail to start via symlinks

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2960: - Assignee: Saisai Shao > Spark executables fail to start via symlinks > ---

[jira] [Resolved] (SPARK-2960) Spark executables fail to start via symlinks

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2960. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8669 [https://github.com/ap

[jira] [Resolved] (SPARK-11442) Reduce numSlices for local metrics test of SparkListenerSuite

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11442. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9384 [https://github.com

[jira] [Updated] (SPARK-11442) Reduce numSlices for local metrics test of SparkListenerSuite

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11442: -- Assignee: Ted Yu > Reduce numSlices for local metrics test of SparkListenerSuite >

[jira] [Comment Edited] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989325#comment-14989325 ] Hyukjin Kwon edited comment on SPARK-11500 at 11/4/15 10:54 AM: ---

[jira] [Commented] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989325#comment-14989325 ] Hyukjin Kwon commented on SPARK-11500: -- It is non-deterministic and also incorrect i

[jira] [Updated] (SPARK-11498) TreeNodeException under very special condition

2015-11-04 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-11498: Description: {code:title=/tmp/bug.py} from pyspark import SparkContext from pyspark.sql import SQLC

[jira] [Comment Edited] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989325#comment-14989325 ] Hyukjin Kwon edited comment on SPARK-11500 at 11/4/15 10:59 AM: ---

[jira] [Comment Edited] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989325#comment-14989325 ] Hyukjin Kwon edited comment on SPARK-11500 at 11/4/15 11:03 AM: ---

[jira] [Assigned] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10946: Assignee: Apache Spark > JDBC - Use Statement.executeUpdate instead of PreparedStatement.e

[jira] [Assigned] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10946: Assignee: (was: Apache Spark) > JDBC - Use Statement.executeUpdate instead of Prepared

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989353#comment-14989353 ] Apache Spark commented on SPARK-10946: -- User 'somideshmukh' has created a pull reque

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989356#comment-14989356 ] somil deshmukh commented on SPARK-10946: https://github.com/apache/spark/pull/946

[jira] [Commented] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989368#comment-14989368 ] Apache Spark commented on SPARK-11265: -- User 'steveloughran' has created a pull requ

[jira] [Commented] (SPARK-11476) Incorrect function referred to in MLib Random data generation documentation

2015-11-04 Thread Jason Blochowiak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989377#comment-14989377 ] Jason Blochowiak commented on SPARK-11476: -- My apologies - this stemmed from my

[jira] [Updated] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11265: -- Target Version/s: 1.5.3 Labels: backport-needed (was: ) > YarnClient can't get tokens to

[jira] [Updated] (SPARK-11477) support create Dataset from RDD

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11477: -- Assignee: Wenchen Fan > support create Dataset from RDD > --- > >

[jira] [Updated] (SPARK-11491) Use Scala 2.10.5

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11491: -- Priority: Minor (was: Major) Component/s: Spark Core > Use Scala 2.10.5 > > >

[jira] [Updated] (SPARK-11495) Fix potential socket / file handle leaks identified via static analysis

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11495: -- Component/s: Spark Core > Fix potential socket / file handle leaks identified via static analysis > ---

[jira] [Updated] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11499: -- Component/s: Web UI > Spark History Server UI should respect protocol when doing redirection >

[jira] [Updated] (SPARK-11278) PageRank fails with unified memory manager

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11278: -- Affects Version/s: (was: 1.5.2) (was: 1.6.0) 1.5.1

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989444#comment-14989444 ] Sean Owen commented on SPARK-11278: --- Oh, mea culpa [~nravi]. [~davies] set that. Is thi

[jira] [Updated] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10946: -- Target Version/s: (was: 1.6.0) > JDBC - Use Statement.executeUpdate instead of PreparedStatement.exec

[jira] [Resolved] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10975. --- Resolution: Fixed OK if it's resolved by the same change, I think it's close enough to call this res

[jira] [Updated] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10975: -- Target Version/s: (was: 1.6.0) Priority: Major (was: Blocker) > Shuffle files left behin

[jira] [Updated] (SPARK-6157) Unrolling with MEMORY_AND_DISK should always release memory

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6157: - Target Version/s: (was: 1.6.0) > Unrolling with MEMORY_AND_DISK should always release memory > -

[jira] [Updated] (SPARK-10588) Saving a DataFrame containing only nulls to JSON doesn't work

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10588: -- Target Version/s: (was: 1.6.0) > Saving a DataFrame containing only nulls to JSON doesn't work >

[jira] [Updated] (SPARK-10653) Remove unnecessary things from SparkEnv

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10653: -- Target Version/s: (was: 1.6.0) > Remove unnecessary things from SparkEnv > --

[jira] [Updated] (SPARK-8122) ParquetRelation.enableLogForwarding() may fail to configure loggers

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8122: - Target Version/s: (was: 1.6.0) > ParquetRelation.enableLogForwarding() may fail to configure loggers > -

[jira] [Updated] (SPARK-10864) SparkUI: app name is hidden if window is resized

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10864: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) Issue Type: Improve

[jira] [Updated] (SPARK-7016) Refactor dev/run-tests(-jenkins) from Bash to Python

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7016: - Target Version/s: (was: 1.6.0) > Refactor dev/run-tests(-jenkins) from Bash to Python >

[jira] [Commented] (SPARK-9110) Refactor dev/tests/* scripts into Python

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989458#comment-14989458 ] Sean Owen commented on SPARK-9110: -- Is this one likely to go forward? > Refactor dev/tes

[jira] [Updated] (SPARK-6517) Bisecting k-means clustering

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6517: - Target Version/s: (was: 1.6.0) Priority: Major (was: Critical) > Bisecting k-means clusteri

[jira] [Updated] (SPARK-4684) Add a script to run JDBC server on Windows

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4684: - Target Version/s: (was: 1.6.0) > Add a script to run JDBC server on Windows > --

[jira] [Updated] (SPARK-5571) LDA should handle text as well

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5571: - Target Version/s: (was: 1.6.0) > LDA should handle text as well > -- > >

[jira] [Updated] (SPARK-5535) Add parameter for storage levels.

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5535: - Target Version/s: (was: 1.6.0) > Add parameter for storage levels. > - >

[jira] [Updated] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3717: - Target Version/s: (was: 1.6.0) > DecisionTree, RandomForest: Partition by feature >

[jira] [Resolved] (SPARK-5787) Protect JVM from some not-important exceptions

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5787. -- Resolution: Won't Fix Target Version/s: (was: 1.6.0) I think this is stale or obsolete. > P

[jira] [Updated] (SPARK-6160) ChiSqSelector should keep test statistic info

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6160: - Target Version/s: (was: 1.6.0) > ChiSqSelector should keep test statistic info > ---

[jira] [Updated] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5992: - Target Version/s: (was: 1.6.0) > Locality Sensitive Hashing (LSH) for MLlib > --

[jira] [Updated] (SPARK-6682) Deprecate static train and use builder instead for Scala/Java

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6682: - Target Version/s: (was: 1.6.0) > Deprecate static train and use builder instead for Scala/Java > ---

[jira] [Updated] (SPARK-6685) Use DSYRK to compute AtA in ALS

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6685: - Target Version/s: (was: 1.6.0) > Use DSYRK to compute AtA in ALS > --- > >

[jira] [Updated] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1655: - Target Version/s: (was: 1.6.0) > In naive Bayes, store conditional probabilities distributively. > -

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3181: - Target Version/s: (was: 1.6.0) > Add Robust Regression Algorithm with Huber Estimator >

[jira] [Updated] (SPARK-3665) Java API for GraphX

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3665: - Target Version/s: (was: 1.6.0) I doubt this will ever happen right? > Java API for GraphX > ---

[jira] [Updated] (SPARK-4285) Transpose RDD[Vector] to column store for ML

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4285: - Target Version/s: (was: 1.6.0) > Transpose RDD[Vector] to column store for ML >

[jira] [Updated] (SPARK-4122) Add library to write data back to Kafka

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4122: - Target Version/s: (was: 1.6.0) Is this going to happen or should be closed? the PR hasn't been updated i

[jira] [Updated] (SPARK-5027) add SVMWithLBFGS interface in MLLIB

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5027: - Target Version/s: (was: 1.6.0) > add SVMWithLBFGS interface in MLLIB > -

[jira] [Updated] (SPARK-4980) Add decay factors to streaming linear methods

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4980: - Target Version/s: (was: 1.6.0) > Add decay factors to streaming linear methods > ---

[jira] [Commented] (SPARK-10420) Implementing Reactive Streams based Spark Streaming Receiver

2015-11-04 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989521#comment-14989521 ] Rodrigo Boavida commented on SPARK-10420: - Hi all, I've touched base about this w

[jira] [Commented] (SPARK-2629) Improved state management for Spark Streaming

2015-11-04 Thread Adrian Tanase (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989581#comment-14989581 ] Adrian Tanase commented on SPARK-2629: -- Great feature, thanks for driving it! I've le

[jira] [Commented] (SPARK-11197) Run SQL query on files directly without create a table

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989587#comment-14989587 ] Apache Spark commented on SPARK-11197: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-10978) Allow PrunedFilterScan to eliminate predicates from further evaluation

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989604#comment-14989604 ] Apache Spark commented on SPARK-10978: -- User 'liancheng' has created a pull request

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

2015-11-04 Thread Alex Slusarenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989638#comment-14989638 ] Alex Slusarenko commented on SPARK-1239: > How is this not a major issue for every

[jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env

2015-11-04 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11484: Description: Customer reported a strange UI when running spark application

[jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env

2015-11-04 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11484: Description: Customer reported a strange UI when running spark application

[jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env

2015-11-04 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11484: Description: Customer reported a strange UI when running spark application

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Darren Govoni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989807#comment-14989807 ] Darren Govoni commented on SPARK-3789: -- Because the ticket has been open for over a y

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-11-04 Thread Siddharth Sarda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989804#comment-14989804 ] Siddharth Sarda commented on SPARK-10474: - [~nadenf] What solved your isssue exac

[jira] [Comment Edited] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Darren Govoni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989807#comment-14989807 ] Darren Govoni edited comment on SPARK-3789 at 11/4/15 4:14 PM: -

[jira] [Resolved] (SPARK-9492) LogisticRegression in R should provide model statistics

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9492. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9303 [https://githu

[jira] [Resolved] (SPARK-11380) Replace example code in mllib-frequent-pattern-mining.md using include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11380. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9340 [https://gi

[jira] [Assigned] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10028: Assignee: Apache Spark > Add Python API for PrefixSpan > - > >

[jira] [Commented] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989849#comment-14989849 ] Apache Spark commented on SPARK-10028: -- User 'yu-iskw' has created a pull request fo

[jira] [Assigned] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10028: Assignee: (was: Apache Spark) > Add Python API for PrefixSpan > --

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Assignee: Xusen Yin > Blank lines should be reserved in include_example > -

[jira] [Updated] (SPARK-11380) Replace example code in mllib-frequent-pattern-mining.md using include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11380: -- Assignee: Pravin Gadakh > Replace example code in mllib-frequent-pattern-mining.md using includ

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Summary: Blank lines should be reserved in include_example (was: Blank line reserved include_e

[jira] [Resolved] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11443. --- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 9400 [https://gi

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Target Version/s: 1.6.0 > Blank lines should be reserved in include_example > -

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989855#comment-14989855 ] Sean Owen commented on SPARK-3789: -- [~sesshomurai] I'm more commenting on the lack of any

[jira] [Updated] (SPARK-11443) Blank lines should be reserved in include_example

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11443: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Blank lines should be reserved in in

[jira] [Updated] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10028: -- Shepherd: Xiangrui Meng Target Version/s: 1.6.0 > Add Python API for PrefixSpan > -

[jira] [Updated] (SPARK-10028) Add Python API for PrefixSpan

2015-11-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10028: -- Assignee: Yu Ishikawa > Add Python API for PrefixSpan > - > >

[jira] [Created] (SPARK-11502) Word2VecSuite needs appropriate checks

2015-11-04 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-11502: Summary: Word2VecSuite needs appropriate checks Key: SPARK-11502 URL: https://issues.apache.org/jira/browse/SPARK-11502 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-11502) Word2VecSuite needs appropriate checks

2015-11-04 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-11502: - Priority: Minor (was: Major) > Word2VecSuite needs appropriate checks >

[jira] [Commented] (SPARK-11502) Word2VecSuite needs appropriate checks

2015-11-04 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989916#comment-14989916 ] Imran Rashid commented on SPARK-11502: -- cc [~yinxusen] [~srowen] [~mengxr] > Word2V

[jira] [Resolved] (SPARK-10622) Race condition between scheduler and YARN executor status update

2015-11-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10622. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > Race cond

[jira] [Resolved] (SPARK-11235) Support streaming data using network library

2015-11-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11235. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > Support s

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Darren Govoni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989940#comment-14989940 ] Darren Govoni commented on SPARK-3789: -- I guess by that logic why does GraphX even ex

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-11-04 Thread Jacob Wellington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989956#comment-14989956 ] Jacob Wellington commented on SPARK-10474: -- I can report that pr 9241 solved my

[jira] [Resolved] (SPARK-11485) Make DataFrameHolder and DatasetHolder public

2015-11-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11485. - Resolution: Fixed Fix Version/s: 1.6.0 > Make DataFrameHolder and DatasetHolder public > -

[jira] [Resolved] (SPARK-11490) variance should alias var_samp instead of var_pop

2015-11-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11490. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9449 [https://github.com/a

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-04 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990006#comment-14990006 ] Glenn Strycker commented on SPARK-3789: --- I posted a similar question on stackoverflo

[jira] [Commented] (SPARK-4122) Add library to write data back to Kafka

2015-11-04 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990007#comment-14990007 ] Hari Shreedharan commented on SPARK-4122: - I kept it updated for a while and didn'

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

2015-11-04 Thread Pierre Beauvois (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990013#comment-14990013 ] Pierre Beauvois commented on SPARK-11472: - Thanks for the reply Sean. I'm going t

[jira] [Commented] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-11-04 Thread Neil Jonkers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990025#comment-14990025 ] Neil Jonkers commented on SPARK-5068: - We stil see this issue on Spark 1.5: hive can h

  1   2   3   >