[jira] [Updated] (SPARK-6280) Remove Akka systemName from Spark

2015-12-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6280: --- Assignee: Shixiong Zhu (was: Apache Spark) > Remove Akka systemName from Spark >

[jira] [Updated] (SPARK-7995) Remove AkkaRpcEnv and remove Akka from the dependencies of Core

2015-12-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7995: --- Assignee: Shixiong Zhu (was: Apache Spark) > Remove AkkaRpcEnv and remove Akka from the dependencies

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

2015-12-24 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070779#comment-15070779 ] yuhao yang commented on SPARK-12488: I cannot repro the issue even with empty vector

[jira] [Assigned] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12504: Assignee: Apache Spark > JDBC data source credentials are not masked in the data frame exp

[jira] [Updated] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11939: Issue Type: Umbrella (was: Sub-task) Parent: (was: SPARK-11937) > PySpark support mode

[jira] [Commented] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070816#comment-15070816 ] Yanbo Liang commented on SPARK-11939: - [~josephkb] I have implemented MLWriter/MLWrit

[jira] [Assigned] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11939: Assignee: (was: Apache Spark) > PySpark support model export/import for Pipeline API >

[jira] [Assigned] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11939: Assignee: Apache Spark > PySpark support model export/import for Pipeline API > --

[jira] [Commented] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

2015-12-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070822#comment-15070822 ] Takeshi Yamamuro commented on SPARK-5753: - [~rxin] This ticket should be closed be

[jira] [Commented] (SPARK-12391) JDBC OR operator push down

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070828#comment-15070828 ] Apache Spark commented on SPARK-12391: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070832#comment-15070832 ] Apache Spark commented on SPARK-12409: -- User 'viirya' has created a pull request for

[jira] [Resolved] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5753. -- Resolution: Duplicate > add basic support to JDBCRDD for postgresql types: uuid, hstore, and array > ---

[jira] [Commented] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070840#comment-15070840 ] Yanbo Liang commented on SPARK-12494: - [~anandr...@gmail.com] Can this issue be repro

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070840#comment-15070840 ] Yanbo Liang edited comment on SPARK-12494 at 12/24/15 10:14 AM: ---

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070840#comment-15070840 ] Yanbo Liang edited comment on SPARK-12494 at 12/24/15 10:15 AM: ---

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070844#comment-15070844 ] Yanbo Liang commented on SPARK-12461: - I can work on it. > Add ExpressionDescription

[jira] [Issue Comment Deleted] (SPARK-12461) Add ExpressionDescription to math functions

2015-12-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12461: Comment: was deleted (was: I can work on it.) > Add ExpressionDescription to math functions >

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

2015-12-24 Thread Furcy Pin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070862#comment-15070862 ] Furcy Pin commented on SPARK-9600: -- You are right that I forgot to wipe the metastore and

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070865#comment-15070865 ] Sean Owen commented on SPARK-12453: --- It should fix it. The way you can tell is to run {

[jira] [Commented] (SPARK-12426) Docker JDBC integration tests are failing again

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070882#comment-15070882 ] Sean Owen commented on SPARK-12426: --- Hm, I get this on OSX now, or I did once. This alw

[jira] [Created] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-24 Thread yaron weinsberg (JIRA)
yaron weinsberg created SPARK-12517: --- Summary: No default RDD name for ones created by sc.textFile Key: SPARK-12517 URL: https://issues.apache.org/jira/browse/SPARK-12517 Project: Spark Is

[jira] [Assigned] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12517: Assignee: (was: Apache Spark) > No default RDD name for ones created by sc.textFile >

[jira] [Assigned] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12517: Assignee: Apache Spark > No default RDD name for ones created by sc.textFile > --

[jira] [Commented] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-12-24 Thread Daniel Haviv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070905#comment-15070905 ] Daniel Haviv commented on SPARK-10481: -- Is there a workaround that can be used to ov

[jira] [Commented] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-12-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070914#comment-15070914 ] Jeff Zhang commented on SPARK-10481: Where do you use SPARK_PREPEND_CLASSES ? It is o

[jira] [Created] (SPARK-12518) Problem in Spark deserialize

2015-12-24 Thread Zhanpeng Wu (JIRA)
Zhanpeng Wu created SPARK-12518: --- Summary: Problem in Spark deserialize Key: SPARK-12518 URL: https://issues.apache.org/jira/browse/SPARK-12518 Project: Spark Issue Type: Question Com

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

2015-12-24 Thread Zhanpeng Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used htsjdk > Problem in Spark deserialize > > >

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

2015-12-24 Thread Zhanpeng Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used [htsjdk|https://github.com/samtools/htsjdk] in my Spark application, I fou

[jira] [Updated] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12136: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > rddToFil

[jira] [Updated] (SPARK-12146) SparkR jsonFile should support multiple input files

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12146: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > SparkR j

[jira] [Updated] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12093: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Fix the

[jira] [Updated] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12088: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > check co

[jira] [Updated] (SPARK-11824) WebUI throws console error for descriptions with 'bad' HTML

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11824: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > WebUI th

[jira] [Updated] (SPARK-11774) Implement "struct", "encode","decode" in SparkR

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11774: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Implemen

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12324: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > The docu

[jira] [Updated] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12000: -- Fix Version/s: (was: 1.6.1) 1.6.0 > `sbt publishLocal` hits a Scala compiler bug

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12395: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Result o

[jira] [Updated] (SPARK-12103) Clarify documentation of KafkaUtils createStream with multiple topics

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12103: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Clarify

[jira] [Updated] (SPARK-12109) Expressions's simpleString should delegate to its toString

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12109: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Expressi

[jira] [Updated] (SPARK-10259) Add @Since annotation to ml.classification

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10259: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Add @Since annotation to ml.classification >

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12019: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > SparkR.i

[jira] [Updated] (SPARK-11964) Create user guide section explaining export/import

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11964: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Create u

[jira] [Updated] (SPARK-9886) Validate usages of Runtime.getRuntime.addShutdownHook

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9886: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Validate us

[jira] [Updated] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11551: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Replace example code in ml-features.md using

[jira] [Updated] (SPARK-12466) Harmless Master NPE in tests

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12466: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Harmless

[jira] [Updated] (SPARK-11608) ML 1.6 QA: Programming guide update and migration guide

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11608: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > ML 1.6 Q

[jira] [Updated] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12275: -- Fix Version/s: (was: 1.6.1) (was: 1.5.3) (was: 2.0.0)

[jira] [Updated] (SPARK-12298) Infinite loop in DataFrame.sortWithinPartitions(String, String*)

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12298: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Infinite

[jira] [Updated] (SPARK-6518) Add example code and user guide for bisecting k-means

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6518: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add example

[jira] [Updated] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12390: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Clean up

[jira] [Updated] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12160: -- Fix Version/s: (was: 1.6.1) (was: 1.5.3) 1.6.0 > spark.ml

[jira] [Updated] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11602: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > ML 1.6 Q

[jira] [Updated] (SPARK-11978) Move dataset_example.py to examples/ml and rename to dataframe_example.py

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11978: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Move dat

[jira] [Updated] (SPARK-10266) Add @Since annotation to ml.tuning

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10266: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Add @Since annotation to ml.tuning > ---

[jira] [Updated] (SPARK-11957) SQLTransformer docs are unclear about generality of SQL statements

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11957: -- Fix Version/s: (was: 1.6.1) 1.6.0 > SQLTransformer docs are unclear about genera

[jira] [Updated] (SPARK-11715) R support corr for Column Aggregration

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11715: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > R suppor

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12159: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add user

[jira] [Updated] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11497: -- Fix Version/s: (was: 1.6.1) (was: 1.5.3) (was: 2.0.0)

[jira] [Updated] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12048: -- Fix Version/s: (was: 1.6.1) (was: 1.5.3) (was: 2.0.0)

[jira] [Updated] (SPARK-10248) DAGSchedulerSuite should check there were no errors in EventProcessLoop

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10248: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > DAGSched

[jira] [Updated] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11605: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > ML 1.6 Q

[jira] [Updated] (SPARK-11958) Create user guide section for SQLTransformer

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11958: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Create user guide section for SQLTransformer

[jira] [Updated] (SPARK-12364) Add ML example for SparkR

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12364: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add ML e

[jira] [Updated] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10477: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > using DS

[jira] [Updated] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12082: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > NettyBlo

[jira] [Updated] (SPARK-12057) Prevent failure on corrupt JSON records

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12057: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Prevent

[jira] [Updated] (SPARK-10299) word2vec should allow users to specify the window size

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10299: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > word2vec

[jira] [Updated] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12158: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > [R] [SQL

[jira] [Updated] (SPARK-12380) MLLib should use existing SQLContext instead create new one

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12380: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > MLLib sh

[jira] [Updated] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11193: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Spark 1.

[jira] [Updated] (SPARK-12166) Unset hadoop related environment in testing

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12166: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Unset ha

[jira] [Updated] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12104: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > collect(

[jira] [Updated] (SPARK-12310) Add write.json and write.parquet for SparkR

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12310: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add writ

[jira] [Updated] (SPARK-12107) Update spark-ec2 versions

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12107: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Update s

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9972: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add `struct

[jira] [Updated] (SPARK-12217) Document invalid handling for StringIndexer

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12217: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Document

[jira] [Updated] (SPARK-12199) Follow-up: Refine example code in ml-features.md

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12199: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Follow-u

[jira] [Updated] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12056: -- Fix Version/s: (was: 1.6.1) 1.6.0 > NewHadoopRDD: TaskAttemptContext should be c

[jira] [Updated] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12062: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Master r

[jira] [Updated] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12115: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Change n

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12031: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Integer

[jira] [Updated] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12186: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > stage we

[jira] [Updated] (SPARK-12215) User guide section for KMeans in spark.ml

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12215: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > User gui

[jira] [Updated] (SPARK-12044) Fix usage of isnan, isNaN

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12044: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Fix usag

[jira] [Updated] (SPARK-12212) Clarify the distinction between spark.mllib and spark.ml

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12212: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Clarify

[jira] [Updated] (SPARK-12211) Incorrect version number in graphx doc for migration from 1.1

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12211: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Incorrec

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

2015-12-24 Thread Zhanpeng Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used [htsjdk|https://github.com/samtools/htsjdk] in my Spark application, I fo

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

2015-12-24 Thread Zhanpeng Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used [htsjdk|https://github.com/samtools/htsjdk] in my Spark application, I fo

[jira] [Resolved] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

2015-12-24 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12502. Resolution: Fixed Target Version/s: 1.6.0, 2.0.0 > Script /dev/run-tests fails wh

[jira] [Updated] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

2015-12-24 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12502: --- Assignee: Kazuaki Ishizaki > Script /dev/run-tests fails when IBM Java is used >

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

2015-12-24 Thread Zhanpeng Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Environment: Linux Red Hat 4.8.2-16, Java 8, htsjdk-1.130 > Problem in Spark deserialize >

[jira] [Updated] (SPARK-12518) Problem in Spark deserialization with htsjdk BAMRecordCodec

2015-12-24 Thread Zhanpeng Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Summary: Problem in Spark deserialization with htsjdk BAMRecordCodec (was: Problem in Spark deseri

[jira] [Updated] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12502: -- Target Version/s: (was: 1.6.0, 2.0.0) Fix Version/s: 2.0.0 1.6.1 > Scrip

[jira] [Updated] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12104: -- Fix Version/s: 2.0.0 > collect() does not handle multiple columns with same name >

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9972: - Fix Version/s: 2.0.0 > Add `struct`, `encode` and `decode` function in SparkR > --

[jira] [Updated] (SPARK-12217) Document invalid handling for StringIndexer

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12217: -- Fix Version/s: 2.0.0 > Document invalid handling for StringIndexer > --

[jira] [Updated] (SPARK-12310) Add write.json and write.parquet for SparkR

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12310: -- Fix Version/s: 2.0.0 > Add write.json and write.parquet for SparkR > --

[jira] [Updated] (SPARK-12212) Clarify the distinction between spark.mllib and spark.ml

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12212: -- Fix Version/s: 2.0.0 > Clarify the distinction between spark.mllib and spark.ml > -

[jira] [Updated] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12186: -- Fix Version/s: 2.0.0 > stage web URI will redirect to the wrong location if it is the first URI from >

[jira] [Updated] (SPARK-12215) User guide section for KMeans in spark.ml

2015-12-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12215: -- Fix Version/s: 2.0.0 > User guide section for KMeans in spark.ml >

  1   2   3   >