[jira] [Commented] (SPARK-12522) Add the missing the document string for the SQL configuration

[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071278#comment-15071278 ] Apache Spark commented on SPARK-12522: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071347#comment-15071347 ] Xiu (Joe) Guo commented on SPARK-12521: --- In 1.5.2 {code}sqlContext.load(){code} is deprecated, but

[jira] [Updated] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-12316: - Attachment: 20151210045533.jpg 20151210045149.jpg > Stack overflow with endless

[jira] [Updated] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12516: Description: Failure of NodeManager will make all the executors belong to that NM exit silently.

[jira] [Created] (SPARK-12522) Add the missing the document string for the SQL configuration

Xiao Li created SPARK-12522: --- Summary: Add the missing the document string for the SQL configuration Key: SPARK-12522 URL: https://issues.apache.org/jira/browse/SPARK-12522 Project: Spark Issue

[jira] [Commented] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071399#comment-15071399 ] Apache Spark commented on SPARK-12316: -- User 'SaintBacchus' has created a pull request for this

[jira] [Assigned] (SPARK-12522) Add the missing the document string for the SQL configuration

[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12522: Assignee: (was: Apache Spark) > Add the missing the document string for the SQL

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: Apache Spark > DataFrame Partitions in java does not work >

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: (was: Apache Spark) > DataFrame Partitions in java does not work >

[jira] [Assigned] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12316: Assignee: (was: Apache Spark) > Stack overflow with endless call of `Delegation token

[jira] [Updated] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12516: Description: Failure of NodeManager will make all the executors belong to that NM exit silently.

[jira] [Commented] (SPARK-8855) Python API for Association Rules

[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071263#comment-15071263 ] Caique Rodrigues Marques commented on SPARK-8855: - I tried to implement, in the last days,

[jira] [Assigned] (SPARK-9716) BinaryClassificationEvaluator should accept Double prediction column

[ https://issues.apache.org/jira/browse/SPARK-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9716: --- Assignee: (was: Apache Spark) > BinaryClassificationEvaluator should accept Double

[jira] [Assigned] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12316: Assignee: Apache Spark > Stack overflow with endless call of `Delegation token thread`

[jira] [Assigned] (SPARK-9716) BinaryClassificationEvaluator should accept Double prediction column

[ https://issues.apache.org/jira/browse/SPARK-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9716: --- Assignee: Apache Spark > BinaryClassificationEvaluator should accept Double prediction

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071354#comment-15071354 ] Zhang, Liye commented on SPARK-12196: - I am out of office with limited email access from 12/21/2015

[jira] [Updated] (SPARK-12447) Only update AM's internal state when executor is successfully launched by NM

[ https://issues.apache.org/jira/browse/SPARK-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12447: Description: Currently {{YarnAllocator}} will update its managed states like

[jira] [Assigned] (SPARK-12522) Add the missing the document string for the SQL configuration

[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12522: Assignee: Apache Spark > Add the missing the document string for the SQL configuration >

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: Apache Spark > DataFrame Partitions in java does not work >

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: (was: Apache Spark) > DataFrame Partitions in java does not work >

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071294#comment-15071294 ] Apache Spark commented on SPARK-12504: -- User 'sureshthalamati' has created a pull request for this

[jira] [Updated] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Summary: Store blocks in different speed storage devices by hierarchy way (was: Store blocks in storage

[jira] [Commented] (SPARK-12375) VectorIndexer: allow unknown categories

[ https://issues.apache.org/jira/browse/SPARK-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071370#comment-15071370 ] yuhao yang commented on SPARK-12375: PR here, https://github.com/apache/spark/pull/10466 >

[jira] [Assigned] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12436: Assignee: (was: Apache Spark) > If all values of a JSON field is null, JSON's

[jira] [Assigned] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12436: Assignee: Apache Spark > If all values of a JSON field is null, JSON's inferSchema should

[jira] [Updated] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

[ https://issues.apache.org/jira/browse/SPARK-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12509: -- Description: Currently, when we call corr or cov on dataframe with invalid input we

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071157#comment-15071157 ] Martin Schade commented on SPARK-12453: --- I can confirm that removing the dependency works as well.

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071141#comment-15071141 ] Xiao Li commented on SPARK-12461: - It sounds like nobody is taking this one. I can do it. > Add

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071142#comment-15071142 ] Kai Jiang commented on SPARK-12461: --- I may want take this one. Could I do it? > Add

[jira] [Comment Edited] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071142#comment-15071142 ] Kai Jiang edited comment on SPARK-12461 at 12/24/15 5:17 PM: - I may want take

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071153#comment-15071153 ] Xiao Li commented on SPARK-12461: - Sure. To verify your changes, please run ./bin/spark-sql and describe

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071161#comment-15071161 ] Kai Jiang commented on SPARK-12461: --- Okay, i will try this one and PR later. > Add

[jira] [Updated] (SPARK-7995) Remove AkkaRpcEnv and remove Akka from the dependencies of Core

[ https://issues.apache.org/jira/browse/SPARK-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7995: --- Assignee: Shixiong Zhu (was: Apache Spark) > Remove AkkaRpcEnv and remove Akka from the dependencies

[jira] [Updated] (SPARK-6280) Remove Akka systemName from Spark

[ https://issues.apache.org/jira/browse/SPARK-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6280: --- Assignee: Shixiong Zhu (was: Apache Spark) > Remove Akka systemName from Spark >

[jira] [Assigned] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12504: Assignee: Apache Spark > JDBC data source credentials are not masked in the data frame

[jira] [Commented] (SPARK-11939) PySpark support model export/import for Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070816#comment-15070816 ] Yanbo Liang commented on SPARK-11939: - [~josephkb] I have implemented

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070779#comment-15070779 ] yuhao yang commented on SPARK-12488: I cannot repro the issue even with empty vector in documents.

[jira] [Updated] (SPARK-11939) PySpark support model export/import for Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11939: Issue Type: Umbrella (was: Sub-task) Parent: (was: SPARK-11937) > PySpark support

[jira] [Commented] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070822#comment-15070822 ] Takeshi Yamamuro commented on SPARK-5753: - [~rxin] This ticket should be closed because it has

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070865#comment-15070865 ] Sean Owen commented on SPARK-12453: --- It should fix it. The way you can tell is to run {{mvn

[jira] [Commented] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070905#comment-15070905 ] Daniel Haviv commented on SPARK-10481: -- Is there a workaround that can be used to overcome this

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used htsjdk > Problem in Spark deserialize > > >

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070840#comment-15070840 ] Yanbo Liang edited comment on SPARK-12494 at 12/24/15 10:15 AM:

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070840#comment-15070840 ] Yanbo Liang edited comment on SPARK-12494 at 12/24/15 10:14 AM:

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070862#comment-15070862 ] Furcy Pin commented on SPARK-9600: -- You are right that I forgot to wipe the metastore and warehouse

[jira] [Assigned] (SPARK-12517) No default RDD name for ones created by sc.textFile

[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12517: Assignee: Apache Spark > No default RDD name for ones created by sc.textFile >

[jira] [Assigned] (SPARK-12517) No default RDD name for ones created by sc.textFile

[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12517: Assignee: (was: Apache Spark) > No default RDD name for ones created by sc.textFile

[jira] [Created] (SPARK-12518) Problem in Spark deserialize

Zhanpeng Wu created SPARK-12518: --- Summary: Problem in Spark deserialize Key: SPARK-12518 URL: https://issues.apache.org/jira/browse/SPARK-12518 Project: Spark Issue Type: Question

[jira] [Updated] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12186: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > stage

[jira] [Updated] (SPARK-12215) User guide section for KMeans in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12215: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > User

[jira] [Updated] (SPARK-12044) Fix usage of isnan, isNaN

[ https://issues.apache.org/jira/browse/SPARK-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12044: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Fix

[jira] [Updated] (SPARK-12212) Clarify the distinction between spark.mllib and spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12212: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Clarify

[jira] [Updated] (SPARK-12211) Incorrect version number in graphx doc for migration from 1.1

[ https://issues.apache.org/jira/browse/SPARK-12211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12211: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Commented] (SPARK-12391) JDBC OR operator push down

[ https://issues.apache.org/jira/browse/SPARK-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070828#comment-15070828 ] Apache Spark commented on SPARK-12391: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070832#comment-15070832 ] Apache Spark commented on SPARK-12409: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070840#comment-15070840 ] Yanbo Liang commented on SPARK-12494: - [~anandr...@gmail.com] Can this issue be reproduced? It looks

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070844#comment-15070844 ] Yanbo Liang commented on SPARK-12461: - I can work on it. > Add ExpressionDescription to math

[jira] [Updated] (SPARK-10248) DAGSchedulerSuite should check there were no errors in EventProcessLoop

[ https://issues.apache.org/jira/browse/SPARK-10248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10248: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11605: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > ML 1.6

[jira] [Updated] (SPARK-11958) Create user guide section for SQLTransformer

[ https://issues.apache.org/jira/browse/SPARK-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11958: -- Fix Version/s: (was: 1.6.1) 1.6.0 > Create user guide section for

[jira] [Updated] (SPARK-12364) Add ML example for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12364: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add ML

[jira] [Updated] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10477: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > using

[jira] [Updated] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12082: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12057) Prevent failure on corrupt JSON records

[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12057: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Prevent

[jira] [Updated] (SPARK-10299) word2vec should allow users to specify the window size

[ https://issues.apache.org/jira/browse/SPARK-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10299: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12158: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > [R]

[jira] [Updated] (SPARK-12380) MLLib should use existing SQLContext instead create new one

[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12380: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > MLLib

[jira] [Updated] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11193: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Spark

[jira] [Updated] (SPARK-12166) Unset hadoop related environment in testing

[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12166: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Unset

[jira] [Updated] (SPARK-12217) Document invalid handling for StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12217: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12199) Follow-up: Refine example code in ml-features.md

[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12199: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

[ https://issues.apache.org/jira/browse/SPARK-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12056: -- Fix Version/s: (was: 1.6.1) 1.6.0 > NewHadoopRDD: TaskAttemptContext should be

[jira] [Updated] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12062: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Master

[jira] [Updated] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12115: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Change

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12031: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Integer

[jira] [Updated] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12107: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Update

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9972: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add

[jira] [Updated] (SPARK-11715) R support corr for Column Aggregration

[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11715: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > R

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12159: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add

[jira] [Updated] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11497: -- Fix Version/s: (was: 1.6.1) (was: 1.5.3) (was: 2.0.0)

[jira] [Updated] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12048: -- Fix Version/s: (was: 1.6.1) (was: 1.5.3) (was: 2.0.0)

[jira] [Updated] (SPARK-12104) collect() does not handle multiple columns with same name

[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12104: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12310) Add write.json and write.parquet for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12310: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Add

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used [htsjdk|https://github.com/samtools/htsjdk] in my Spark application, I

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used [htsjdk|https://github.com/samtools/htsjdk] in my Spark application, I

[jira] [Resolved] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12502. Resolution: Fixed Target Version/s: 1.6.0, 2.0.0 > Script /dev/run-tests fails

[jira] [Updated] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12502: --- Assignee: Kazuaki Ishizaki > Script /dev/run-tests fails when IBM Java is used >

[jira] [Assigned] (SPARK-11939) PySpark support model export/import for Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11939: Assignee: Apache Spark > PySpark support model export/import for Pipeline API >

[jira] [Assigned] (SPARK-11939) PySpark support model export/import for Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11939: Assignee: (was: Apache Spark) > PySpark support model export/import for Pipeline API

[jira] [Resolved] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5753. -- Resolution: Duplicate > add basic support to JDBCRDD for postgresql types: uuid, hstore, and array >

[jira] [Issue Comment Deleted] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12461: Comment: was deleted (was: I can work on it.) > Add ExpressionDescription to math functions >

[jira] [Commented] (SPARK-12426) Docker JDBC integration tests are failing again

[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070882#comment-15070882 ] Sean Owen commented on SPARK-12426: --- Hm, I get this on OSX now, or I did once. This always happens on

[jira] [Created] (SPARK-12517) No default RDD name for ones created by sc.textFile

yaron weinsberg created SPARK-12517: --- Summary: No default RDD name for ones created by sc.textFile Key: SPARK-12517 URL: https://issues.apache.org/jira/browse/SPARK-12517 Project: Spark

[jira] [Commented] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070914#comment-15070914 ] Jeff Zhang commented on SPARK-10481: Where do you use SPARK_PREPEND_CLASSES ? It is only for

[jira] [Updated] (SPARK-12518) Problem in Spark deserialize

[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanpeng Wu updated SPARK-12518: Description: When I used [htsjdk|https://github.com/samtools/htsjdk] in my Spark application, I

[jira] [Updated] (SPARK-11774) Implement "struct", "encode","decode" in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11774: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 >

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12324: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > The

[jira] [Updated] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12000: -- Fix Version/s: (was: 1.6.1) 1.6.0 > `sbt publishLocal` hits a Scala compiler

[jira] [Updated] (SPARK-11964) Create user guide section explaining export/import

[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11964: -- Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Create

[jira] [Updated] (SPARK-9886) Validate usages of Runtime.getRuntime.addShutdownHook

[ https://issues.apache.org/jira/browse/SPARK-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9886: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) 1.6.0 > Validate

  1   2   3   >