[jira] [Updated] (SPARK-12447) Only update AM's internal state when executor is successfully launched by NM

[ https://issues.apache.org/jira/browse/SPARK-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12447: Description: Currently {{YarnAllocator}} will update its managed states like {{numExecutorsRunning

[jira] [Commented] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071399#comment-15071399 ] Apache Spark commented on SPARK-12316: -- User 'SaintBacchus' has created a pull reque

[jira] [Assigned] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12316: Assignee: Apache Spark > Stack overflow with endless call of `Delegation token thread` whe

[jira] [Assigned] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12316: Assignee: (was: Apache Spark) > Stack overflow with endless call of `Delegation token

[jira] [Updated] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-12316: - Attachment: 20151210045533.jpg 20151210045149.jpg > Stack overflow with endless c

[jira] [Updated] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12516: Description: Failure of NodeManager will make all the executors belong to that NM exit silently.

[jira] [Assigned] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12436: Assignee: Apache Spark > If all values of a JSON field is null, JSON's inferSchema should

[jira] [Assigned] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12436: Assignee: (was: Apache Spark) > If all values of a JSON field is null, JSON's inferSch

[jira] [Commented] (SPARK-12375) VectorIndexer: allow unknown categories

[ https://issues.apache.org/jira/browse/SPARK-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071370#comment-15071370 ] yuhao yang commented on SPARK-12375: PR here, https://github.com/apache/spark/pull/10

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071354#comment-15071354 ] Zhang, Liye commented on SPARK-12196: - I am out of office with limited email access f

[jira] [Updated] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Summary: Store blocks in different speed storage devices by hierarchy way (was: Store blocks in storage device

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: Apache Spark > DataFrame Partitions in java does not work >

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: (was: Apache Spark) > DataFrame Partitions in java does not work > -

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: (was: Apache Spark) > DataFrame Partitions in java does not work > -

[jira] [Assigned] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12521: Assignee: Apache Spark > DataFrame Partitions in java does not work >

[jira] [Commented] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071347#comment-15071347 ] Xiu (Joe) Guo commented on SPARK-12521: --- In 1.5.2 {code}sqlContext.load(){code} is

[jira] [Updated] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12516: Description: Failure of NodeManager will make all the executors belong to that NM exit silently.

[jira] [Assigned] (SPARK-9716) BinaryClassificationEvaluator should accept Double prediction column

[ https://issues.apache.org/jira/browse/SPARK-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9716: --- Assignee: (was: Apache Spark) > BinaryClassificationEvaluator should accept Double predic

[jira] [Assigned] (SPARK-9716) BinaryClassificationEvaluator should accept Double prediction column

[ https://issues.apache.org/jira/browse/SPARK-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9716: --- Assignee: Apache Spark > BinaryClassificationEvaluator should accept Double prediction column

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071294#comment-15071294 ] Apache Spark commented on SPARK-12504: -- User 'sureshthalamati' has created a pull re

[jira] [Assigned] (SPARK-12522) Add the missing the document string for the SQL configuration

[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12522: Assignee: Apache Spark > Add the missing the document string for the SQL configuration > -

[jira] [Assigned] (SPARK-12522) Add the missing the document string for the SQL configuration

[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12522: Assignee: (was: Apache Spark) > Add the missing the document string for the SQL config

[jira] [Commented] (SPARK-12522) Add the missing the document string for the SQL configuration

[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071278#comment-15071278 ] Apache Spark commented on SPARK-12522: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-12522) Add the missing the document string for the SQL configuration

Xiao Li created SPARK-12522: --- Summary: Add the missing the document string for the SQL configuration Key: SPARK-12522 URL: https://issues.apache.org/jira/browse/SPARK-12522 Project: Spark Issue Ty

[jira] [Commented] (SPARK-8855) Python API for Association Rules

[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071263#comment-15071263 ] Caique Rodrigues Marques commented on SPARK-8855: - I tried to implement, i

[jira] [Updated] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

[ https://issues.apache.org/jira/browse/SPARK-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12509: -- Description: Currently, when we call corr or cov on dataframe with invalid input we see

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071161#comment-15071161 ] Kai Jiang commented on SPARK-12461: --- Okay, i will try this one and PR later. > Add

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071157#comment-15071157 ] Martin Schade commented on SPARK-12453: --- I can confirm that removing the dependency

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071153#comment-15071153 ] Xiao Li commented on SPARK-12461: - Sure. To verify your changes, please run ./bin/spark-s

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071142#comment-15071142 ] Kai Jiang commented on SPARK-12461: --- I may want take this one. Could I do it? > Add Ex

[jira] [Comment Edited] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071142#comment-15071142 ] Kai Jiang edited comment on SPARK-12461 at 12/24/15 5:17 PM: -

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071141#comment-15071141 ] Xiao Li commented on SPARK-12461: - It sounds like nobody is taking this one. I can do it.

[jira] [Created] (SPARK-12521) DataFrame Partitions in java does not work

Sergey Podolsky created SPARK-12521: --- Summary: DataFrame Partitions in java does not work Key: SPARK-12521 URL: https://issues.apache.org/jira/browse/SPARK-12521 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Created] (SPARK-12520) Python API dataframe join returns wrong results on outer join

Aravind B created SPARK-12520: -- Summary: Python API dataframe join returns wrong results on outer join Key: SPARK-12520 URL: https://issues.apache.org/jira/browse/SPARK-12520 Project: Spark Is

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Updated] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12519: - Description: After running the distinct() method to transform a DataFrame, subsequent actions li

[jira] [Created] (SPARK-12519) "Managed memory leak detected" when using distinct on PySpark DataFrame

Paul Shearer created SPARK-12519: Summary: "Managed memory leak detected" when using distinct on PySpark DataFrame Key: SPARK-12519 URL: https://issues.apache.org/jira/browse/SPARK-12519 Project: Spar

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071062#comment-15071062 ] Benjamin Fradet commented on SPARK-12247: - The [PR|https://github.com/apache/spar

[jira] [Updated] (SPARK-7200) Tungsten test suites should fail if memory leak is detected

[ https://issues.apache.org/jira/browse/SPARK-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7200: - Target Version/s: (was: 1.6.0) > Tungsten test suites should fail if memory leak is detected > -

[jira] [Updated] (SPARK-8987) Increase test coverage of DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8987: - Target Version/s: (was: 1.6.0) > Increase test coverage of DAGScheduler > --

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10372: -- Target Version/s: (was: 1.6.0) > Add end-to-end tests for the scheduling code > -

[jira] [Updated] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11780: -- Target Version/s: (was: 1.6.0) > Provide type aliases in org.apache.spark.sql.types for backwards com

[jira] [Updated] (SPARK-7992) Hide private classes/objects in in generated Java API doc

[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7992: - Target Version/s: (was: 1.6.0) > Hide private classes/objects in in generated Java API doc > ---

[jira] [Updated] (SPARK-12004) RDD checkpointing does not preserve partitioner

[ https://issues.apache.org/jira/browse/SPARK-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12004: -- Target Version/s: (was: 1.6.0) > RDD checkpointing does not preserve partitioner > -

[jira] [Updated] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12231: -- Target Version/s: (was: 1.6.0) > Failed to generate predicate Error when using dropna > -

[jira] [Updated] (SPARK-12039) HiveSparkSubmitSuite's SPARK-9757 Persist Parquet relation with decimal column is very flaky

[ https://issues.apache.org/jira/browse/SPARK-12039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12039: -- Target Version/s: (was: 1.6.0) > HiveSparkSubmitSuite's SPARK-9757 Persist Parquet relation with deci

[jira] [Updated] (SPARK-12512) WithColumn does not work on multiple column with special character

[ https://issues.apache.org/jira/browse/SPARK-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12512: -- Component/s: SQL > WithColumn does not work on multiple column with special character > ---

[jira] [Updated] (SPARK-12517) No default RDD name for ones created by sc.textFile

[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12517: -- Fix Version/s: (was: 1.3.1) > No default RDD name for ones created by sc.textFile > --

[jira] [Updated] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12511: -- Component/s: Streaming PySpark > streaming driver with checkpointing unable to finaliz

[jira] [Updated] (SPARK-12440) Avoid setCheckpointDir warning when filesystem is not local

[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12440: -- Assignee: Pierre Borckmans (was: Apache Spark) > Avoid setCheckpointDir warning when filesystem is not

[jira] [Resolved] (SPARK-12440) Avoid setCheckpointDir warning when filesystem is not local

[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12440. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10392 [https://github.co

[jira] [Updated] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12353: -- Target Version/s: 2.0.0 Labels: releasenotes (was: easyfix) Since this changes the resul

[jira] [Updated] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12010: -- Assignee: Christian Kurz Fix Version/s: 1.6.1 > Spark JDBC requires support for column-name-fr

[jira] [Resolved] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12010. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10380 [https://github.co

[jira] [Resolved] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12311. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10289 [https://github.co

[jira] [Updated] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12311: -- Assignee: Kazuaki Ishizaki > [CORE] Restore previous value of "os.arch" property in test suites after

[jira] [Updated] (SPARK-11537) hour/minute/second returns negative value

[ https://issues.apache.org/jira/browse/SPARK-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11537: -- Fix Version/s: (was: 1.6.1) > hour/minute/second returns negative value > -

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12324: -- Fix Version/s: 2.0.0 > The documentation sidebar does not collapse properly > -

[jira] [Updated] (SPARK-12057) Prevent failure on corrupt JSON records

[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12057: -- Fix Version/s: 2.0.0 > Prevent failure on corrupt JSON records > --

[jira] [Updated] (SPARK-11824) WebUI throws console error for descriptions with 'bad' HTML

[ https://issues.apache.org/jira/browse/SPARK-11824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11824: -- Fix Version/s: 2.0.0 > WebUI throws console error for descriptions with 'bad' HTML > --

[jira] [Updated] (SPARK-12093) Fix the error of comment in DDLParser

[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12093: -- Fix Version/s: 2.0.0 > Fix the error of comment in DDLParser > - >

[jira] [Updated] (SPARK-12466) Harmless Master NPE in tests

[ https://issues.apache.org/jira/browse/SPARK-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12466: -- Fix Version/s: 2.0.0 > Harmless Master NPE in tests > > >

[jira] [Updated] (SPARK-11774) Implement "struct", "encode","decode" in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11774: -- Fix Version/s: 2.0.0 > Implement "struct", "encode","decode" in SparkR > --

[jira] [Updated] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12136: -- Fix Version/s: 2.0.0 > rddToFileName does not properly handle prefix and suffix parameters > --

[jira] [Updated] (SPARK-12146) SparkR jsonFile should support multiple input files

[ https://issues.apache.org/jira/browse/SPARK-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12146: -- Fix Version/s: 2.0.0 > SparkR jsonFile should support multiple input files > --

[jira] [Updated] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12088: -- Fix Version/s: 2.0.0 > check connection.isClose before connection.getAutoCommit in JDBCRDD.close >

[jira] [Updated] (SPARK-12275) No plan for BroadcastHint in some condition

[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12275: -- Fix Version/s: 2.0.0 1.5.3 > No plan for BroadcastHint in some condition > -

[jira] [Updated] (SPARK-12166) Unset hadoop related environment in testing

[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12166: -- Fix Version/s: 2.0.0 > Unset hadoop related environment in testing > -

[jira] [Updated] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10477: -- Fix Version/s: 2.0.0 > using DSL in ColumnPruningSuite to improve readablity >

[jira] [Updated] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12082: -- Fix Version/s: 2.0.0 > NettyBlockTransferSecuritySuite "security mismatch auth off on client" test > i

[jira] [Updated] (SPARK-12103) Clarify documentation of KafkaUtils createStream with multiple topics

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12103: -- Fix Version/s: 2.0.0 > Clarify documentation of KafkaUtils createStream with multiple topics >

[jira] [Updated] (SPARK-11978) Move dataset_example.py to examples/ml and rename to dataframe_example.py

[ https://issues.apache.org/jira/browse/SPARK-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11978: -- Fix Version/s: 2.0.0 > Move dataset_example.py to examples/ml and rename to dataframe_example.py >

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12019: -- Fix Version/s: 2.0.0 > SparkR.init does not support character vector for sparkJars and sparkPackages >

[jira] [Updated] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12048: -- Fix Version/s: 2.0.0 1.5.3 > JDBCRDD calls close() twice - SQLite then throws an exc

[jira] [Updated] (SPARK-6518) Add example code and user guide for bisecting k-means

[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6518: - Fix Version/s: 2.0.0 > Add example code and user guide for bisecting k-means > ---

[jira] [Updated] (SPARK-11964) Create user guide section explaining export/import

[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11964: -- Fix Version/s: 2.0.0 > Create user guide section explaining export/import > ---

[jira] [Updated] (SPARK-12109) Expressions's simpleString should delegate to its toString

[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12109: -- Fix Version/s: 2.0.0 > Expressions's simpleString should delegate to its toString > ---

[jira] [Updated] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12160: -- Fix Version/s: 1.5.3 > spark.mllib should use SQLContext.getOrCreate >

[jira] [Updated] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11193: -- Fix Version/s: 2.0.0 > Spark 1.5+ Kinesis Streaming - ClassCastException when starting > KinesisReceiv

[jira] [Updated] (SPARK-11715) R support corr for Column Aggregration

[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11715: -- Fix Version/s: 2.0.0 > R support corr for Column Aggregration > --

[jira] [Updated] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12158: -- Fix Version/s: 2.0.0 > [R] [SQL] Fix 'sample' functions that break R unit test cases >

[jira] [Updated] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11602: -- Fix Version/s: 2.0.0 > ML 1.6 QA: API: New Scala APIs, docs > > >

[jira] [Updated] (SPARK-10248) DAGSchedulerSuite should check there were no errors in EventProcessLoop

[ https://issues.apache.org/jira/browse/SPARK-10248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10248: -- Fix Version/s: 2.0.0 > DAGSchedulerSuite should check there were no errors in EventProcessLoop > --

[jira] [Updated] (SPARK-12380) MLLib should use existing SQLContext instead create new one

[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12380: -- Fix Version/s: 2.0.0 > MLLib should use existing SQLContext instead create new one > --

[jira] [Updated] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11497: -- Fix Version/s: 2.0.0 1.5.3 > PySpark RowMatrix Constructor Has Type Erasure Issue >

[jira] [Updated] (SPARK-10299) word2vec should allow users to specify the window size

[ https://issues.apache.org/jira/browse/SPARK-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10299: -- Fix Version/s: 2.0.0 > word2vec should allow users to specify the window size > ---

[jira] [Updated] (SPARK-12364) Add ML example for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12364: -- Fix Version/s: 2.0.0 > Add ML example for SparkR > - > > Key: S

[jira] [Updated] (SPARK-12298) Infinite loop in DataFrame.sortWithinPartitions(String, String*)

[ https://issues.apache.org/jira/browse/SPARK-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12298: -- Fix Version/s: 2.0.0 > Infinite loop in DataFrame.sortWithinPartitions(String, String*) > -

[jira] [Updated] (SPARK-12390) Clean up unused serializer parameter in BlockManager

[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12390: -- Fix Version/s: 2.0.0 > Clean up unused serializer parameter in BlockManager > -

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12395: -- Fix Version/s: 2.0.0 > Result of DataFrame.join(usingColumns) could be wrong for outer join > -

[jira] [Updated] (SPARK-11608) ML 1.6 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11608: -- Fix Version/s: 2.0.0 > ML 1.6 QA: Programming guide update and migration guide > --

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12159: -- Fix Version/s: 2.0.0 > Add user guide section for IndexToString transformer > -

  1   2   3   >