[jira] [Updated] (SPARK-11315) Add YARN extension service to publish Spark events to YARN timeline service

[ https://issues.apache.org/jira/browse/SPARK-11315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11315: - Target Version/s: (was: 1.6.0) > Add YARN extension service to publish Spark events to

[jira] [Updated] (SPARK-11796) Docker JDBC integration tests fail in Maven build due to dependency issue

[ https://issues.apache.org/jira/browse/SPARK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11796: - Component/s: Tests > Docker JDBC integration tests fail in Maven build due to dependency

[jira] [Updated] (SPARK-11601) ML 1.6 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11601: - Component/s: Documentation > ML 1.6 QA: API: Binary incompatible changes >

[jira] [Updated] (SPARK-11954) Encoder for JavaBeans / POJOs

[ https://issues.apache.org/jira/browse/SPARK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11954: - Assignee: Wenchen Fan > Encoder for JavaBeans / POJOs > - >

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12031: - Description: In my case, some partitions contain too much items. When do range

[jira] [Updated] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8966: Target Version/s: (was: 1.6.0) > Design a mechanism to ensure that temporary files

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11600: - Component/s: Documentation > Spark MLlib 1.6 QA umbrella > --- >

[jira] [Commented] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033103#comment-15033103 ] Michael Armbrust commented on SPARK-8414: - Still planning to do this for 1.6? > Ensure

[jira] [Created] (SPARK-12069) Documentation update for Datasets

Michael Armbrust created SPARK-12069: Summary: Documentation update for Datasets Key: SPARK-12069 URL: https://issues.apache.org/jira/browse/SPARK-12069 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11966: - Target Version/s: 1.7.0 > Spark API for UDTFs > --- > >

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7348: Target Version/s: (was: 1.6.0) > DAG visualization: add links to RDD page >

[jira] [Updated] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12060: - Priority: Critical (was: Major) > Avoid memory copy in JavaSerializerInstance.serialize

[jira] [Updated] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

[ https://issues.apache.org/jira/browse/SPARK-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11985: - Component/s: Documentation > Update Spark Streaming - Kinesis Library Documentation

[jira] [Updated] (SPARK-6518) Add example code and user guide for bisecting k-means

[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6518: Component/s: Documentation > Add example code and user guide for bisecting k-means >

[jira] [Updated] (SPARK-11603) ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11603: - Component/s: Documentation > ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed

[jira] [Updated] (SPARK-11607) Update MLlib website for 1.6

[ https://issues.apache.org/jira/browse/SPARK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11607: - Component/s: Documentation > Update MLlib website for 1.6 >

[jira] [Updated] (SPARK-6280) Remove Akka systemName from Spark

[ https://issues.apache.org/jira/browse/SPARK-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6280: Target Version/s: (was: 1.6.0) > Remove Akka systemName from Spark >

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12031: - Priority: Critical (was: Major) > Integer overflow when do sampling. >

[jira] [Commented] (SPARK-12017) Java Doc Publishing Broken

[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033119#comment-15033119 ] Michael Armbrust commented on SPARK-12017: -- Fixed in https://github.com/apache/spark/pull/10049

[jira] [Resolved] (SPARK-12017) Java Doc Publishing Broken

[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12017. -- Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 1.6.0 > Java Doc

[jira] [Updated] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12010: - Target Version/s: (was: 1.6.0) > Spark JDBC requires support for column-name-free

[jira] [Commented] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033124#comment-15033124 ] Michael Armbrust commented on SPARK-12010: -- Thanks for working on this, but we've already hit

[jira] [Resolved] (SPARK-11990) DataFrame recompute UDF in some situation.

[ https://issues.apache.org/jira/browse/SPARK-11990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11990. -- Resolution: Duplicate Fix Version/s: 1.6.0 This is already fixed in Spark 1.6

[jira] [Created] (SPARK-12017) Java Doc Publishing Broken

Michael Armbrust created SPARK-12017: Summary: Java Doc Publishing Broken Key: SPARK-12017 URL: https://issues.apache.org/jira/browse/SPARK-12017 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12017) Java Doc Publishing Broken

[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029153#comment-15029153 ] Michael Armbrust commented on SPARK-12017: -- /cc [~joshrosen] > Java Doc Publishing Broken >

[jira] [Resolved] (SPARK-11863) Unable to resolve order by if it contains mixture of aliases and real columns.

[ https://issues.apache.org/jira/browse/SPARK-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11863. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9961

[jira] [Updated] (SPARK-11942) fix encoder life cycle for CoGroup

[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11942: - Assignee: Wenchen Fan > fix encoder life cycle for CoGroup >

[jira] [Resolved] (SPARK-11942) fix encoder life cycle for CoGroup

[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11942. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9928

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024927#comment-15024927 ] Michael Armbrust commented on SPARK-9141: - [~tianyi] please provide a reproduction of the issue

[jira] [Commented] (SPARK-9328) Netty IO layer should implement read timeouts

[ https://issues.apache.org/jira/browse/SPARK-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025107#comment-15025107 ] Michael Armbrust commented on SPARK-9328: - [~joshrosen] is this actually a 1.6 blocker? > Netty

[jira] [Resolved] (SPARK-11926) unify GetStructField and GetInternalRowField

[ https://issues.apache.org/jira/browse/SPARK-11926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11926. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9909

[jira] [Resolved] (SPARK-11913) support typed aggregate for complex buffer schema

[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11913. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9898

[jira] [Resolved] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11894. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9904

[jira] [Resolved] (SPARK-11921) fix `nullable` of encoder schema

[ https://issues.apache.org/jira/browse/SPARK-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11921. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9906

[jira] [Updated] (SPARK-7539) Perf tests for Python MLlib

[ https://issues.apache.org/jira/browse/SPARK-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7539: Component/s: Tests > Perf tests for Python MLlib > --- > >

[jira] [Resolved] (SPARK-11819) nice error message for missing encoder

[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11819. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9810

[jira] [Resolved] (SPARK-11876) [SQL] Support PrintSchema in DataSet APIs

[ https://issues.apache.org/jira/browse/SPARK-11876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11876. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9855

[jira] [Updated] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11873: - Issue Type: Improvement (was: Bug) > Regression for TPC-DS query 63 when used with

[jira] [Updated] (SPARK-11819) nice error message for missing encoder

[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11819: - Assignee: Wenchen Fan > nice error message for missing encoder >

[jira] [Updated] (SPARK-11876) [SQL] Support PrintSchema in DataSet APIs

[ https://issues.apache.org/jira/browse/SPARK-11876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11876: - Assignee: Xiao Li > [SQL] Support PrintSchema in DataSet APIs >

[jira] [Created] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

Michael Armbrust created SPARK-11889: Summary: Type inference in REPL broken for GroupedDataset.agg Key: SPARK-11889 URL: https://issues.apache.org/jira/browse/SPARK-11889 Project: Spark

[jira] [Updated] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

[ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11889: - Target Version/s: 1.6.0 > Type inference in REPL broken for GroupedDataset.agg >

[jira] [Updated] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

[ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11889: - Component/s: SQL > Type inference in REPL broken for GroupedDataset.agg >

[jira] [Created] (SPARK-11890) Encoder errors logic breaks on Scala 2.11

Michael Armbrust created SPARK-11890: Summary: Encoder errors logic breaks on Scala 2.11 Key: SPARK-11890 URL: https://issues.apache.org/jira/browse/SPARK-11890 Project: Spark Issue

[jira] [Updated] (SPARK-11890) Encoder errors logic breaks on Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11890: - Description: {code} [error]

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019203#comment-15019203 ] Michael Armbrust commented on SPARK-11894: -- I meant if you call `toDF()` on the dataset and then

[jira] [Resolved] (SPARK-11716) UDFRegistration Drops Input Type Information

[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11716. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9868

[jira] [Resolved] (SPARK-11636) Support as on Classes defined in the REPL

[ https://issues.apache.org/jira/browse/SPARK-11636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11636. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9825

[jira] [Resolved] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

[ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11889. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9870

[jira] [Resolved] (SPARK-11890) Encoder errors logic breaks on Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11890. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9871

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019191#comment-15019191 ] Michael Armbrust commented on SPARK-11894: -- What is the output as a DataFrame? > Incorrect

[jira] [Updated] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11894: - Target Version/s: 1.6.0 > Incorrect results are returned when using null >

[jira] [Commented] (SPARK-11855) Catalyst breaks backwards compatibility in branch-1.6

[ https://issues.apache.org/jira/browse/SPARK-11855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014180#comment-15014180 ] Michael Armbrust commented on SPARK-11855: -- Hey, very sorry for the confusion here. Catalyst is

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11778: - Labels: releasenotes (was: ) > HiveContext.read.table does not support user-specified

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11778: - Assignee: Huaxin Gao > HiveContext.read.table does not support user-specified database

[jira] [Resolved] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11778. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9773

[jira] [Resolved] (SPARK-11633) HiveContext throws TreeNode Exception : Failed to Copy Node

[ https://issues.apache.org/jira/browse/SPARK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11633. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9762

[jira] [Resolved] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

[ https://issues.apache.org/jira/browse/SPARK-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11848. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9832

[jira] [Resolved] (SPARK-11750) revert SPARK-11727 and code clean up

[ https://issues.apache.org/jira/browse/SPARK-11750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11750. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9726

[jira] [Updated] (SPARK-11750) revert SPARK-11727 and code clean up

[ https://issues.apache.org/jira/browse/SPARK-11750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11750: - Assignee: Wenchen Fan > revert SPARK-11727 and code clean up >

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014678#comment-15014678 ] Michael Armbrust commented on SPARK-11319: -- bq. It doesn't sound much like a hint to me. In my

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014535#comment-15014535 ] Michael Armbrust commented on SPARK-11319: -- Okay, the tone here is quickly veering away from

[jira] [Resolved] (SPARK-11803) Dataset self join returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11803. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9806

[jira] [Updated] (SPARK-11803) Dataset self join returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11803: - Assignee: Wenchen Fan > Dataset self join returns incorrect result >

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Assignee: Wenchen Fan > Let UDF to handle null value > > >

[jira] [Resolved] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11795. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9792

[jira] [Updated] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11795: - Assignee: Wenchen Fan > org.apache.spark.sql.AnalysisException: Can't extract value from

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Labels: releasenotes (was: ) > Let UDF to handle null value >

[jira] [Resolved] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11725. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9770

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11778: - Priority: Critical (was: Minor) > HiveContext.read.table does not support

[jira] [Updated] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11262: - Component/s: Tests > Unit test for gradient, loss layers, memory management for

[jira] [Updated] (SPARK-11095) Simplify Netty RPC implementation by using a separate thread pool for each endpoint

[ https://issues.apache.org/jira/browse/SPARK-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11095: - Target Version/s: 2.0.0 (was: 1.6.0) > Simplify Netty RPC implementation by using a

[jira] [Updated] (SPARK-11028) When planning queries without partial aggregation support, we should try to use TungstenAggregate.

[ https://issues.apache.org/jira/browse/SPARK-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11028: - Target Version/s: (was: 1.6.0) > When planning queries without partial aggregation

[jira] [Updated] (SPARK-6377) Set the number of map output partitions for Exchange operator automatically based on the size of input tables and the reduce-side operation.

[ https://issues.apache.org/jira/browse/SPARK-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6377: Target Version/s: (was: 1.6.0) > Set the number of map output partitions for Exchange

[jira] [Updated] (SPARK-11735) Add a check in the constructor of SqlContext to make sure the SparkContext is not stopped

[ https://issues.apache.org/jira/browse/SPARK-11735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11735: - Target Version/s: (was: 1.6.0) > Add a check in the constructor of SqlContext to make

[jira] [Updated] (SPARK-7465) DAG visualization: RDD dependencies not always shown

[ https://issues.apache.org/jira/browse/SPARK-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7465: Target Version/s: (was: 1.6.0) > DAG visualization: RDD dependencies not always shown >

[jira] [Updated] (SPARK-7471) DAG visualization: show call site information

[ https://issues.apache.org/jira/browse/SPARK-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7471: Target Version/s: (was: 1.6.0) > DAG visualization: show call site information >

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012137#comment-15012137 ] Michael Armbrust commented on SPARK-9427: - What is the status here? Are we actually trying to get

[jira] [Updated] (SPARK-10665) Connect the local iterators with the planner

[ https://issues.apache.org/jira/browse/SPARK-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10665: - Target Version/s: (was: 1.6.0) > Connect the local iterators with the planner >

[jira] [Updated] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10359: - Target Version/s: (was: 1.6.0) > Enumerate Spark's dependencies in a file and diff

[jira] [Updated] (SPARK-10340) Use S3 bulk listing for S3-backed Hive tables

[ https://issues.apache.org/jira/browse/SPARK-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10340: - Target Version/s: (was: 1.6.0) > Use S3 bulk listing for S3-backed Hive tables >

[jira] [Updated] (SPARK-7457) Perf test for ALS.recommendAll

[ https://issues.apache.org/jira/browse/SPARK-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7457: Component/s: Tests > Perf test for ALS.recommendAll > -- > >

[jira] [Resolved] (SPARK-11392) GroupedIterator's hasNext is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11392. -- Resolution: Won't Fix Given we don't want to materialize the whole group, I think this

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8447: Component/s: Tests > Test external shuffle service with all shuffle managers >

[jira] [Updated] (SPARK-10364) Support Parquet logical type TIMESTAMP_MILLIS

[ https://issues.apache.org/jira/browse/SPARK-10364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10364: - Target Version/s: (was: 1.6.0) > Support Parquet logical type TIMESTAMP_MILLIS >

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8716: Component/s: Tests > Write tests for executor shared cache feature >

[jira] [Updated] (SPARK-10366) Support Parquet logical type DATE

[ https://issues.apache.org/jira/browse/SPARK-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10366: - Target Version/s: (was: 1.6.0) > Support Parquet logical type DATE >

[jira] [Updated] (SPARK-9359) Support IntervalType for Parquet

[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9359: Target Version/s: (was: 1.6.0) > Support IntervalType for Parquet >

[jira] [Updated] (SPARK-9346) Conversion is applied three times on partitioned data sources that require conversion

[ https://issues.apache.org/jira/browse/SPARK-9346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9346: Target Version/s: (was: 1.6.0) > Conversion is applied three times on partitioned data

[jira] [Resolved] (SPARK-11637) Alias do not work with udf with * parameter

[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11637. -- Resolution: Duplicate Fix Version/s: 1.6.0 This is fixed. Please reopen if you

[jira] [Updated] (SPARK-10420) Implementing Reactive Streams based Spark Streaming Receiver

[ https://issues.apache.org/jira/browse/SPARK-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10420: - Target Version/s: (was: 1.6.0) > Implementing Reactive Streams based Spark Streaming

[jira] [Commented] (SPARK-11323) Add History Service Provider to service application histories from YARN timeline server

[ https://issues.apache.org/jira/browse/SPARK-11323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012168#comment-15012168 ] Michael Armbrust commented on SPARK-11323: -- Are we still trying to get this, [SPARK-11314], and

[jira] [Updated] (SPARK-7025) Create a Java-friendly input source API

[ https://issues.apache.org/jira/browse/SPARK-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7025: Target Version/s: 2.0.0 (was: 1.6.0) > Create a Java-friendly input source API >

[jira] [Commented] (SPARK-11838) Spark SQL query fragment RDD reuse

[ https://issues.apache.org/jira/browse/SPARK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012701#comment-15012701 ] Michael Armbrust commented on SPARK-11838: -- As I said to [~markhamstra] offline, my biggest

[jira] [Updated] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10620: - Target Version/s: 2.0.0 (was: 1.6.0) > Look into whether accumulator mechanism can

[jira] [Updated] (SPARK-7271) Redesign shuffle interface for binary processing

[ https://issues.apache.org/jira/browse/SPARK-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7271: Target Version/s: 1.7.0 (was: 1.6.0) > Redesign shuffle interface for binary processing >

[jira] [Updated] (SPARK-7200) Tungsten test suites should fail if memory leak is detected

[ https://issues.apache.org/jira/browse/SPARK-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7200: Component/s: Tests > Tungsten test suites should fail if memory leak is detected >

[jira] [Resolved] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11679. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9649

[jira] [Resolved] (SPARK-10186) Add support for more postgres column types

[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10186. -- Resolution: Fixed Fix Version/s: 1.6.0 > Add support for more postgres column

[jira] [Resolved] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11089. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9740

<    4   5   6   7   8   9   10   11   12   13   >