[jira] [Resolved] (SPARK-2660) Enable pretty-printing SchemaRDD Rows

[ https://issues.apache.org/jira/browse/SPARK-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2660. - Resolution: Fixed Assignee: Michael Armbrust Fix Version/s: 1.5.0 We have

[jira] [Resolved] (SPARK-3440) HiveServer2 and CLI should retrieve Hive result set schema

[ https://issues.apache.org/jira/browse/SPARK-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3440. - Resolution: Fixed I think that in general most native commands are actually implemented

[jira] [Resolved] (SPARK-3350) Strange anomaly trying to write a SchemaRDD into an Avro file

[ https://issues.apache.org/jira/browse/SPARK-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3350. - Resolution: Cannot Reproduce I'm going to close this since it seems the issue has been

[jira] [Assigned] (SPARK-3440) HiveServer2 and CLI should retrieve Hive result set schema

[ https://issues.apache.org/jira/browse/SPARK-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-3440: --- Assignee: Michael Armbrust > HiveServer2 and CLI should retrieve Hive result set

[jira] [Resolved] (SPARK-3231) select on a table in parquet format containing smallint as a field type does not work

[ https://issues.apache.org/jira/browse/SPARK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3231. - Resolution: Fixed Fix Version/s: 1.5.0 > select on a table in parquet format

[jira] [Resolved] (SPARK-3208) Hive Parquet SerDe returns null columns

[ https://issues.apache.org/jira/browse/SPARK-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3208. - Resolution: Fixed Convert metastore is now the default, so I'll close this issue. > Hive

[jira] [Resolved] (SPARK-3034) [HIve] java.sql.Date cannot be cast to java.sql.Timestamp

[ https://issues.apache.org/jira/browse/SPARK-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3034. - Resolution: Cannot Reproduce I'm going to close this as I believe the problem does not

[jira] [Resolved] (SPARK-4100) JSON RDD schema inference causes whole RDD to be realized

[ https://issues.apache.org/jira/browse/SPARK-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4100. - Resolution: Won't Fix Closing as this is the expected behavior. > JSON RDD schema

[jira] [Resolved] (SPARK-3991) Not Serializable , Nullpinter Exceptions in SQL server mode

[ https://issues.apache.org/jira/browse/SPARK-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3991. - Resolution: Cannot Reproduce I'm going to close this issue as I believe the problems are

[jira] [Resolved] (SPARK-3978) Schema change on Spark-Hive (Parquet file format) table not working

[ https://issues.apache.org/jira/browse/SPARK-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3978. - Resolution: Fixed Fix Version/s: 1.5.0 Closing as it sound like this is fixed in

[jira] [Resolved] (SPARK-3804) Output of Generator expressions is not stable after serialization.

[ https://issues.apache.org/jira/browse/SPARK-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3804. - Resolution: Fixed Fix Version/s: 1.5.0 This has been fixed. > Output of Generator

[jira] [Resolved] (SPARK-3833) Allow Spark SQL SchemaRDDs to be merged

[ https://issues.apache.org/jira/browse/SPARK-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3833. - Resolution: Fixed Fix Version/s: 1.4.0 We support Schema merging for parquet

[jira] [Resolved] (SPARK-3753) Spark hive join results in empty with shared hive context

[ https://issues.apache.org/jira/browse/SPARK-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3753. - Resolution: Cannot Reproduce I can't reproduce this in Spark 1.5. Please reopen if you

[jira] [Resolved] (SPARK-5823) Reuse mutable rows for inner structures when parsing JSON objects

[ https://issues.apache.org/jira/browse/SPARK-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5823. - Resolution: Fixed > Reuse mutable rows for inner structures when parsing JSON objects >

[jira] [Resolved] (SPARK-3700) Improve the performance of scanning JSON datasets

[ https://issues.apache.org/jira/browse/SPARK-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3700. - Resolution: Fixed Fix Version/s: 1.5.0 We've done a lot of improvement here, so

[jira] [Resolved] (SPARK-3617) Configurable case sensitivity

[ https://issues.apache.org/jira/browse/SPARK-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3617. - Resolution: Fixed Fix Version/s: 1.5.0 This is now configurable. > Configurable

[jira] [Resolved] (SPARK-4205) Timestamp and Date objects with comparison operators

[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4205. - Resolution: Fixed The dataframe DSL has been significantly improved, including

[jira] [Resolved] (SPARK-4273) Providing ExternalSet to avoid OOM when count(distinct)

[ https://issues.apache.org/jira/browse/SPARK-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4273. - Resolution: Fixed Fix Version/s: 1.5.0 External aggregation based on sorting has

[jira] [Reopened] (SPARK-6944) Mechanism to associate generic operator scope with RDD's

[ https://issues.apache.org/jira/browse/SPARK-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6944: -- > Mechanism to associate generic operator scope with RDD's >

[jira] [Resolved] (SPARK-10475) improve column prunning for Project on Sort

[ https://issues.apache.org/jira/browse/SPARK-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10475. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8644

[jira] [Resolved] (SPARK-6943) Graphically show the RDD DAG on the UI

[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6943. -- Resolution: Fixed > Graphically show the RDD DAG on the UI > -- > >

[jira] [Resolved] (SPARK-6942) Umbrella: UI Visualizations for Core and Dataframes

[ https://issues.apache.org/jira/browse/SPARK-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6942. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Umbrella: UI

[jira] [Resolved] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10066. -- Resolution: Fixed > Can't create HiveContext with spark-shell or spark-sql on snapshot

[jira] [Resolved] (SPARK-9343) DROP TABLE ignores IF EXISTS clause

[ https://issues.apache.org/jira/browse/SPARK-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9343. - Resolution: Fixed Fix Version/s: 1.5.0 Tested on 1.5 and this seems to be

[jira] [Resolved] (SPARK-2106) Unify the HiveContext

[ https://issues.apache.org/jira/browse/SPARK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2106. - Resolution: Won't Fix I'm going to close this old issue unless there is still work to be

[jira] [Resolved] (SPARK-2239) Spark SQL basicOperator add Distinct operator

[ https://issues.apache.org/jira/browse/SPARK-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2239. - Resolution: Duplicate > Spark SQL basicOperator add Distinct operator >

[jira] [Commented] (SPARK-10623) turning on predicate pushdown throws nonsuch element exception when RDD is empty

[ https://issues.apache.org/jira/browse/SPARK-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746164#comment-14746164 ] Zhan Zhang commented on SPARK-10623: It is caused by the SearchArgument.Builder is not correctly

[jira] [Resolved] (SPARK-2824) Allow saving Parquet files to the HiveMetastore

[ https://issues.apache.org/jira/browse/SPARK-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2824. - Resolution: Fixed Fix Version/s: 1.5.0 We have much better support for working

[jira] [Resolved] (SPARK-3057) [Hive] Extra bytes detected at the end of the row!

[ https://issues.apache.org/jira/browse/SPARK-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3057. - Resolution: Not A Problem I'm going to close this as "not a problem" as It seems that

[jira] [Resolved] (SPARK-4093) Simplify the unwrap/wrap between HiveUDFs

[ https://issues.apache.org/jira/browse/SPARK-4093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4093. - Resolution: Won't Fix As we implement more functions natively this is no longer an

[jira] [Resolved] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3928. - Resolution: Fixed I'm going to close this since we now support hadoop style globbing. >

[jira] [Resolved] (SPARK-3919) HiveThriftServer2 fails to start because of Hive 0.12 metastore schema verification failure

[ https://issues.apache.org/jira/browse/SPARK-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3919. - Resolution: Not A Problem Closing as not a problem. Configure Spark SQL to talk to a

[jira] [Resolved] (SPARK-5738) Reuse mutable row for each record at jsonStringToRow

[ https://issues.apache.org/jira/browse/SPARK-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5738. - Resolution: Fixed > Reuse mutable row for each record at jsonStringToRow >

[jira] [Created] (SPARK-10617) Leap year miscalculated in sql query

shao lo created SPARK-10617: --- Summary: Leap year miscalculated in sql query Key: SPARK-10617 URL: https://issues.apache.org/jira/browse/SPARK-10617 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10591) False negative in QueryTest.checkAnswer

[ https://issues.apache.org/jira/browse/SPARK-10591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10591: --- Description: {{checkAnswer}} doesn't handle {{Map\[K, V\]}} properly. For example: {noformat} scala>

[jira] [Created] (SPARK-10615) changes assertEquals to assertEqual for existing unit tests

Yanbo Liang created SPARK-10615: --- Summary: changes assertEquals to assertEqual for existing unit tests Key: SPARK-10615 URL: https://issues.apache.org/jira/browse/SPARK-10615 Project: Spark

[jira] [Commented] (SPARK-10262) Add @Since annotation to ml.attribute

[ https://issues.apache.org/jira/browse/SPARK-10262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745461#comment-14745461 ] Yashwanth Kumar commented on SPARK-10262: - Can I have this task. I think i can finish this in a

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745467#comment-14745467 ] Cheng Hao commented on SPARK-4226: -- [~marmbrus] [~yhuai] After investigating a little bit, I think using

[jira] [Commented] (SPARK-10388) Public dataset loader interface

[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745430#comment-14745430 ] Kai Sasaki commented on SPARK-10388: It seems very useful for the beginners who want to try Spark ML

[jira] [Commented] (SPARK-10540) HadoopFsRelationTest's "test all data types" is flaky

[ https://issues.apache.org/jira/browse/SPARK-10540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745434#comment-14745434 ] Apache Spark commented on SPARK-10540: -- User 'liancheng' has created a pull request for this issue:

[jira] [Created] (SPARK-10618) Refactoring and adding test for Mesos coarse-grained Scheduler

Akash Mishra created SPARK-10618: Summary: Refactoring and adding test for Mesos coarse-grained Scheduler Key: SPARK-10618 URL: https://issues.apache.org/jira/browse/SPARK-10618 Project: Spark

<    1   2   3