[jira] [Resolved] (SPARK-14001) support multi-children Union in SQLBuilder

[ https://issues.apache.org/jira/browse/SPARK-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14001. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11818 [https

[jira] [Resolved] (SPARK-13972) hive tests should fail if SQL generation failed

[ https://issues.apache.org/jira/browse/SPARK-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13972. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11782 [https

[jira] [Comment Edited] (SPARK-13911) Having condition and order by cannot both have aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195821#comment-15195821 ] Cheng Lian edited comment on SPARK-13911 at 3/15/16 6:15 PM: - Another problem

[jira] [Commented] (SPARK-13911) Having condition and order by cannot both have aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195821#comment-15195821 ] Cheng Lian commented on SPARK-13911: Another problem related to the {{ResolveAggregateFunctions

[jira] [Created] (SPARK-13911) Having condition and order by cannot both have aggregate functions

Cheng Lian created SPARK-13911: -- Summary: Having condition and order by cannot both have aggregate functions Key: SPARK-13911 URL: https://issues.apache.org/jira/browse/SPARK-13911 Project: Spark

[jira] [Created] (SPARK-13910) Should provide a factory method for constructing DataFrames using unresolved logical plan

Cheng Lian created SPARK-13910: -- Summary: Should provide a factory method for constructing DataFrames using unresolved logical plan Key: SPARK-13910 URL: https://issues.apache.org/jira/browse/SPARK-13910

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Assignee: Wenchen Fan (was: Xiao Li) > SQL generation support for window functi

[jira] [Resolved] (SPARK-13841) Remove Dataset.collectRows() and Dataset.takeRows()

[ https://issues.apache.org/jira/browse/SPARK-13841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13841. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11678 [https

[jira] [Created] (SPARK-13841) Remove Dataset.collectRows() and Dataset.takeRows()

Cheng Lian created SPARK-13841: -- Summary: Remove Dataset.collectRows() and Dataset.takeRows() Key: SPARK-13841 URL: https://issues.apache.org/jira/browse/SPARK-13841 Project: Spark Issue Type

[jira] [Created] (SPARK-13828) QueryExecution's assertAnalyzed needs to preserve the stacktrace

Cheng Lian created SPARK-13828: -- Summary: QueryExecution's assertAnalyzed needs to preserve the stacktrace Key: SPARK-13828 URL: https://issues.apache.org/jira/browse/SPARK-13828 Project: Spark

[jira] [Created] (SPARK-13826) Revise ScalaDoc of the new Dataset API

Cheng Lian created SPARK-13826: -- Summary: Revise ScalaDoc of the new Dataset API Key: SPARK-13826 URL: https://issues.apache.org/jira/browse/SPARK-13826 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13817. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11656 [https

[jira] [Updated] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13817: --- Issue Type: Sub-task (was: Test) Parent: SPARK-13822 > Re-enable MiMA check after unify

[jira] [Created] (SPARK-13822) Follow-ups of DataFrame/Dataset API unification

Cheng Lian created SPARK-13822: -- Summary: Follow-ups of DataFrame/Dataset API unification Key: SPARK-13822 URL: https://issues.apache.org/jira/browse/SPARK-13822 Project: Spark Issue Type

[jira] [Deleted] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

[ https://issues.apache.org/jira/browse/SPARK-13565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13565: --- > Migrate DataFrameReader/DataFrameWriter to Dataset

[jira] [Deleted] (SPARK-13561) Migrate Dataset untyped aggregations

[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13561: --- > Migrate Dataset untyped aggregations > > >

[jira] [Deleted] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13563: --- > Migrate DataFrameNaFunctions to Data

[jira] [Deleted] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

[ https://issues.apache.org/jira/browse/SPARK-13564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13564: --- > Migrate DataFrameStatFunctions to Data

[jira] [Deleted] (SPARK-13562) Migrate Dataset typed aggregations

[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13562: --- > Migrate Dataset typed aggregations > -- > >

[jira] [Created] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

Cheng Lian created SPARK-13817: -- Summary: Re-enable MiMA check after unifying DataFrame and Dataset API Key: SPARK-13817 URL: https://issues.apache.org/jira/browse/SPARK-13817 Project: Spark

[jira] [Deleted] (SPARK-13560) Migrate GroupedDataset pivoting methods

[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13560: --- > Migrate GroupedDataset pivoting meth

[jira] [Deleted] (SPARK-13559) Migrate common GroupedDataset aggregations

[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13559: --- > Migrate common GroupedDataset aggregati

[jira] [Deleted] (SPARK-13558) Migrate basic GroupedDataset methods

[ https://issues.apache.org/jira/browse/SPARK-13558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13558: --- > Migrate basic GroupedDataset methods > > >

[jira] [Deleted] (SPARK-13557) Migrate gather-to-driver actions

[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13557: --- > Migrate gather-to-driver actions > > >

[jira] [Deleted] (SPARK-13555) Migrate untyped relational operations

[ https://issues.apache.org/jira/browse/SPARK-13555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13555: --- > Migrate untyped relational operations > - > >

[jira] [Deleted] (SPARK-13556) Migrate untyped joins

[ https://issues.apache.org/jira/browse/SPARK-13556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13556: --- > Migrate untyped joins > - > > Key:

[jira] [Deleted] (SPARK-13554) Migrate typed relational operations

[ https://issues.apache.org/jira/browse/SPARK-13554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13554: --- > Migrate typed relational operations > --- > >

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > >

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > >

[jira] [Resolved] (PARQUET-528) Fix flush() for RecordConsumer and implementations

[ https://issues.apache.org/jira/browse/PARQUET-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved PARQUET-528. Resolution: Fixed Issue resolved by pull request 325 [https://github.com/apache/parquet-mr/pull

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Fix Version/s: 2.0.0 > SQL generation support for cube, rollup, and grouping

[jira] [Resolved] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12720. Resolution: Fixed Resolved by https://github.com/apache/spark/pull/11283 > SQL generation supp

[jira] [Resolved] (SPARK-13603) SQL generation for subquery

[ https://issues.apache.org/jira/browse/SPARK-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13603. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11453 [https

[jira] [Commented] (SPARK-13649) Move CalendarInterval out of unsafe package

[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1510#comment-1510 ] Cheng Lian commented on SPARK-13649: cc [~cloud_fan] > Move CalendarInterval out of unsafe pack

[jira] [Created] (SPARK-13649) Move CalendarInterval out of unsafe package

Cheng Lian created SPARK-13649: -- Summary: Move CalendarInterval out of unsafe package Key: SPARK-13649 URL: https://issues.apache.org/jira/browse/SPARK-13649 Project: Spark Issue Type

[jira] [Commented] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

[ https://issues.apache.org/jira/browse/SPARK-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173249#comment-15173249 ] Cheng Lian commented on SPARK-13589: [~nongli] Is SPARK-13533 related to this one? > Flaky t

[jira] [Created] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

Cheng Lian created SPARK-13589: -- Summary: Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType Key: SPARK-13589 URL: https://issues.apache.org/jira/browse/SPARK-13589 Project: Spark

[jira] [Resolved] (SPARK-13540) Nested classes within Scala objects can't be used as Dataset element type

[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13540. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11421 [https

[jira] [Updated] (SPARK-13561) Migrate Dataset untyped aggregations

[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13561: --- Assignee: (was: Cheng Lian) > Migrate Dataset untyped aggregati

[jira] [Updated] (SPARK-13560) Migrate GroupedDataset pivoting methods

[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13560: --- Assignee: (was: Cheng Lian) > Migrate GroupedDataset pivoting meth

[jira] [Updated] (SPARK-13559) Migrate common GroupedDataset aggregations

[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13559: --- Assignee: (was: Cheng Lian) > Migrate common GroupedDataset aggregati

[jira] [Updated] (SPARK-13562) Migrate Dataset typed aggregations

[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13562: --- Assignee: (was: Cheng Lian) > Migrate Dataset typed aggregati

[jira] [Updated] (SPARK-13557) Migrate gather-to-driver actions

[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13557: --- Assignee: (was: Cheng Lian) > Migrate gather-to-driver acti

[jira] [Created] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

Cheng Lian created SPARK-13565: -- Summary: Migrate DataFrameReader/DataFrameWriter to Dataset API Key: SPARK-13565 URL: https://issues.apache.org/jira/browse/SPARK-13565 Project: Spark Issue

[jira] [Updated] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13563: --- Description: After the migration, we should have a separate namespace {{Dataset.na}}, just like

[jira] [Created] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

Cheng Lian created SPARK-13564: -- Summary: Migrate DataFrameStatFunctions to Dataset Key: SPARK-13564 URL: https://issues.apache.org/jira/browse/SPARK-13564 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

Cheng Lian created SPARK-13563: -- Summary: Migrate DataFrameNaFunctions to Dataset Key: SPARK-13563 URL: https://issues.apache.org/jira/browse/SPARK-13563 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13562) Migrate Dataset typed aggregations

Cheng Lian created SPARK-13562: -- Summary: Migrate Dataset typed aggregations Key: SPARK-13562 URL: https://issues.apache.org/jira/browse/SPARK-13562 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13561) Migrate Dataset untyped aggregations

Cheng Lian created SPARK-13561: -- Summary: Migrate Dataset untyped aggregations Key: SPARK-13561 URL: https://issues.apache.org/jira/browse/SPARK-13561 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13560) Migrate GroupedDataset pivoting methods

Cheng Lian created SPARK-13560: -- Summary: Migrate GroupedDataset pivoting methods Key: SPARK-13560 URL: https://issues.apache.org/jira/browse/SPARK-13560 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13558) Migrate basic GroupedDataset methods

Cheng Lian created SPARK-13558: -- Summary: Migrate basic GroupedDataset methods Key: SPARK-13558 URL: https://issues.apache.org/jira/browse/SPARK-13558 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13559) Migrate common GroupedDataset aggregations

Cheng Lian created SPARK-13559: -- Summary: Migrate common GroupedDataset aggregations Key: SPARK-13559 URL: https://issues.apache.org/jira/browse/SPARK-13559 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13557) Migrate gather-to-driver actions

Cheng Lian created SPARK-13557: -- Summary: Migrate gather-to-driver actions Key: SPARK-13557 URL: https://issues.apache.org/jira/browse/SPARK-13557 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13556) Migrate untyped joins

Cheng Lian created SPARK-13556: -- Summary: Migrate untyped joins Key: SPARK-13556 URL: https://issues.apache.org/jira/browse/SPARK-13556 Project: Spark Issue Type: Sub-task Components

[jira] [Created] (SPARK-13555) Migrate untyped relational operations

Cheng Lian created SPARK-13555: -- Summary: Migrate untyped relational operations Key: SPARK-13555 URL: https://issues.apache.org/jira/browse/SPARK-13555 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13554) Migrate typed relational operations

Cheng Lian created SPARK-13554: -- Summary: Migrate typed relational operations Key: SPARK-13554 URL: https://issues.apache.org/jira/browse/SPARK-13554 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13553) Migrate basic inspection operations

Cheng Lian created SPARK-13553: -- Summary: Migrate basic inspection operations Key: SPARK-13553 URL: https://issues.apache.org/jira/browse/SPARK-13553 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-13540) Nested classes within Scala objects can't be used as Dataset element type

[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Summary: Nested classes within Scala objects can't be used as Dataset element type (was: Scala

[jira] [Updated] (SPARK-13540) Scala object can't be added to OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Description: Add the following test case to {{DatasetSuite}} to reproduce this issue: {code} object

[jira] [Updated] (SPARK-13540) Scala object can't be added to OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Assignee: Cheng Lian Affects Version/s: 2.0.0 Target Version/s: 2.0.0

[jira] [Created] (SPARK-13540) Scala object can't be added to OuterScopes

Cheng Lian created SPARK-13540: -- Summary: Scala object can't be added to OuterScopes Key: SPARK-13540 URL: https://issues.apache.org/jira/browse/SPARK-13540 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13457) Remove DataFrame RDD operations

[ https://issues.apache.org/jira/browse/SPARK-13457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13457. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11388 [https

[jira] [Resolved] (SPARK-13486) Move SQLConf into an internal package

[ https://issues.apache.org/jira/browse/SPARK-13486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13486. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11363 [https

[jira] [Updated] (SPARK-13473) Predicate can't be pushed through project with nondeterministic field

[ https://issues.apache.org/jira/browse/SPARK-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13473: --- Assignee: Cheng Lian Affects Version/s: 2.0.0 1.5.2

[jira] [Created] (SPARK-13473) Predicate can't be pushed through project with nondeterministic field

Cheng Lian created SPARK-13473: -- Summary: Predicate can't be pushed through project with nondeterministic field Key: SPARK-13473 URL: https://issues.apache.org/jira/browse/SPARK-13473 Project: Spark

Re: How to delete a record from parquet files using dataframes

Parquet is a read-only format. So the only way to remove data from a written Parquet file is to write a new Parquet file without unwanted rows. Cheng On 2/17/16 5:11 AM, SRK wrote: Hi, I am saving my records in the form of parquet files using dataframes in hdfs. How to delete the records

[jira] [Created] (SPARK-13457) Remove DataFrame RDD operations

Cheng Lian created SPARK-13457: -- Summary: Remove DataFrame RDD operations Key: SPARK-13457 URL: https://issues.apache.org/jira/browse/SPARK-13457 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

Cheng Lian created SPARK-13456: -- Summary: Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11 Key: SPARK-13456 URL: https://issues.apache.org/jira/browse/SPARK-13456

[jira] [Commented] (SPARK-13454) Cannot drop table whose name starts with underscore

[ https://issues.apache.org/jira/browse/SPARK-13454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158930#comment-15158930 ] Cheng Lian commented on SPARK-13454: cc [~yhuai] > Cannot drop table whose name sta

[jira] [Created] (SPARK-13454) Cannot drop table whose name starts with underscore

Cheng Lian created SPARK-13454: -- Summary: Cannot drop table whose name starts with underscore Key: SPARK-13454 URL: https://issues.apache.org/jira/browse/SPARK-13454 Project: Spark Issue Type

[jira] [Resolved] (SPARK-13263) SQL generation support for tablesample

[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13263. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11148 [https

[jira] [Updated] (SPARK-13263) SQL generation support for tablesample

[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13263: --- Assignee: Xiao Li > SQL generation support for tablesam

[jira] [Resolved] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13236. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11195 [https

[jira] [Updated] (SPARK-13236) SQL generation support for Set Operations

[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13236: --- Assignee: Xiao Li > SQL generation support for Set Operati

[jira] [Commented] (SPARK-13418) SQL generation for uncorrelated scalar subqueries

[ https://issues.apache.org/jira/browse/SPARK-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156534#comment-15156534 ] Cheng Lian commented on SPARK-13418: Summary of offline discussion with [~rxin]: Moving {{.sql

[jira] [Resolved] (SPARK-12799) Simplify various string output for expressions

[ https://issues.apache.org/jira/browse/SPARK-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12799. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10757 [https

[jira] [Created] (SPARK-13370) Lexer not handling whitespaces properly

Cheng Lian created SPARK-13370: -- Summary: Lexer not handling whitespaces properly Key: SPARK-13370 URL: https://issues.apache.org/jira/browse/SPARK-13370 Project: Spark Issue Type: Bug

Re: Welcoming two new committers

Awesome! Congrats and welcome!! Cheng On Tue, Feb 9, 2016 at 2:55 AM, Shixiong(Ryan) Zhu wrote: > Congrats!!! Herman and Wenchen!!! > > > On Mon, Feb 8, 2016 at 10:44 AM, Luciano Resende > wrote: > >> >> >> On Mon, Feb 8, 2016 at 9:15 AM, Matei

Re: Welcoming two new committers

Awesome! Congrats and welcome!! On 2/9/16 2:55 AM, Shixiong(Ryan) Zhu wrote: Congrats!!! Herman and Wenchen!!! On Mon, Feb 8, 2016 at 10:44 AM, Luciano Resende > wrote: On Mon, Feb 8, 2016 at 9:15 AM, Matei Zaharia

[jira] [Resolved] (SPARK-13314) Malformed WholeStageCodegen tree string

[ https://issues.apache.org/jira/browse/SPARK-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13314. Resolution: Not A Problem I didn't realize that the extra vertical lines are used to indicate

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Assignee: Xiao Li > SQL generation support for cube, rollup, and grouping

[jira] [Created] (SPARK-13314) Malformed WholeStageCodegen tree string

Cheng Lian created SPARK-13314: -- Summary: Malformed WholeStageCodegen tree string Key: SPARK-13314 URL: https://issues.apache.org/jira/browse/SPARK-13314 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13314) Malformed WholeStageCodegen tree string

[ https://issues.apache.org/jira/browse/SPARK-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-13314: -- Assignee: Cheng Lian > Malformed WholeStageCodegen tree str

[jira] [Resolved] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12725. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11050 [https

[jira] [Updated] (SPARK-13205) SQL generation support for self join

[ https://issues.apache.org/jira/browse/SPARK-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13205: --- Assignee: Xiao Li > SQL generation support for self j

[jira] [Resolved] (SPARK-13205) SQL generation support for self join

[ https://issues.apache.org/jira/browse/SPARK-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13205. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11084 [https

[jira] [Created] (SPARK-13244) Unify DataFrame and Dataset API

Cheng Lian created SPARK-13244: -- Summary: Unify DataFrame and Dataset API Key: SPARK-13244 URL: https://issues.apache.org/jira/browse/SPARK-13244 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13157) ADD JAR command cannot handle path with @ character

[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13157: --- Assignee: Herman van Hovell > ADD JAR command cannot handle path with @ charac

[jira] [Commented] (SPARK-13157) ADD JAR command cannot handle path with @ character

[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130754#comment-15130754 ] Cheng Lian commented on SPARK-13157: Thanks for the explanation. > ADD JAR command cannot han

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130760#comment-15130760 ] Cheng Lian commented on SPARK-13150: Both flaky tests seem to be caused by SPARK-13157. Ideally

[jira] [Commented] (SPARK-13157) ADD JAR command cannot handle path with @ character

[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130738#comment-15130738 ] Cheng Lian commented on SPARK-13157: Thanks [~hvanhovell]! Just curious, is this a bug

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129556#comment-15129556 ] Cheng Lian commented on SPARK-13150: Seems that ADD JAR command in both flaky tests may fail silently

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129857#comment-15129857 ] Cheng Lian commented on SPARK-13150: Please refer to [this PR comment|https://github.com/apache

[jira] [Created] (SPARK-13157) ADD JAR command cannot handle path with @ character

Cheng Lian created SPARK-13157: -- Summary: ADD JAR command cannot handle path with @ character Key: SPARK-13157 URL: https://issues.apache.org/jira/browse/SPARK-13157 Project: Spark Issue Type

[jira] [Assigned] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-12725: -- Assignee: Xiao Li > SQL generation suffers from name conficts introduced by some analy

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127021#comment-15127021 ] Cheng Lian commented on SPARK-13101: [~deenar] Just had an offline discussion with [~marmbrus

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126890#comment-15126890 ] Cheng Lian commented on SPARK-13101: I think this is expected behavior. The problem in snippet

[jira] [Comment Edited] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127021#comment-15127021 ] Cheng Lian edited comment on SPARK-13101 at 2/1/16 9:03 PM: [~deenar] Just

[jira] [Comment Edited] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127021#comment-15127021 ] Cheng Lian edited comment on SPARK-13101 at 2/1/16 9:02 PM: [~deenar] Just

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126894#comment-15126894 ] Cheng Lian commented on SPARK-13101: [~deenar] I also tried the last two snippets and they both work

<    2   3   4   5   6   7   8   9   10   11   >