[jira] [Created] (SPARK-14488) Creating temporary table using SQL DDL shouldn't write files to file system

2016-04-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14488: -- Summary: Creating temporary table using SQL DDL shouldn't write files to file system Key: SPARK-14488 URL: https://issues.apache.org/jira/browse/SPARK-14488 Project:

[jira] [Created] (SPARK-14458) Wrong data schema is passed to FileFormat data sources that can't infer schema

2016-04-07 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14458: -- Summary: Wrong data schema is passed to FileFormat data sources that can't infer schema Key: SPARK-14458 URL: https://issues.apache.org/jira/browse/SPARK-14458 Project:

[jira] [Resolved] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-04-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13589. Resolution: Resolved Fixed by SPARK-13537 > Flaky test: ParquetHadoopFsRelationSuite.test all

[jira] [Created] (SPARK-14407) Hide HadoopFsRelation related data source API to execution package

2016-04-05 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14407: -- Summary: Hide HadoopFsRelation related data source API to execution package Key: SPARK-14407 URL: https://issues.apache.org/jira/browse/SPARK-14407 Project: Spark

[jira] [Resolved] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14404. Resolution: Not A Bug The scheme of {{FakeFileSystem}} is randomly generated, so it doesn't

[jira] [Created] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14404: -- Summary: HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it Key: SPARK-14404 URL: https://issues.apache.org/jira/browse/SPARK-14404

[jira] [Updated] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14404: --- Component/s: SQL > HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't >

[jira] [Created] (SPARK-14372) Dataset.randomSplit() needs a Java version

2016-04-04 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14372: -- Summary: Dataset.randomSplit() needs a Java version Key: SPARK-14372 URL: https://issues.apache.org/jira/browse/SPARK-14372 Project: Spark Issue Type:

[jira] [Created] (SPARK-14369) Implement preferredLocations() for FileScanRDD

2016-04-04 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14369: -- Summary: Implement preferredLocations() for FileScanRDD Key: SPARK-14369 URL: https://issues.apache.org/jira/browse/SPARK-14369 Project: Spark Issue Type:

[jira] [Created] (SPARK-14295) buildReader implementation for LibSVM

2016-03-31 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14295: -- Summary: buildReader implementation for LibSVM Key: SPARK-14295 URL: https://issues.apache.org/jira/browse/SPARK-14295 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14274) Add FileFormat.prepareRead to collect necessary global information

2016-03-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14274: --- Summary: Add FileFormat.prepareRead to collect necessary global information (was: Replaces

[jira] [Updated] (SPARK-14274) Replaces inferSchema with prepareRead to collect necessary global information

2016-03-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14274: --- Description: One problem of our newly introduced {{FileFormat.buildReader()}} method is that it

[jira] [Created] (SPARK-14274) Replaces inferSchema with prepareRead to collect necessary global information

2016-03-30 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14274: -- Summary: Replaces inferSchema with prepareRead to collect necessary global information Key: SPARK-14274 URL: https://issues.apache.org/jira/browse/SPARK-14274 Project:

[jira] [Created] (SPARK-14273) Add FileFormat.isSplittable to indicate whether a format is splittable

2016-03-30 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14273: -- Summary: Add FileFormat.isSplittable to indicate whether a format is splittable Key: SPARK-14273 URL: https://issues.apache.org/jira/browse/SPARK-14273 Project: Spark

[jira] [Resolved] (SPARK-14114) implement buildReader for text data source

2016-03-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14114. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11934

[jira] [Created] (SPARK-14244) Physical Window operator uses global SizeBasedWindowFunction.n attribute generated on both driver and executor side

2016-03-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14244: -- Summary: Physical Window operator uses global SizeBasedWindowFunction.n attribute generated on both driver and executor side Key: SPARK-14244 URL:

[jira] [Resolved] (SPARK-14208) Rename "spark.sql.parquet.fileScan"

2016-03-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14208. Resolution: Fixed Issue resolved by pull request 12003

[jira] [Created] (SPARK-14237) De-duplicate partition value appending logic in various buildReader() implementations

2016-03-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14237: -- Summary: De-duplicate partition value appending logic in various buildReader() implementations Key: SPARK-14237 URL: https://issues.apache.org/jira/browse/SPARK-14237

[jira] [Updated] (SPARK-14206) buildReader implementation for CSV

2016-03-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14206: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 Fix Version/s: (was: 2.0.0) >

[jira] [Assigned] (SPARK-14206) buildReader implementation for CSV

2016-03-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-14206: -- Assignee: Cheng Lian > buildReader implementation for CSV >

[jira] [Created] (SPARK-14208) Rename "spark.sql.parquet.fileScan"

2016-03-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14208: -- Summary: Rename "spark.sql.parquet.fileScan" Key: SPARK-14208 URL: https://issues.apache.org/jira/browse/SPARK-14208 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14206) buildReader implementation for CSV

2016-03-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14206: -- Summary: buildReader implementation for CSV Key: SPARK-14206 URL: https://issues.apache.org/jira/browse/SPARK-14206 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-03-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13456. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11931

[jira] [Updated] (SPARK-14146) Imported implicits can't be found in Spark REPL in some cases

2016-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14146: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 Component/s: Spark Core

[jira] [Updated] (SPARK-14114) implement buildReader for text data source

2016-03-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14114: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 Fix Version/s: (was: 2.0.0) >

[jira] [Created] (SPARK-14116) buildReader implementation for ORC

2016-03-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14116: -- Summary: buildReader implementation for ORC Key: SPARK-14116 URL: https://issues.apache.org/jira/browse/SPARK-14116 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13549) Refactor the Optimizer Rule CollapseProject

2016-03-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13549. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11427

[jira] [Updated] (SPARK-13549) Refactor the Optimizer Rule CollapseProject

2016-03-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13549: --- Assignee: Xiao Li > Refactor the Optimizer Rule CollapseProject >

[jira] [Resolved] (SPARK-13772) DataType mismatch about decimal

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13772. Resolution: Fixed Fix Version/s: 1.6.2 Issue resolved by pull request 11605

[jira] [Updated] (SPARK-13772) DataType mismatch about decimal

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13772: --- Assignee: cen yuhai > DataType mismatch about decimal > --- > >

[jira] [Updated] (SPARK-13772) DataType mismatch about decimal

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13772: --- Target Version/s: 1.6.2 > DataType mismatch about decimal > --- > >

[jira] [Updated] (SPARK-13772) DataType mismatch about decimal

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13772: --- Description: Code snippet to reproduce this issue using 1.6.0: {code} select if(1=1, cast(1 as

[jira] [Resolved] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13774. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11775

[jira] [Updated] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13774: --- Assignee: Sunitha Kambhampati > IllegalArgumentException: Can not create a Path from an empty string

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Description: Release note update: {quote} Starting from 2.0.0, Spark SQL handles views natively by

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Labels: releasenotes (was: ) > Enable native view by default > - > >

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Enable native view by default >

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Assignee: Wenchen Fan > Enable native view by default > - > >

[jira] [Resolved] (SPARK-14000) case class with a tuple field can't work in Dataset

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14000. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11816

[jira] [Resolved] (SPARK-14004) AttributeReference and Alias should only use their first qualifier to build SQL representations

2016-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14004. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11820

[jira] [Updated] (SPARK-13972) hive tests should fail if SQL generation failed

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13972: --- Assignee: Wenchen Fan > hive tests should fail if SQL generation failed >

[jira] [Updated] (SPARK-14001) support multi-children Union in SQLBuilder

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14001: --- Assignee: Wenchen Fan > support multi-children Union in SQLBuilder >

[jira] [Updated] (SPARK-12719) SQL generation support for generators (including UDTF)

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12719: --- Assignee: Wenchen Fan > SQL generation support for generators (including UDTF) >

[jira] [Resolved] (SPARK-14002) SQLBuilder should add subquery to Aggregate child when necessary

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14002. Resolution: Duplicate Fix Version/s: 2.0.0 This issue is actually covered by SPARK-13976.

[jira] [Updated] (SPARK-13974) sub-query names do not need to be globally unique while generate SQL

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13974: --- Assignee: Wenchen Fan > sub-query names do not need to be globally unique while generate SQL >

[jira] [Updated] (SPARK-14004) AttributeReference and Alias should only use their first qualifier to build SQL representations

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14004: --- Priority: Minor (was: Major) > AttributeReference and Alias should only use their first qualifier

[jira] [Created] (SPARK-14004) AttributeReference and Alias should only use their first qualifier to build SQL representations

2016-03-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14004: -- Summary: AttributeReference and Alias should only use their first qualifier to build SQL representations Key: SPARK-14004 URL: https://issues.apache.org/jira/browse/SPARK-14004

[jira] [Created] (SPARK-14002) SQLBuilder should add subquery to Aggregate child when necessary

2016-03-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14002: -- Summary: SQLBuilder should add subquery to Aggregate child when necessary Key: SPARK-14002 URL: https://issues.apache.org/jira/browse/SPARK-14002 Project: Spark

[jira] [Resolved] (SPARK-14001) support multi-children Union in SQLBuilder

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14001. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11818

[jira] [Resolved] (SPARK-13972) hive tests should fail if SQL generation failed

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13972. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11782

[jira] [Comment Edited] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195821#comment-15195821 ] Cheng Lian edited comment on SPARK-13911 at 3/15/16 6:15 PM: - Another problem

[jira] [Commented] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195821#comment-15195821 ] Cheng Lian commented on SPARK-13911: Another problem related to the {{ResolveAggregateFunctions}}

[jira] [Created] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13911: -- Summary: Having condition and order by cannot both have aggregate functions Key: SPARK-13911 URL: https://issues.apache.org/jira/browse/SPARK-13911 Project: Spark

[jira] [Created] (SPARK-13910) Should provide a factory method for constructing DataFrames using unresolved logical plan

2016-03-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13910: -- Summary: Should provide a factory method for constructing DataFrames using unresolved logical plan Key: SPARK-13910 URL: https://issues.apache.org/jira/browse/SPARK-13910

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

2016-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Assignee: Wenchen Fan (was: Xiao Li) > SQL generation support for window functions >

[jira] [Resolved] (SPARK-13841) Remove Dataset.collectRows() and Dataset.takeRows()

2016-03-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13841. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11678

[jira] [Created] (SPARK-13841) Remove Dataset.collectRows() and Dataset.takeRows()

2016-03-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13841: -- Summary: Remove Dataset.collectRows() and Dataset.takeRows() Key: SPARK-13841 URL: https://issues.apache.org/jira/browse/SPARK-13841 Project: Spark Issue Type:

[jira] [Created] (SPARK-13828) QueryExecution's assertAnalyzed needs to preserve the stacktrace

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13828: -- Summary: QueryExecution's assertAnalyzed needs to preserve the stacktrace Key: SPARK-13828 URL: https://issues.apache.org/jira/browse/SPARK-13828 Project: Spark

[jira] [Created] (SPARK-13826) Revise ScalaDoc of the new Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13826: -- Summary: Revise ScalaDoc of the new Dataset API Key: SPARK-13826 URL: https://issues.apache.org/jira/browse/SPARK-13826 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13817. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11656

[jira] [Updated] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13817: --- Issue Type: Sub-task (was: Test) Parent: SPARK-13822 > Re-enable MiMA check after unifying

[jira] [Created] (SPARK-13822) Follow-ups of DataFrame/Dataset API unification

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13822: -- Summary: Follow-ups of DataFrame/Dataset API unification Key: SPARK-13822 URL: https://issues.apache.org/jira/browse/SPARK-13822 Project: Spark Issue Type:

[jira] [Deleted] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13565: --- > Migrate DataFrameReader/DataFrameWriter to Dataset API >

[jira] [Deleted] (SPARK-13561) Migrate Dataset untyped aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13561: --- > Migrate Dataset untyped aggregations > > > Key:

[jira] [Deleted] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13563: --- > Migrate DataFrameNaFunctions to Dataset > --- > >

[jira] [Deleted] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13564: --- > Migrate DataFrameStatFunctions to Dataset > - > >

[jira] [Deleted] (SPARK-13562) Migrate Dataset typed aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13562: --- > Migrate Dataset typed aggregations > -- > > Key:

[jira] [Created] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13817: -- Summary: Re-enable MiMA check after unifying DataFrame and Dataset API Key: SPARK-13817 URL: https://issues.apache.org/jira/browse/SPARK-13817 Project: Spark

[jira] [Deleted] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13560: --- > Migrate GroupedDataset pivoting methods > --- > >

[jira] [Deleted] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13559: --- > Migrate common GroupedDataset aggregations > -- > >

[jira] [Deleted] (SPARK-13558) Migrate basic GroupedDataset methods

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13558: --- > Migrate basic GroupedDataset methods > > > Key:

[jira] [Deleted] (SPARK-13557) Migrate gather-to-driver actions

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13557: --- > Migrate gather-to-driver actions > > > Key:

[jira] [Deleted] (SPARK-13555) Migrate untyped relational operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13555: --- > Migrate untyped relational operations > - > >

[jira] [Deleted] (SPARK-13556) Migrate untyped joins

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13556: --- > Migrate untyped joins > - > > Key: SPARK-13556 >

[jira] [Deleted] (SPARK-13554) Migrate typed relational operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13554: --- > Migrate typed relational operations > --- > > Key:

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > > Key:

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > > Key:

[jira] [Resolved] (PARQUET-528) Fix flush() for RecordConsumer and implementations

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved PARQUET-528. Resolution: Fixed Issue resolved by pull request 325

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Fix Version/s: 2.0.0 > SQL generation support for cube, rollup, and grouping set >

[jira] [Resolved] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12720. Resolution: Fixed Resolved by https://github.com/apache/spark/pull/11283 > SQL generation support

[jira] [Resolved] (SPARK-13603) SQL generation for subquery

2016-03-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13603. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11453

[jira] [Commented] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1510#comment-1510 ] Cheng Lian commented on SPARK-13649: cc [~cloud_fan] > Move CalendarInterval out of unsafe package >

[jira] [Created] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13649: -- Summary: Move CalendarInterval out of unsafe package Key: SPARK-13649 URL: https://issues.apache.org/jira/browse/SPARK-13649 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173249#comment-15173249 ] Cheng Lian commented on SPARK-13589: [~nongli] Is SPARK-13533 related to this one? > Flaky test:

[jira] [Created] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13589: -- Summary: Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType Key: SPARK-13589 URL: https://issues.apache.org/jira/browse/SPARK-13589 Project: Spark

[jira] [Resolved] (SPARK-13540) Nested classes within Scala objects can't be used as Dataset element type

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13540. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11421

[jira] [Updated] (SPARK-13561) Migrate Dataset untyped aggregations

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13561: --- Assignee: (was: Cheng Lian) > Migrate Dataset untyped aggregations >

[jira] [Updated] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13560: --- Assignee: (was: Cheng Lian) > Migrate GroupedDataset pivoting methods >

[jira] [Updated] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13559: --- Assignee: (was: Cheng Lian) > Migrate common GroupedDataset aggregations >

[jira] [Updated] (SPARK-13562) Migrate Dataset typed aggregations

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13562: --- Assignee: (was: Cheng Lian) > Migrate Dataset typed aggregations >

[jira] [Updated] (SPARK-13557) Migrate gather-to-driver actions

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13557: --- Assignee: (was: Cheng Lian) > Migrate gather-to-driver actions >

[jira] [Created] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13565: -- Summary: Migrate DataFrameReader/DataFrameWriter to Dataset API Key: SPARK-13565 URL: https://issues.apache.org/jira/browse/SPARK-13565 Project: Spark Issue

[jira] [Updated] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13563: --- Description: After the migration, we should have a separate namespace {{Dataset.na}}, just like

[jira] [Created] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13564: -- Summary: Migrate DataFrameStatFunctions to Dataset Key: SPARK-13564 URL: https://issues.apache.org/jira/browse/SPARK-13564 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13563: -- Summary: Migrate DataFrameNaFunctions to Dataset Key: SPARK-13563 URL: https://issues.apache.org/jira/browse/SPARK-13563 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13562) Migrate Dataset typed aggregations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13562: -- Summary: Migrate Dataset typed aggregations Key: SPARK-13562 URL: https://issues.apache.org/jira/browse/SPARK-13562 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13561) Migrate Dataset untyped aggregations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13561: -- Summary: Migrate Dataset untyped aggregations Key: SPARK-13561 URL: https://issues.apache.org/jira/browse/SPARK-13561 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13560: -- Summary: Migrate GroupedDataset pivoting methods Key: SPARK-13560 URL: https://issues.apache.org/jira/browse/SPARK-13560 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13558) Migrate basic GroupedDataset methods

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13558: -- Summary: Migrate basic GroupedDataset methods Key: SPARK-13558 URL: https://issues.apache.org/jira/browse/SPARK-13558 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13559: -- Summary: Migrate common GroupedDataset aggregations Key: SPARK-13559 URL: https://issues.apache.org/jira/browse/SPARK-13559 Project: Spark Issue Type: Sub-task

<    1   2   3   4   5   6   7   8   9   10   >