[jira] [Resolved] (SPARK-13131) Use best time and average time in micro benchmark

2016-02-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13131. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11018

[jira] [Resolved] (SPARK-13113) Remove unnecessary bit operation when decoding page number

2016-02-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13113. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11002

[jira] [Resolved] (SPARK-12798) Broadcast hash join

2016-02-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12798. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10989

[jira] [Resolved] (SPARK-12913) Reimplement stat functions as declarative function

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12913. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10960

[jira] [Created] (SPARK-13147) improve readability of generated code

2016-02-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13147: -- Summary: improve readability of generated code Key: SPARK-13147 URL: https://issues.apache.org/jira/browse/SPARK-13147 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

2016-02-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13150: -- Summary: Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session Key: SPARK-13150 URL: https://issues.apache.org/jira/browse/SPARK-13150

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129239#comment-15129239 ] Davies Liu commented on SPARK-13150: This one usually fail together :

[jira] [Reopened] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-13150: not fixed yet > Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test > single

[jira] [Resolved] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12992. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10908

[jira] [Created] (SPARK-13145) checkAnswer should tolerate small float number error

2016-02-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13145: -- Summary: checkAnswer should tolerate small float number error Key: SPARK-13145 URL: https://issues.apache.org/jira/browse/SPARK-13145 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13147) improve readability of generated code

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13147. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11032

[jira] [Assigned] (SPARK-13131) Use median time in benchmark

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-13131: -- Assignee: Davies Liu > Use median time in benchmark > > >

[jira] [Updated] (SPARK-13131) Use median time in benchmark

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13131: --- Summary: Use median time in benchmark (was: Use best time in benchmark) > Use median time in

[jira] [Updated] (SPARK-13131) Use median time in benchmark

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13131: --- Component/s: SQL > Use median time in benchmark > > >

[jira] [Updated] (SPARK-13131) Use median time in benchmark

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13131: --- Description: Median time should be more stable than average time in benchmark. (was: Best time

[jira] [Updated] (SPARK-13157) ADD JAR command cannot handle path with @ character

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13157: --- Priority: Blocker (was: Major) > ADD JAR command cannot handle path with @ character >

[jira] [Resolved] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13150. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11037

[jira] [Resolved] (SPARK-12951) Support spilling in generate aggregate

2016-02-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12951. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10998

[jira] [Closed] (SPARK-12715) Improve test coverage

2016-02-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-12715. -- Resolution: Won't Fix > Improve test coverage > - > > Key:

[jira] [Commented] (SPARK-12715) Improve test coverage

2016-02-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127359#comment-15127359 ] Davies Liu commented on SPARK-12715: It was a guess, unfortunately it's wrong, we can close this

[jira] [Created] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

2016-02-01 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13114: -- Summary: java.lang.NegativeArraySizeException in CSV Key: SPARK-13114 URL: https://issues.apache.org/jira/browse/SPARK-13114 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13131) Use best time in benchmark

2016-02-01 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13131: -- Summary: Use best time in benchmark Key: SPARK-13131 URL: https://issues.apache.org/jira/browse/SPARK-13131 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12715) Improve test coverage

2016-02-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126766#comment-15126766 ] Davies Liu commented on SPARK-12715: I think Hive should have lots of test cases for parser, it will

[jira] [Updated] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

2016-02-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13114: --- Priority: Critical (was: Major) > java.lang.NegativeArraySizeException in CSV >

[jira] [Resolved] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

2016-01-31 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13093. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10987

[jira] [Assigned] (SPARK-12913) Reimplement stat functions as declarative function

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12913: -- Assignee: Davies Liu > Reimplement stat functions as declarative function >

[jira] [Resolved] (SPARK-12914) Generate TungstenAggregate with grouping keys

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12914. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10855

[jira] [Resolved] (SPARK-13098) remove GenericInternalRowWithSchema

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13098. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10992

[jira] [Assigned] (SPARK-12951) Support spilling in generate aggregate

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12951: -- Assignee: Davies Liu > Support spilling in generate aggregate >

[jira] [Resolved] (SPARK-13072) simplify and improve murmur3 hash expression codegen

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13072. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10974

[jira] [Updated] (SPARK-13095) improve performance of hash join with dimension table

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13095: --- Component/s: SQL > improve performance of hash join with dimension table >

[jira] [Created] (SPARK-13095) improve performance of hash join with dimension table

2016-01-29 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13095: -- Summary: improve performance of hash join with dimension table Key: SPARK-13095 URL: https://issues.apache.org/jira/browse/SPARK-13095 Project: Spark Issue

[jira] [Updated] (SPARK-12913) Reimplement stat functions as declarative function

2016-01-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12913: --- Summary: Reimplement stat functions as declarative function (was: Reimplement stddev/variance as

[jira] [Resolved] (SPARK-13067) DataFrameSuite.simple explode fail locally

2016-01-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13067. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10970

[jira] [Resolved] (SPARK-13031) Improve test coverage for whole stage codegen

2016-01-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13031. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10944

[jira] [Updated] (SPARK-12913) Reimplement stddev/variance as declarative function

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12913: --- Summary: Reimplement stddev/variance as declarative function (was: Reimplement all builtin

[jira] [Resolved] (SPARK-13045) Clean up ColumnarBatch.Row and Column.Struct

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13045. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10952

[jira] [Created] (SPARK-13031) Improve test coverage for whole stage codegen

2016-01-27 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13031: -- Summary: Improve test coverage for whole stage codegen Key: SPARK-13031 URL: https://issues.apache.org/jira/browse/SPARK-13031 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12950) Improve performance of BytesToBytesMap

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12950: -- Assignee: Davies Liu > Improve performance of BytesToBytesMap >

[jira] [Updated] (SPARK-12950) Improve performance of BytesToBytesMap

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12950: --- Assignee: (was: Davies Liu) > Improve performance of BytesToBytesMap >

[jira] [Resolved] (SPARK-12902) Visualization and metrics for generated operators

2016-01-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12902. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10828

[jira] [Resolved] (SPARK-12879) improve unsafe row writing framework

2016-01-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12879. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10809

[jira] [Updated] (SPARK-12950) Improve performance of BytesToBytesMap

2016-01-22 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12950: --- Description: When benchmark generated aggregate with grouping keys, the profiling show that lookup

[jira] [Resolved] (SPARK-12960) Some examples are missing support for python2

2016-01-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12960. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10872

[jira] [Created] (SPARK-12949) Support common expression elimination

2016-01-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12949: -- Summary: Support common expression elimination Key: SPARK-12949 URL: https://issues.apache.org/jira/browse/SPARK-12949 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12950) Improve performance of BytesToBytesMap

2016-01-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12950: -- Summary: Improve performance of BytesToBytesMap Key: SPARK-12950 URL: https://issues.apache.org/jira/browse/SPARK-12950 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12951) Support spilling in generate aggregate

2016-01-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12951: -- Summary: Support spilling in generate aggregate Key: SPARK-12951 URL: https://issues.apache.org/jira/browse/SPARK-12951 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12798) Broadcast hash join

2016-01-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12798: -- Assignee: Davies Liu > Broadcast hash join > --- > > Key:

[jira] [Resolved] (SPARK-12797) Aggregation without grouping keys

2016-01-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12797. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10840

[jira] [Updated] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12881: --- Fix Version/s: 2.0.0 > Enable sub-expression Elimination in generated mutable projection >

[jira] [Resolved] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12881. Resolution: Fixed Target Version/s: 2.0.0 > Enable sub-expression Elimination in

[jira] [Created] (SPARK-12913) Reimplement all builtin aggregate functions as declarative function

2016-01-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12913: -- Summary: Reimplement all builtin aggregate functions as declarative function Key: SPARK-12913 URL: https://issues.apache.org/jira/browse/SPARK-12913 Project: Spark

[jira] [Created] (SPARK-12914) Generate TungstenAggregate with grouping keys

2016-01-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12914: -- Summary: Generate TungstenAggregate with grouping keys Key: SPARK-12914 URL: https://issues.apache.org/jira/browse/SPARK-12914 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12913) Reimplement all builtin aggregate functions as declarative function

2016-01-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12913: --- Description: As benchmarked and discussed here:

[jira] [Created] (SPARK-12915) SQL metrics for generated operators

2016-01-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12915: -- Summary: SQL metrics for generated operators Key: SPARK-12915 URL: https://issues.apache.org/jira/browse/SPARK-12915 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-12700) SortMergeJoin and BroadcastHashJoin should support condition

2016-01-18 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12700. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10653

[jira] [Created] (SPARK-12902) Visualization and metrics for generated operators

2016-01-18 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12902: -- Summary: Visualization and metrics for generated operators Key: SPARK-12902 URL: https://issues.apache.org/jira/browse/SPARK-12902 Project: Spark Issue Type:

[jira] [Created] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-18 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12881: -- Summary: Enable sub-expression Elimination in generated mutable projection Key: SPARK-12881 URL: https://issues.apache.org/jira/browse/SPARK-12881 Project: Spark

[jira] [Resolved] (SPARK-12860) speed up safe projection for primitive types

2016-01-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12860. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10790

[jira] [Resolved] (SPARK-12856) speed up hashCode of unsafe array

2016-01-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12856. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10784

[jira] [Resolved] (SPARK-12796) initial prototype: projection/filter/range

2016-01-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12796. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10735

[jira] [Created] (SPARK-12840) Support pass any object into codegen as reference

2016-01-15 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12840: -- Summary: Support pass any object into codegen as reference Key: SPARK-12840 URL: https://issues.apache.org/jira/browse/SPARK-12840 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-12840) Support passing arbitrary objects (not just expressions) into code generated classes

2016-01-15 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12840. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10777

[jira] [Commented] (SPARK-10538) java.lang.NegativeArraySizeException during join

2016-01-15 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102653#comment-15102653 ] Davies Liu commented on SPARK-10538: @mayxine The problem you posted is not related to this JIRA, it

[jira] [Created] (SPARK-12848) Parse number as decimal

2016-01-15 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12848: -- Summary: Parse number as decimal Key: SPARK-12848 URL: https://issues.apache.org/jira/browse/SPARK-12848 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12848) Parse number as decimal

2016-01-15 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102797#comment-15102797 ] Davies Liu commented on SPARK-12848: [~hvanhovell] The `BD` tag only works in Hive, other databases

[jira] [Commented] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

2016-01-15 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102802#comment-15102802 ] Davies Liu commented on SPARK-11219: It's nice to have, useful when you use online help in console.

[jira] [Resolved] (SPARK-9297) covar_pop and covar_samp aggregate functions

2016-01-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9297. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10029

[jira] [Created] (SPARK-12797) Aggregation without grouping keys

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12797: -- Summary: Aggregation without grouping keys Key: SPARK-12797 URL: https://issues.apache.org/jira/browse/SPARK-12797 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12796) initial prototype: projection/filter/range

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12796: -- Summary: initial prototype: projection/filter/range Key: SPARK-12796 URL: https://issues.apache.org/jira/browse/SPARK-12796 Project: Spark Issue Type: New

[jira] [Created] (SPARK-12798) Broadcast hash join

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12798: -- Summary: Broadcast hash join Key: SPARK-12798 URL: https://issues.apache.org/jira/browse/SPARK-12798 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-12795) Whole stage codegen

2016-01-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12795: --- Description: Whole stage codegen is used by some modern MPP databases to archive great performance.

[jira] [Updated] (SPARK-12795) Whole stage codegen

2016-01-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12795: --- Summary: Whole stage codegen (was: Compile multiple operator into a single Java function to avoid

[jira] [Created] (SPARK-12795) Compile multiple operator into a single Java function to avoid the overhead from materialize rows and Scala iterator

2016-01-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12795: -- Summary: Compile multiple operator into a single Java function to avoid the overhead from materialize rows and Scala iterator Key: SPARK-12795 URL:

[jira] [Commented] (SPARK-12731) PySpark docstring cleanup

2016-01-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094520#comment-15094520 ] Davies Liu commented on SPARK-12731: Enforce some style checking will bring some cost for

[jira] [Assigned] (SPARK-12545) Support exists condition

2016-01-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12545: -- Assignee: Davies Liu > Support exists condition > > >

[jira] [Updated] (SPARK-12687) Support from clause surrounded by `()`

2016-01-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12687: --- Assignee: Liang-Chi Hsieh > Support from clause surrounded by `()` >

[jira] [Commented] (SPARK-12740) grouping()/grouping_id() should work with having and order by

2016-01-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092602#comment-15092602 ] Davies Liu commented on SPARK-12740: They will be introduced by

[jira] [Assigned] (SPARK-12700) SortMergeJoin and BroadcastHashJoin should support condition

2016-01-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12700: -- Assignee: Davies Liu > SortMergeJoin and BroadcastHashJoin should support condition >

[jira] [Created] (HIVE-12833) GROUPING__ID is wrong

2016-01-09 Thread Davies Liu (JIRA)
Davies Liu created HIVE-12833: - Summary: GROUPING__ID is wrong Key: HIVE-12833 URL: https://issues.apache.org/jira/browse/HIVE-12833 Project: Hive Issue Type: Bug Reporter: Davies

[jira] [Created] (SPARK-12740) grouping()/grouping_id() should work with having and order by

2016-01-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12740: -- Summary: grouping()/grouping_id() should work with having and order by Key: SPARK-12740 URL: https://issues.apache.org/jira/browse/SPARK-12740 Project: Spark

[jira] [Updated] (SPARK-12738) GROUPING__ID is wrong

2016-01-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12738: --- Description: For group set, GROUPING__ID should be 1 if the column is aggregated, or 0. The current

[jira] [Created] (SPARK-12738) GROUPING__ID is wrong

2016-01-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12738: -- Summary: GROUPING__ID is wrong Key: SPARK-12738 URL: https://issues.apache.org/jira/browse/SPARK-12738 Project: Spark Issue Type: Bug Components: SQL

[jira] [Assigned] (SPARK-12543) Support subquery in select/where/having

2016-01-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12543: -- Assignee: Davies Liu > Support subquery in select/where/having >

[jira] [Resolved] (SPARK-12687) Support from clause surrounded by `()`

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12687. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10660

[jira] [Created] (SPARK-12715) Improve test coverage

2016-01-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12715: -- Summary: Improve test coverage Key: SPARK-12715 URL: https://issues.apache.org/jira/browse/SPARK-12715 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Updated] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12706: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-12540 > support grouping/grouping_id

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12705: --- Description: The following query can't be resolved: ``` scala> sqlContext.sql("select sum(a) over

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12705: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-12540 > Sorting column can't be resolved if

[jira] [Commented] (SPARK-11214) Join with Unicode-String results wrong empty

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090222#comment-15090222 ] Davies Liu commented on SPARK-11214: [~xDSticker] Could you try this in master or 1.6? I couldn't

[jira] [Commented] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089994#comment-15089994 ] Davies Liu commented on SPARK-12705: [~smilegator]I had updated JIRA to have a reproducable test

[jira] [Created] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-01-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12729: -- Summary: phantom references to replace the finalize call in python broadcast Key: SPARK-12729 URL: https://issues.apache.org/jira/browse/SPARK-12729 Project: Spark

[jira] [Assigned] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12706: -- Assignee: Davies Liu > support grouping/grouping_id function together group set >

[jira] [Resolved] (SPARK-12577) better support of parentheses in partition by and order by clause of window function's over clause

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12577. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10620

[jira] [Created] (SPARK-12700) SortMergeJoin and BroadcastHashJoin should support condition

2016-01-07 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12700: -- Summary: SortMergeJoin and BroadcastHashJoin should support condition Key: SPARK-12700 URL: https://issues.apache.org/jira/browse/SPARK-12700 Project: Spark

[jira] [Created] (SPARK-12706) support grouping function together group set

2016-01-07 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12706: -- Summary: support grouping function together group set Key: SPARK-12706 URL: https://issues.apache.org/jira/browse/SPARK-12706 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12706: --- Summary: support grouping/grouping_id function together group set (was: support grouping function

[jira] [Updated] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12706: --- Description:

[jira] [Updated] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12706: --- Assignee: (was: Davies Liu) > support grouping/grouping_id function together group set >

[jira] [Created] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-07 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12705: -- Summary: Sorting column can't be resolved if it's not in projection Key: SPARK-12705 URL: https://issues.apache.org/jira/browse/SPARK-12705 Project: Spark Issue

<    4   5   6   7   8   9   10   11   12   13   >