[jira] [Updated] (SPARK-12659) NPE when spill in CartisianProduct

[ https://issues.apache.org/jira/browse/SPARK-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12659: --- Affects Version/s: (was: 1.6.0) 2.0.0 > NPE when spill in

[jira] [Assigned] (SPARK-12542) Support intersect/except in Hive SQL

[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12542: -- Assignee: Davies Liu (was: Xiao Li) > Support intersect/except in Hive SQL >

[jira] [Updated] (SPARK-12542) Support intersect/except in Hive SQL

[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12542: --- Summary: Support intersect/except in Hive SQL (was: Support union/intersect/except in Hive SQL) >

[jira] [Commented] (SPARK-12662) Add a local sort operator to DataFrame used by randomSplit

[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086056#comment-15086056 ] Davies Liu commented on SPARK-12662: Another way to make the DataFrame deterministic is materialize

[jira] [Resolved] (SPARK-12681) Split IdentifiersParser.g to avoid single huge java source

[ https://issues.apache.org/jira/browse/SPARK-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12681. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10624

[jira] [Created] (SPARK-12681) Split IdentifiersParser.g to avoid single huge java source

Davies Liu created SPARK-12681: -- Summary: Split IdentifiersParser.g to avoid single huge java source Key: SPARK-12681 URL: https://issues.apache.org/jira/browse/SPARK-12681 Project: Spark Issue

[jira] [Assigned] (SPARK-12681) Split IdentifiersParser.g to avoid single huge java source

[ https://issues.apache.org/jira/browse/SPARK-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12681: -- Assignee: Davies Liu > Split IdentifiersParser.g to avoid single huge java source >

[jira] [Created] (SPARK-12659) NPE when spill in CartisianProduct

Davies Liu created SPARK-12659: -- Summary: NPE when spill in CartisianProduct Key: SPARK-12659 URL: https://issues.apache.org/jira/browse/SPARK-12659 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12511. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Resolved] (SPARK-12617) socket descriptor leak killing streaming app

[ https://issues.apache.org/jira/browse/SPARK-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12617. Resolution: Fixed Fix Version/s: 1.6.1 1.5.3 2.0.0

[jira] [Resolved] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12636. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10581

[jira] [Created] (SPARK-12661) Drop Python 2.6 support in PySpark

Davies Liu created SPARK-12661: -- Summary: Drop Python 2.6 support in PySpark Key: SPARK-12661 URL: https://issues.apache.org/jira/browse/SPARK-12661 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12470. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Resolved] (SPARK-12541) Support rollup/cube in SQL query

[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12541. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10522

[jira] [Commented] (SPARK-12624) When schema is specified, we should treat undeclared fields as null (in Python)

[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081932#comment-15081932 ] Davies Liu commented on SPARK-12624: [~rxin] The RDD or list could be just tuple, how do we know

[jira] [Resolved] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12289. Resolution: Fixed Assignee: Davies Liu (was: Apache Spark) Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-12292) Support UnsafeRow in Generate

[ https://issues.apache.org/jira/browse/SPARK-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12292. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > Support UnsafeRow in

[jira] [Resolved] (SPARK-12293) Support UnsafeRow in LocalTableScan

[ https://issues.apache.org/jira/browse/SPARK-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12293. Resolution: Fixed Assignee: Davies Liu (was: Liang-Chi Hsieh) Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12585. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10528

[jira] [Created] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

Davies Liu created SPARK-12585: -- Summary: The numFields of UnsafeRow should not changed by pointTo() Key: SPARK-12585 URL: https://issues.apache.org/jira/browse/SPARK-12585 Project: Spark Issue

[jira] [Updated] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12585: --- Description: Right now, numFields will be passed in by pointTo(), then bitSetWidthInBytes is

[jira] [Assigned] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12585: -- Assignee: Davies Liu > The numFields of UnsafeRow should not changed by pointTo() >

[jira] [Updated] (SPARK-12300) Fix schema inferance on local collections

[ https://issues.apache.org/jira/browse/SPARK-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12300: --- Fix Version/s: (was: 1.6.0) 1.6.1 > Fix schema inferance on local collections

[jira] [Resolved] (SPARK-12300) Fix schema inferance on local collections

[ https://issues.apache.org/jira/browse/SPARK-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12300. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12542) Support union/intersect/except in Hive SQL

[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074368#comment-15074368 ] Davies Liu commented on SPARK-12542: [~viirya] [~xiaol] That's true, updated the title. Once

[jira] [Updated] (SPARK-12542) Support union/intersect/except in Hive SQL

[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12542: --- Assignee: Xiao Li > Support union/intersect/except in Hive SQL >

[jira] [Updated] (SPARK-12542) Support union/intersect/except in Hive SQL

[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12542: --- Summary: Support union/intersect/except in Hive SQL (was: Support intersect/except in SQL) >

[jira] [Updated] (SPARK-12542) Support union/intersect/except in Hive SQL

[ https://issues.apache.org/jira/browse/SPARK-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12542: --- Description: (was: Also `UNION ALL`in Hive SQL parser) > Support union/intersect/except in Hive

[jira] [Commented] (SPARK-12385) Push projection into Join

[ https://issues.apache.org/jira/browse/SPARK-12385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074383#comment-15074383 ] Davies Liu commented on SPARK-12385: [~smilegator] Thanks for working on this, could you take the

[jira] [Commented] (SPARK-12544) Support window functions in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074369#comment-15074369 ] Davies Liu commented on SPARK-12544: [~hvanhovell] Right now, the SQL parser can't parse the clause

[jira] [Assigned] (SPARK-12541) Support rollup/cube in SQL query

[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12541: -- Assignee: Davies Liu > Support rollup/cube in SQL query > >

[jira] [Updated] (SPARK-12541) Support rollup/cube in SQL query

[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12541: --- Description: We have DataFrame API for rollup/cube, but do not support them in SQL parser (both

[jira] [Updated] (SPARK-12541) Support rollup/cube in SQL query

[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12541: --- Description: We have DataFrame API for rollup/cube, but do not support them in SQL parser (both

[jira] [Updated] (SPARK-12541) Support rollup/cube in SQL query

[ https://issues.apache.org/jira/browse/SPARK-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12541: --- Summary: Support rollup/cube in SQL query (was: Support rollup/cube/povit in SQL query) > Support

[jira] [Commented] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074726#comment-15074726 ] Davies Liu commented on SPARK-11437: [~maver1ck] Maybe we should provide a API to verify the schema

[jira] [Closed] (SPARK-12291) Support UnsafeRow in BroadcastLeftSemiJoinHash

[ https://issues.apache.org/jira/browse/SPARK-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-12291. -- Resolution: Not A Problem > Support UnsafeRow in BroadcastLeftSemiJoinHash >

[jira] [Closed] (SPARK-11855) Catalyst breaks backwards compatibility in branch-1.6

[ https://issues.apache.org/jira/browse/SPARK-11855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-11855. -- Resolution: Won't Fix > Catalyst breaks backwards compatibility in branch-1.6 >

[jira] [Assigned] (SPARK-12540) Support all TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-12540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12540: -- Assignee: Davies Liu > Support all TPCDS queries > - > >

[jira] [Commented] (SPARK-12291) Support UnsafeRow in BroadcastLeftSemiJoinHash

[ https://issues.apache.org/jira/browse/SPARK-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074729#comment-15074729 ] Davies Liu commented on SPARK-12291: Thanks, I will close this one. > Support UnsafeRow in

[jira] [Created] (SPARK-12541) Support rollup/cube/povit in SQL query

Davies Liu created SPARK-12541: -- Summary: Support rollup/cube/povit in SQL query Key: SPARK-12541 URL: https://issues.apache.org/jira/browse/SPARK-12541 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12544) Support window functions in SQLContext

Davies Liu created SPARK-12544: -- Summary: Support window functions in SQLContext Key: SPARK-12544 URL: https://issues.apache.org/jira/browse/SPARK-12544 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12545) Support exists condition

Davies Liu created SPARK-12545: -- Summary: Support exists condition Key: SPARK-12545 URL: https://issues.apache.org/jira/browse/SPARK-12545 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12540) Support all TPCDS queries

Davies Liu created SPARK-12540: -- Summary: Support all TPCDS queries Key: SPARK-12540 URL: https://issues.apache.org/jira/browse/SPARK-12540 Project: Spark Issue Type: Epic Components:

[jira] [Created] (SPARK-12543) Support subquery in select/where/having

Davies Liu created SPARK-12543: -- Summary: Support subquery in select/where/having Key: SPARK-12543 URL: https://issues.apache.org/jira/browse/SPARK-12543 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12542) Support intersect/except in SQL

Davies Liu created SPARK-12542: -- Summary: Support intersect/except in SQL Key: SPARK-12542 URL: https://issues.apache.org/jira/browse/SPARK-12542 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12511: --- Assignee: Shixiong Zhu > streaming driver with checkpointing unable to finalize leading to OOM >

[jira] [Resolved] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12520. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10477

[jira] [Updated] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12520: --- Assignee: Xiao Li > Python API dataframe join returns wrong results on outer join >

[jira] [Updated] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12520: --- Fix Version/s: 1.6.0 > Python API dataframe join returns wrong results on outer join >

[jira] [Updated] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12520: --- Fix Version/s: 1.5.3 > Python API dataframe join returns wrong results on outer join >

[jira] [Created] (SPARK-12472) OOM when sort a table and save as parquet

Davies Liu created SPARK-12472: -- Summary: OOM when sort a table and save as parquet Key: SPARK-12472 URL: https://issues.apache.org/jira/browse/SPARK-12472 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12388) Change default compressor to LZ4

[ https://issues.apache.org/jira/browse/SPARK-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12388. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10342

[jira] [Commented] (SPARK-12472) OOM when sort a table and save as parquet

[ https://issues.apache.org/jira/browse/SPARK-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067413#comment-15067413 ] Davies Liu commented on SPARK-12472: could be workarounded by decreasing the memory used by both

[jira] [Resolved] (SPARK-12054) Consider nullable in codegen

[ https://issues.apache.org/jira/browse/SPARK-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12054. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10333

[jira] [Resolved] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12341. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > The

[jira] [Resolved] (SPARK-12342) Corr (Pearson correlation) should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12342. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Corr

[jira] [Resolved] (SPARK-12336) Outer join using multiple columns results in wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12336. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Outer

[jira] [Assigned] (SPARK-12342) Corr (Pearson correlation) should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12342: -- Assignee: Davies Liu (was: Cheng Lian) > Corr (Pearson correlation) should be nullable >

[jira] [Assigned] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12341: -- Assignee: Davies Liu (was: Apache Spark) > The "comment" field of DESCRIBE result set should

[jira] [Assigned] (SPARK-12335) CentralMomentAgg should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12335: -- Assignee: Davies Liu (was: Apache Spark) > CentralMomentAgg should be nullable >

[jira] [Resolved] (SPARK-12335) CentralMomentAgg should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12335. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 >

[jira] [Assigned] (SPARK-12336) Outer join using multiple columns results in wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12336: -- Assignee: Davies Liu (was: Cheng Lian) > Outer join using multiple columns results in wrong

[jira] [Resolved] (SPARK-12091) [PySpark] Removal of the JAVA-specific deserialized storage levels

[ https://issues.apache.org/jira/browse/SPARK-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12091. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10092

[jira] [Assigned] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12395: -- Assignee: Davies Liu > Result of DataFrame.join(usingColumns) could be wrong for outer join >

[jira] [Created] (SPARK-12402) Memory leak in broadcast hash join

Davies Liu created SPARK-12402: -- Summary: Memory leak in broadcast hash join Key: SPARK-12402 URL: https://issues.apache.org/jira/browse/SPARK-12402 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12395. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-12402) Memory leak in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12402: --- Description: After run some SQL query in PySpark, the DataFrame are still referenced by py4j

[jira] [Updated] (SPARK-12402) Memory leak in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12402: --- Summary: Memory leak in pyspark (was: Memory leak in broadcast hash join) > Memory leak in pyspark

[jira] [Resolved] (SPARK-8745) Remove GenerateProjection

[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8745. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10316

[jira] [Resolved] (SPARK-12380) MLLib should use existing SQLContext instead create new one

[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12380. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Created] (SPARK-12380) MLLib should use existing SQLContext instead create new one

Davies Liu created SPARK-12380: -- Summary: MLLib should use existing SQLContext instead create new one Key: SPARK-12380 URL: https://issues.apache.org/jira/browse/SPARK-12380 Project: Spark

[jira] [Created] (SPARK-12385) Push projection into Join

Davies Liu created SPARK-12385: -- Summary: Push projection into Join Key: SPARK-12385 URL: https://issues.apache.org/jira/browse/SPARK-12385 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

Davies Liu created SPARK-12395: -- Summary: Result of DataFrame.join(usingColumns) could be wrong for outer join Key: SPARK-12395 URL: https://issues.apache.org/jira/browse/SPARK-12395 Project: Spark

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12395: --- Priority: Critical (was: Major) > Result of DataFrame.join(usingColumns) could be wrong for outer

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12395: --- Priority: Blocker (was: Critical) > Result of DataFrame.join(usingColumns) could be wrong for outer

[jira] [Created] (SPARK-12388) Change default compressor to LZ4

Davies Liu created SPARK-12388: -- Summary: Change default compressor to LZ4 Key: SPARK-12388 URL: https://issues.apache.org/jira/browse/SPARK-12388 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12388) Change default compressor to LZ4

[ https://issues.apache.org/jira/browse/SPARK-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12388: --- Description: According the benchmark [1], LZ4-java could be 80% (or 30%) faster than Snappy. After

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12395: --- Affects Version/s: 1.6.0 > Result of DataFrame.join(usingColumns) could be wrong for outer join >

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12395: --- Priority: Blocker (was: Critical) > Result of DataFrame.join(usingColumns) could be wrong for outer

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12395: --- Component/s: SQL > Result of DataFrame.join(usingColumns) could be wrong for outer join >

[jira] [Updated] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12395: --- Priority: Critical (was: Blocker) > Result of DataFrame.join(usingColumns) could be wrong for outer

[jira] [Updated] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

[ https://issues.apache.org/jira/browse/SPARK-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12288: --- Assignee: Xiao Li > Support UnsafeRow in Coalesce/Except/Intersect >

[jira] [Updated] (SPARK-12293) Support UnsafeRow in LocalTableScan

[ https://issues.apache.org/jira/browse/SPARK-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12293: --- Assignee: Liang-Chi Hsieh (was: Apache Spark) > Support UnsafeRow in LocalTableScan >

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060213#comment-15060213 ] Davies Liu commented on SPARK-12179: I think this UDF is not thread safe, rowNum and comparedColumn

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060217#comment-15060217 ] Davies Liu commented on SPARK-12179: Which version of Spark are you using? > Spark SQL get

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060217#comment-15060217 ] Davies Liu edited comment on SPARK-12179 at 12/16/15 4:04 PM: -- Which

[jira] [Assigned] (SPARK-8745) Remove GenerateProjection

[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-8745: - Assignee: Davies Liu > Remove GenerateProjection > - > >

[jira] [Resolved] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

[ https://issues.apache.org/jira/browse/SPARK-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12288. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10285

[jira] [Resolved] (SPARK-12016) word2vec load model can't use findSynonyms to get words

[ https://issues.apache.org/jira/browse/SPARK-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12016. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10100

[jira] [Created] (SPARK-12284) Output UnsafeRow from window function

Davies Liu created SPARK-12284: -- Summary: Output UnsafeRow from window function Key: SPARK-12284 URL: https://issues.apache.org/jira/browse/SPARK-12284 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12286) Support UnsafeRow in all SparkPlan (if possible)

Davies Liu created SPARK-12286: -- Summary: Support UnsafeRow in all SparkPlan (if possible) Key: SPARK-12286 URL: https://issues.apache.org/jira/browse/SPARK-12286 Project: Spark Issue Type:

[jira] [Created] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

Davies Liu created SPARK-12289: -- Summary: Support UnsafeRow in TakeOrderedAndProject/Limit Key: SPARK-12289 URL: https://issues.apache.org/jira/browse/SPARK-12289 Project: Spark Issue Type:

[jira] [Created] (SPARK-12290) Change the default value in SparkPlan

Davies Liu created SPARK-12290: -- Summary: Change the default value in SparkPlan Key: SPARK-12290 URL: https://issues.apache.org/jira/browse/SPARK-12290 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12283) Use UnsafeRow as the buffer in SortBasedAggregation to avoid Unsafe/Safe conversion

Davies Liu created SPARK-12283: -- Summary: Use UnsafeRow as the buffer in SortBasedAggregation to avoid Unsafe/Safe conversion Key: SPARK-12283 URL: https://issues.apache.org/jira/browse/SPARK-12283

[jira] [Assigned] (SPARK-12286) Support UnsafeRow in all SparkPlan (if possible)

[ https://issues.apache.org/jira/browse/SPARK-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12286: -- Assignee: Davies Liu > Support UnsafeRow in all SparkPlan (if possible) >

[jira] [Updated] (SPARK-12287) Support UnsafeRow in MapPartitions/MapGroups/CoGroup

[ https://issues.apache.org/jira/browse/SPARK-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12287: --- Issue Type: Improvement (was: Epic) > Support UnsafeRow in MapPartitions/MapGroups/CoGroup >

[jira] [Created] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

Davies Liu created SPARK-12288: -- Summary: Support UnsafeRow in Coalesce/Except/Intersect Key: SPARK-12288 URL: https://issues.apache.org/jira/browse/SPARK-12288 Project: Spark Issue Type:

[jira] [Created] (SPARK-12291) Support UnsafeRow in BroadcastLeftSemiJoinHash

Davies Liu created SPARK-12291: -- Summary: Support UnsafeRow in BroadcastLeftSemiJoinHash Key: SPARK-12291 URL: https://issues.apache.org/jira/browse/SPARK-12291 Project: Spark Issue Type:

[jira] [Created] (SPARK-12293) Support UnsafeRow in LocalTableScan

Davies Liu created SPARK-12293: -- Summary: Support UnsafeRow in LocalTableScan Key: SPARK-12293 URL: https://issues.apache.org/jira/browse/SPARK-12293 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12294) Support UnsafeRow in HiveTableScan

Davies Liu created SPARK-12294: -- Summary: Support UnsafeRow in HiveTableScan Key: SPARK-12294 URL: https://issues.apache.org/jira/browse/SPARK-12294 Project: Spark Issue Type: Improvement

<    5   6   7   8   9   10   11   12   13   14   >