[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007565#comment-15007565 ] Davies Liu commented on SPARK-11016: [~charles.al...@acxiom.com] Could you send your

[jira] [Reopened] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-11016: Assignee: (was: Liang-Chi Hsieh) https://github.com/apache/spark/pull/9243 is reverted > Spa

[jira] [Resolved] (SPARK-11743) Add UserDefinedType support to RowEncoder

[ https://issues.apache.org/jira/browse/SPARK-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11743. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9712 [https://github.c

[jira] [Updated] (SPARK-11752) fix timezone problem for DateTimeUtils.getSeconds

[ https://issues.apache.org/jira/browse/SPARK-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11752: --- Fix Version/s: (was: 1.5.2) 1.5.3 > fix timezone problem for DateTimeUtils.get

[jira] [Resolved] (SPARK-11752) fix timezone problem for DateTimeUtils.getSeconds

[ https://issues.apache.org/jira/browse/SPARK-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11752. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Created] (SPARK-11739) Dead SQLContext may not be cleared

Davies Liu created SPARK-11739: -- Summary: Dead SQLContext may not be cleared Key: SPARK-11739 URL: https://issues.apache.org/jira/browse/SPARK-11739 Project: Spark Issue Type: Bug Comp

[jira] [Created] (SPARK-11737) String may not be serialized correctly with Kyro

Davies Liu created SPARK-11737: -- Summary: String may not be serialized correctly with Kyro Key: SPARK-11737 URL: https://issues.apache.org/jira/browse/SPARK-11737 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10712) JVM crashes with spark.sql.tungsten.enabled = true

[ https://issues.apache.org/jira/browse/SPARK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004636#comment-15004636 ] Davies Liu commented on SPARK-10712: How is you small table looks like? Does 1.5.2-RC

[jira] [Commented] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004626#comment-15004626 ] Davies Liu commented on SPARK-9278: --- cc [~lian cheng] > DataFrameWriter.insertInto inse

[jira] [Assigned] (SPARK-11643) inserting date with leading zero inserts null example '0001-12-10'

[ https://issues.apache.org/jira/browse/SPARK-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11643: -- Assignee: Davies Liu > inserting date with leading zero inserts null example '0001-12-10' > --

[jira] [Assigned] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-8029: - Assignee: Davies Liu (was: Imran Rashid) > ShuffleMapTasks must be robust to concurrent attempts

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8029: -- Fix Version/s: (was: 1.7.0) 1.6.0 > ShuffleMapTasks must be robust to concurrent

[jira] [Resolved] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8029. --- Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9610 [https://github.com/

[jira] [Resolved] (SPARK-11396) datetime function: to_unix_timestamp

[ https://issues.apache.org/jira/browse/SPARK-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11396. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9347 [https://github.c

[jira] [Resolved] (SPARK-11481) orderBy with multiple columns in WindowSpec does not work properly

[ https://issues.apache.org/jira/browse/SPARK-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11481. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 1.5.2

[jira] [Commented] (SPARK-11481) orderBy with multiple columns in WindowSpec does not work properly

[ https://issues.apache.org/jira/browse/SPARK-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000826#comment-15000826 ] Davies Liu commented on SPARK-11481: I think this is related to https://issues.apache

[jira] [Resolved] (SPARK-11463) SparkContext fail to create in non-main thread in Python

[ https://issues.apache.org/jira/browse/SPARK-11463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11463. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9574 [https://github.c

[jira] [Resolved] (SPARK-11468) Add R API for stddev/variance

[ https://issues.apache.org/jira/browse/SPARK-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11468. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9489 [https://github.c

[jira] [Resolved] (SPARK-11566) Refactoring GaussianMixtureModel.gaussians in Python

[ https://issues.apache.org/jira/browse/SPARK-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11566. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9534 [https://github.c

[jira] [Resolved] (SPARK-11567) Add Python API for corr aggregate function

[ https://issues.apache.org/jira/browse/SPARK-11567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11567. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9536 [https://github.c

[jira] [Resolved] (SPARK-11599) NPE when resolve a non-existent function

[ https://issues.apache.org/jira/browse/SPARK-11599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11599. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9576 [https://github.c

[jira] [Resolved] (SPARK-11598) Add tests for ShuffledHashOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-11598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11598. Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9573 [https://github.c

[jira] [Resolved] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11595. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9569 [https://github.c

[jira] [Created] (SPARK-11609) Resolve Hive Function

Davies Liu created SPARK-11609: -- Summary: Resolve Hive Function Key: SPARK-11609 URL: https://issues.apache.org/jira/browse/SPARK-11609 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-11481) orderBy with multiple columns in WindowSpec does not work properly

[ https://issues.apache.org/jira/browse/SPARK-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997271#comment-14997271 ] Davies Liu commented on SPARK-11481: [~jamartinh] Could you provide more details abou

[jira] [Comment Edited] (SPARK-11481) orderBy with multiple columns in WindowSpec does not work properly

[ https://issues.apache.org/jira/browse/SPARK-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997271#comment-14997271 ] Davies Liu edited comment on SPARK-11481 at 11/9/15 8:13 PM: -

[jira] [Created] (SPARK-11599) NPE when resolve a non-existent function

Davies Liu created SPARK-11599: -- Summary: NPE when resolve a non-existent function Key: SPARK-11599 URL: https://issues.apache.org/jira/browse/SPARK-11599 Project: Spark Issue Type: Bug Affe

[jira] [Created] (SPARK-11598) Add tests for ShuffledHashOuterJoin

Davies Liu created SPARK-11598: -- Summary: Add tests for ShuffledHashOuterJoin Key: SPARK-11598 URL: https://issues.apache.org/jira/browse/SPARK-11598 Project: Spark Issue Type: Test

[jira] [Closed] (SPARK-10424) ShuffleHashOuterJoin should consider condition

[ https://issues.apache.org/jira/browse/SPARK-10424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-10424. -- Resolution: Invalid ShuffleHashOuterJoin actually support conpdition > ShuffleHashOuterJoin should con

[jira] [Closed] (SPARK-10246) Join in PySpark using a list of column names

[ https://issues.apache.org/jira/browse/SPARK-10246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-10246. -- Resolution: Not A Problem > Join in PySpark using a list of column names >

[jira] [Commented] (SPARK-10246) Join in PySpark using a list of column names

[ https://issues.apache.org/jira/browse/SPARK-10246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997054#comment-14997054 ] Davies Liu commented on SPARK-10246: It already works. > Join in PySpark using a lis

[jira] [Commented] (SPARK-10538) java.lang.NegativeArraySizeException during join

[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997051#comment-14997051 ] Davies Liu commented on SPARK-10538: [~maver1ck] Could you reproduce this issue in ma

[jira] [Assigned] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11089: -- Assignee: Davies Liu > Add a option for thrift-server to share a single session across all >

[jira] [Closed] (SPARK-10425) Add a regression test for SPARK-10379

[ https://issues.apache.org/jira/browse/SPARK-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-10425. -- Resolution: Won't Fix Can't reproduce the failure (easily) > Add a regression test for SPARK-10379 > -

[jira] [Commented] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997042#comment-14997042 ] Davies Liu commented on SPARK-11089: [~lian cheng] Could you help to look into this o

[jira] [Updated] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11089: --- Assignee: Cheng Lian (was: Davies Liu) > Add a option for thrift-server to share a single session ac

[jira] [Closed] (SPARK-6728) Improve performance of py4j for large bytearray

[ https://issues.apache.org/jira/browse/SPARK-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-6728. - Resolution: Won't Fix This can not be fixed without changes in Py4j, but this is not in the roadmap of Py

[jira] [Updated] (SPARK-11151) Use Long internally for DecimalType with precision <= 18

[ https://issues.apache.org/jira/browse/SPARK-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11151: --- Target Version/s: (was: 1.6.0) > Use Long internally for DecimalType with precision <= 18 > ---

[jira] [Updated] (SPARK-6728) Improve performance of py4j for large bytearray

[ https://issues.apache.org/jira/browse/SPARK-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6728: -- Target Version/s: (was: 1.6.0) > Improve performance of py4j for large bytearray > ---

[jira] [Updated] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11191: --- Target Version/s: 1.5.2, 1.5.3 (was: 1.5.2, 1.5.3, 1.6.0) > [1.5] Can't create UDF's using hive thri

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997028#comment-14997028 ] Davies Liu commented on SPARK-11191: This should work in master and 1.6. > [1.5] Can

[jira] [Assigned] (SPARK-11463) SparkContext fail to create in non-main thread in Python

[ https://issues.apache.org/jira/browse/SPARK-11463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11463: -- Assignee: Davies Liu > SparkContext fail to create in non-main thread in Python >

[jira] [Resolved] (SPARK-10783) Do track the pointer array in UnsafeInMemorySorter

[ https://issues.apache.org/jira/browse/SPARK-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10783. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 Fixed by https://github

[jira] [Resolved] (SPARK-11362) Use Spark BitSet in BroadcastNestedLoopJoin

[ https://issues.apache.org/jira/browse/SPARK-11362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11362. Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9316 [https://github.c

[jira] [Resolved] (SPARK-8467) Add LDAModel.describeTopics() in Python

[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8467. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add LDAModel.describeTopics() in Python >

[jira] [Resolved] (SPARK-9162) Implement code generation for ScalaUDF

[ https://issues.apache.org/jira/browse/SPARK-9162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9162. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9270 [https://github.com/

[jira] [Updated] (SPARK-11500) Not deterministic order of columns when using merging schemas.

[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11500: --- Assignee: Hyukjin Kwon > Not deterministic order of columns when using merging schemas. > ---

[jira] [Resolved] (SPARK-11537) hour/minute/second returns negative value

[ https://issues.apache.org/jira/browse/SPARK-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11537. Resolution: Fixed Fix Version/s: 1.5.2 1.6.1 1.6.0 Iss

[jira] [Resolved] (SPARK-11542) glm does not work with long formula

[ https://issues.apache.org/jira/browse/SPARK-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11542. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Created] (SPARK-11542) glm does not work with long formula

Davies Liu created SPARK-11542: -- Summary: glm does not work with long formula Key: SPARK-11542 URL: https://issues.apache.org/jira/browse/SPARK-11542 Project: Spark Issue Type: Bug Com

[jira] [Created] (SPARK-11537) hour/minute/second returns negative value

Davies Liu created SPARK-11537: -- Summary: hour/minute/second returns negative value Key: SPARK-11537 URL: https://issues.apache.org/jira/browse/SPARK-11537 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

[ https://issues.apache.org/jira/browse/SPARK-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11486. Resolution: Fixed Issue resolved by pull request 9383 [https://github.com/apache/spark/pull/9383]

[jira] [Resolved] (SPARK-11425) Improve hybrid aggregation (sort-based after hash-based)

[ https://issues.apache.org/jira/browse/SPARK-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11425. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9383 [https://github.c

[jira] [Resolved] (SPARK-11307) Reduce memory consumption of OutputCommitCoordinator bookkeeping structures

[ https://issues.apache.org/jira/browse/SPARK-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11307. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9274 [https://github.c

[jira] [Resolved] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11398. Resolution: Fixed Fix Version/s: 1.6.0 > unnecessary def dialectClassName in HiveContext, an

[jira] [Assigned] (SPARK-7542) Support off-heap sort buffer in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-7542: - Assignee: Davies Liu > Support off-heap sort buffer in UnsafeExternalSorter > ---

[jira] [Created] (SPARK-11493) Remove Bitset in BytesToBytesMap

Davies Liu created SPARK-11493: -- Summary: Remove Bitset in BytesToBytesMap Key: SPARK-11493 URL: https://issues.apache.org/jira/browse/SPARK-11493 Project: Spark Issue Type: Task Compo

[jira] [Resolved] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is invalid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10304. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8840 [https://github.c

[jira] [Created] (SPARK-11468) Add R API for stddev/variance

Davies Liu created SPARK-11468: -- Summary: Add R API for stddev/variance Key: SPARK-11468 URL: https://issues.apache.org/jira/browse/SPARK-11468 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-11467) Add Python API stddev/variance

Davies Liu created SPARK-11467: -- Summary: Add Python API stddev/variance Key: SPARK-11467 URL: https://issues.apache.org/jira/browse/SPARK-11467 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is invalid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10304: --- Assignee: Liang-Chi Hsieh (was: Zhan Zhang) > Partition discovery does not throw an exception if the

[jira] [Assigned] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-10429: -- Assignee: Davies Liu (was: Wenchen Fan) > MutableProjection should evaluate all expressions f

[jira] [Created] (SPARK-11463) SparkContext fail to create in non-main thread in Python

Davies Liu created SPARK-11463: -- Summary: SparkContext fail to create in non-main thread in Python Key: SPARK-11463 URL: https://issues.apache.org/jira/browse/SPARK-11463 Project: Spark Issue Ty

[jira] [Updated] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11437: --- Fix Version/s: (was: 1.6.1) 1.6.0 > createDataFrame shouldn't .take() when pro

[jira] [Resolved] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11437. Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 9392 [https://github.c

[jira] [Resolved] (SPARK-11345) Make HadoopFsRelation always outputs UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11345. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9305 [https://github.c

[jira] [Resolved] (SPARK-11117) PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows

[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9305 [https://github.c

[jira] [Resolved] (SPARK-11423) Remove PrepareRDD

[ https://issues.apache.org/jira/browse/SPARK-11423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11423. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9381 [https://github.c

[jira] [Created] (SPARK-11425) Improve hybrid aggregation (sort-based after hash-based)

Davies Liu created SPARK-11425: -- Summary: Improve hybrid aggregation (sort-based after hash-based) Key: SPARK-11425 URL: https://issues.apache.org/jira/browse/SPARK-11425 Project: Spark Issue Ty

[jira] [Created] (SPARK-11423) Remove PrepareRDD

Davies Liu created SPARK-11423: -- Summary: Remove PrepareRDD Key: SPARK-11423 URL: https://issues.apache.org/jira/browse/SPARK-11423 Project: Spark Issue Type: Improvement Components:

[jira] [Updated] (SPARK-4849) Pass partitioning information (distribute by) to In-memory caching

[ https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-4849: -- Priority: Critical (was: Minor) > Pass partitioning information (distribute by) to In-memory caching >

[jira] [Updated] (SPARK-11411) Use the space at end of pages

[ https://issues.apache.org/jira/browse/SPARK-11411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11411: --- Component/s: (was: Web UI) SQL > Use the space at end of pages > ---

[jira] [Updated] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11278: --- Target Version/s: 1.6.0 > PageRank fails with unified memory manager > --

[jira] [Updated] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11278: --- Priority: Blocker (was: Major) > PageRank fails with unified memory manager > --

[jira] [Resolved] (SPARK-11417) @Override is not supported by older version of Janino

[ https://issues.apache.org/jira/browse/SPARK-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11417. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Resolved] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10929. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 Target Vers

[jira] [Resolved] (SPARK-10342) Cooperative memory management

[ https://issues.apache.org/jira/browse/SPARK-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10342. Resolution: Fixed > Cooperative memory management > - > >

[jira] [Resolved] (SPARK-10309) Some tasks failed with Unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10309. Resolution: Fixed > Some tasks failed with Unable to acquire memory > -

[jira] [Created] (SPARK-11417) @Override is not supported by older version of Janino

Davies Liu created SPARK-11417: -- Summary: @Override is not supported by older version of Janino Key: SPARK-11417 URL: https://issues.apache.org/jira/browse/SPARK-11417 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981563#comment-14981563 ] Davies Liu commented on SPARK-11330: [~saif.a.ellafi] The 1.5.2-RC1 is out, could you

[jira] [Updated] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11330: --- Fix Version/s: (was: 1.5.1) 1.5.2 > Filter operation on StringType after group

[jira] [Closed] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-11330. -- Resolution: Duplicate Assignee: Davies Liu Fix Version/s: 1.5.1 1.6.0

[jira] [Created] (SPARK-11411) Use the space at end of pages

Davies Liu created SPARK-11411: -- Summary: Use the space at end of pages Key: SPARK-11411 URL: https://issues.apache.org/jira/browse/SPARK-11411 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-11322) Keep full stack track in captured exception in PySpark

[ https://issues.apache.org/jira/browse/SPARK-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11322. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9283 [https://github.c

[jira] [Assigned] (SPARK-10309) Some tasks failed with Unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-10309: -- Assignee: Davies Liu > Some tasks failed with Unable to acquire memory > -

[jira] [Created] (SPARK-11288) Specify the return type for UDF in Scala

Davies Liu created SPARK-11288: -- Summary: Specify the return type for UDF in Scala Key: SPARK-11288 URL: https://issues.apache.org/jira/browse/SPARK-11288 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-10342) Cooperative memory management

[ https://issues.apache.org/jira/browse/SPARK-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-10342: -- Assignee: Davies Liu > Cooperative memory management > - > >

[jira] [Resolved] (SPARK-7021) JUnit output for Python tests

[ https://issues.apache.org/jira/browse/SPARK-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7021. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8323 [https://github.com/

[jira] [Updated] (SPARK-11250) Generate different alias for columns with same name during join

[ https://issues.apache.org/jira/browse/SPARK-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11250: --- Assignee: Narine Kokhlikyan > Generate different alias for columns with same name during join > -

[jira] [Created] (SPARK-11250) Generate different alias for columns with same name during join

Davies Liu created SPARK-11250: -- Summary: Generate different alias for columns with same name during join Key: SPARK-11250 URL: https://issues.apache.org/jira/browse/SPARK-11250 Project: Spark

[jira] [Created] (SPARK-11243) Output UnsafeRow in InMemoryTableScan

Davies Liu created SPARK-11243: -- Summary: Output UnsafeRow in InMemoryTableScan Key: SPARK-11243 URL: https://issues.apache.org/jira/browse/SPARK-11243 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-11149) Improve performance of primitive types in columnar cache

[ https://issues.apache.org/jira/browse/SPARK-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11149. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9145 [https://github.c

[jira] [Resolved] (SPARK-11111) Fast null-safe join

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-1. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9120 [https://github.c

[jira] [Resolved] (SPARK-6740) SQL operator and condition precedence is not honoured

[ https://issues.apache.org/jira/browse/SPARK-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-6740. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8617 [https://github.com/

[jira] [Resolved] (SPARK-10463) remove PromotePrecision during optimization

[ https://issues.apache.org/jira/browse/SPARK-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10463. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8621 [https://github.c

[jira] [Updated] (SPARK-11199) Improve R context management story and add getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-11199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11199: --- Assignee: Felix Cheung > Improve R context management story and add getOrCreate > ---

[jira] [Closed] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-8071. - Resolution: Won't Fix > Run PySpark dataframe.rollup/cube test failed > --

[jira] [Created] (SPARK-11197) Run SQL query on files directly without create a table

Davies Liu created SPARK-11197: -- Summary: Run SQL query on files directly without create a table Key: SPARK-11197 URL: https://issues.apache.org/jira/browse/SPARK-11197 Project: Spark Issue Type

[jira] [Resolved] (SPARK-11119) cleanup unsafe array and map

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9131 [https://github.c

[jira] [Resolved] (SPARK-9643) Error serializing datetimes with timezones using Dataframes and Parquet

[ https://issues.apache.org/jira/browse/SPARK-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9643. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7950 [https://github.com/

<    7   8   9   10   11   12   13   14   15   16   >