[jira] [Updated] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22143: -- Fix Version/s: 2.2.1 > OffHeapColumnVector may leak memory > --

[jira] [Resolved] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22143. --- Resolution: Fixed Fix Version/s: 2.3.0 > OffHeapColumnVector may leak memory >

[jira] [Updated] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22141: -- Fix Version/s: 2.2.1 > Propagate empty relation before checking Cartesian products > --

[jira] [Resolved] (SPARK-22141) Propagate empty relation before checking Cartesian products

[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22141. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > Pro

[jira] [Updated] (SPARK-22143) OffHeapColumnVector may leak memory

[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22143: -- Description: ColumnVector does not clean-up its children on close. This means that we a

[jira] [Created] (SPARK-22143) OffHeapColumnVector may leak memory

Herman van Hovell created SPARK-22143: - Summary: OffHeapColumnVector may leak memory Key: SPARK-22143 URL: https://issues.apache.org/jira/browse/SPARK-22143 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22092) Reallocation in OffHeapColumnVector.reserveInternal corrupts array data

[ https://issues.apache.org/jira/browse/SPARK-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22092: -- Fix Version/s: 2.2.1 > Reallocation in OffHeapColumnVector.reserveInternal corrupts arr

[jira] [Resolved] (SPARK-22092) Reallocation in OffHeapColumnVector.reserveInternal corrupts array data

[ https://issues.apache.org/jira/browse/SPARK-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22092. --- Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.3.0 > Reall

[jira] [Created] (SPARK-21983) Fix ANTLR 4.7 deprecations

Herman van Hovell created SPARK-21983: - Summary: Fix ANTLR 4.7 deprecations Key: SPARK-21983 URL: https://issues.apache.org/jira/browse/SPARK-21983 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21418. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.3.0

[jira] [Created] (SPARK-21830) Bump the dependency of ANTLR to version 4.7

Herman van Hovell created SPARK-21830: - Summary: Bump the dependency of ANTLR to version 4.7 Key: SPARK-21830 URL: https://issues.apache.org/jira/browse/SPARK-21830 Project: Spark Issue T

[jira] [Resolved] (SPARK-21826) outer broadcast hash join should not throw NPE

[ https://issues.apache.org/jira/browse/SPARK-21826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21826. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Fixed per http

[jira] [Assigned] (SPARK-21826) outer broadcast hash join should not throw NPE

[ https://issues.apache.org/jira/browse/SPARK-21826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-21826: - Assignee: Wenchen Fan > outer broadcast hash join should not throw NPE > ---

[jira] [Resolved] (SPARK-21718) Heavy log of type: "Skipping partition based on stats ..."

[ https://issues.apache.org/jira/browse/SPARK-21718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21718. --- Resolution: Fixed Fix Version/s: 2.3.0 > Heavy log of type: "Skipping partitio

[jira] [Resolved] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18394. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > E

[jira] [Resolved] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21595. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.3.0

[jira] [Closed] (SPARK-21629) OR nullability is incorrect

[ https://issues.apache.org/jira/browse/SPARK-21629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-21629. - Resolution: Not A Problem Assignee: (was: Liang-Chi Hsieh) This is not a bug, b

[jira] [Commented] (SPARK-21629) OR nullability is incorrect

[ https://issues.apache.org/jira/browse/SPARK-21629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115397#comment-16115397 ] Herman van Hovell commented on SPARK-21629: --- Sure go for it. Should be a one-li

[jira] [Assigned] (SPARK-21629) OR nullability is incorrect

[ https://issues.apache.org/jira/browse/SPARK-21629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-21629: - Assignee: Liang-Chi Hsieh > OR nullability is incorrect > --

[jira] [Resolved] (SPARK-21205) pmod(number, 0) should be null

[ https://issues.apache.org/jira/browse/SPARK-21205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21205. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > pmod(n

[jira] [Commented] (SPARK-21630) Pmod should not throw a divide by zero exception

[ https://issues.apache.org/jira/browse/SPARK-21630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114078#comment-16114078 ] Herman van Hovell commented on SPARK-21630: --- Yeah it is. Thanks for pointing th

[jira] [Closed] (SPARK-21630) Pmod should not throw a divide by zero exception

[ https://issues.apache.org/jira/browse/SPARK-21630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-21630. - Resolution: Duplicate > Pmod should not throw a divide by zero exception > --

[jira] [Commented] (SPARK-21629) OR nullability is incorrect

[ https://issues.apache.org/jira/browse/SPARK-21629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114041#comment-16114041 ] Herman van Hovell commented on SPARK-21629: --- Thanks for doing this. The first s

[jira] [Created] (SPARK-21630) Pmod should not throw a divide by zero exception

Herman van Hovell created SPARK-21630: - Summary: Pmod should not throw a divide by zero exception Key: SPARK-21630 URL: https://issues.apache.org/jira/browse/SPARK-21630 Project: Spark Is

[jira] [Created] (SPARK-21629) OR nullability is incorrect

Herman van Hovell created SPARK-21629: - Summary: OR nullability is incorrect Key: SPARK-21629 URL: https://issues.apache.org/jira/browse/SPARK-21629 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113388#comment-16113388 ] Herman van Hovell commented on SPARK-21595: --- The old and the new code are not e

[jira] [Created] (SPARK-21258) Window result incorrect using complex object with spilling

Herman van Hovell created SPARK-21258: - Summary: Window result incorrect using complex object with spilling Key: SPARK-21258 URL: https://issues.apache.org/jira/browse/SPARK-21258 Project: Spark

[jira] [Resolved] (SPARK-20758) Add Constant propagation optimization

[ https://issues.apache.org/jira/browse/SPARK-20758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20758. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.3.0 > Add Co

[jira] [Assigned] (SPARK-20773) ParquetWriteSupport.writeFields is quadratic in number of fields

[ https://issues.apache.org/jira/browse/SPARK-20773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-20773: - Assignee: T Poterba > ParquetWriteSupport.writeFields is quadratic in number of

[jira] [Resolved] (SPARK-20773) ParquetWriteSupport.writeFields is quadratic in number of fields

[ https://issues.apache.org/jira/browse/SPARK-20773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20773. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 > ParquetWrite

[jira] [Resolved] (SPARK-20798) GenerateUnsafeProjection should check if value is null before calling the getter

[ https://issues.apache.org/jira/browse/SPARK-20798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20798. --- Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.2.0

[jira] [Updated] (SPARK-20725) partial aggregate should behave correctly for sameResult

[ https://issues.apache.org/jira/browse/SPARK-20725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20725: -- Target Version/s: 2.1.2 > partial aggregate should behave correctly for sameResult > --

[jira] [Resolved] (SPARK-20725) partial aggregate should behave correctly for sameResult

[ https://issues.apache.org/jira/browse/SPARK-20725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20725. --- Resolution: Fixed Fix Version/s: 2.2.0 > partial aggregate should behave corre

[jira] [Resolved] (SPARK-20719) Support LIMIT ALL

[ https://issues.apache.org/jira/browse/SPARK-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20719. --- Resolution: Fixed Fix Version/s: 2.3.0 > Support LIMIT ALL > -

[jira] [Commented] (SPARK-20680) Spark-sql do not support for void column datatype of view

[ https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004911#comment-16004911 ] Herman van Hovell commented on SPARK-20680: --- [~jiangxb] Do you have time to wor

[jira] [Resolved] (SPARK-17685) WholeStageCodegenExec throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-17685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17685. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0

[jira] [Closed] (SPARK-20593) Writing Parquet: Cannot build an empty group

[ https://issues.apache.org/jira/browse/SPARK-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-20593. - Resolution: Not A Problem > Writing Parquet: Cannot build an empty group > --

[jira] [Commented] (SPARK-20593) Writing Parquet: Cannot build an empty group

[ https://issues.apache.org/jira/browse/SPARK-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996283#comment-15996283 ] Herman van Hovell commented on SPARK-20593: --- This is not a bug. You cannot writ

[jira] [Resolved] (SPARK-20567) Failure to bind when using explode and collect_set in streaming

[ https://issues.apache.org/jira/browse/SPARK-20567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20567. --- Resolution: Fixed Fix Version/s: 2.2.0 > Failure to bind when using explode an

[jira] [Comment Edited] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993464#comment-15993464 ] Herman van Hovell edited comment on SPARK-20556 at 5/2/17 6:34 PM:

[jira] [Commented] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993464#comment-15993464 ] Herman van Hovell commented on SPARK-20556: --- [~vlyubin] This was fixed in SPARK

[jira] [Closed] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-20556. - Resolution: Duplicate Fix Version/s: 2.2.0 > codehaus fails to generate code becau

[jira] [Updated] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20556: -- Component/s: (was: Optimizer) SQL > codehaus fails to generate cod

[jira] [Commented] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991976#comment-15991976 ] Herman van Hovell commented on SPARK-20548: --- I jumped the gun on this one, the

[jira] [Reopened] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reopened SPARK-20548: --- > Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class > -

[jira] [Resolved] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20548. --- Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.2.0 > Fla

[jira] [Resolved] (SPARK-20492) Do not print empty parentheses for invalid primitive types in parser

[ https://issues.apache.org/jira/browse/SPARK-20492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20492. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0 > Do no

[jira] [Resolved] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-12837. --- Resolution: Fixed Fix Version/s: (was: 2.0.0) 2.3.0

[jira] [Assigned] (SPARK-20482) Resolving Casts is too strict on having time zone set

[ https://issues.apache.org/jira/browse/SPARK-20482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-20482: - Assignee: Kris Mok > Resolving Casts is too strict on having time zone set > ---

[jira] [Resolved] (SPARK-20450) Unexpected first-query schema inference cost with 2.1.1 RC

[ https://issues.apache.org/jira/browse/SPARK-20450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20450. --- Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.1 > Unexpec

[jira] [Assigned] (SPARK-19951) Add string concatenate operator || to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-19951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-19951: - Assignee: (was: Herman van Hovell) > Add string concatenate operator || to S

[jira] [Commented] (SPARK-19951) Add string concatenate operator || to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-19951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977629#comment-15977629 ] Herman van Hovell commented on SPARK-19951: --- [~maropu] go for it! > Add string

[jira] [Created] (SPARK-20420) Add events to the external catalog

Herman van Hovell created SPARK-20420: - Summary: Add events to the external catalog Key: SPARK-20420 URL: https://issues.apache.org/jira/browse/SPARK-20420 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-20410) Make SparkConf a def instead of a val in SharedSQLContext

[ https://issues.apache.org/jira/browse/SPARK-20410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20410. --- Resolution: Fixed Fix Version/s: 2.2.0 > Make SparkConf a def instead of a val

[jira] [Resolved] (SPARK-20334) Return a better error message when correlated predicates contain aggregate expression that has mixture of outer and local references

[ https://issues.apache.org/jira/browse/SPARK-20334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20334. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.2.0 > Retur

[jira] [Resolved] (SPARK-20407) ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test

[ https://issues.apache.org/jira/browse/SPARK-20407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20407. --- Resolution: Fixed Assignee: Bogdan Raducanu Fix Version/s: 2.2.0 > Pa

[jira] [Updated] (SPARK-20409) fail early if aggregate function in GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-20409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20409: -- Fix Version/s: 2.1.2 > fail early if aggregate function in GROUP BY > -

[jira] [Resolved] (SPARK-20409) fail early if aggregate function in GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-20409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20409. --- Resolution: Fixed Fix Version/s: 2.2.0 > fail early if aggregate function in G

[jira] [Updated] (SPARK-20410) Make SparkConf a def instead of a val in SharedSQLContext

[ https://issues.apache.org/jira/browse/SPARK-20410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20410: -- Issue Type: Improvement (was: Bug) > Make SparkConf a def instead of a val in SharedSQ

[jira] [Created] (SPARK-20410) Make SparkConf a def instead of a val in SharedSQLContext

Herman van Hovell created SPARK-20410: - Summary: Make SparkConf a def instead of a val in SharedSQLContext Key: SPARK-20410 URL: https://issues.apache.org/jira/browse/SPARK-20410 Project: Spark

[jira] [Resolved] (SPARK-20405) Dataset.withNewExecutionId should be private

[ https://issues.apache.org/jira/browse/SPARK-20405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20405. --- Resolution: Fixed Fix Version/s: 2.2.0 > Dataset.withNewExecutionId should be

[jira] [Commented] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972753#comment-15972753 ] Herman van Hovell commented on SPARK-20356: --- Here is a reproduction in scala: {

[jira] [Updated] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20243: -- Fix Version/s: 2.1.1 > DebugFilesystem.assertNoOpenStreams thread race > --

[jira] [Assigned] (SPARK-18127) Add hooks and extension points to Spark

[ https://issues.apache.org/jira/browse/SPARK-18127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-18127: - Assignee: Sameer Agarwal (was: Herman van Hovell) > Add hooks and extension poi

[jira] [Updated] (SPARK-19946) DebugFilesystem.assertNoOpenStreams should report the open streams to help debugging

[ https://issues.apache.org/jira/browse/SPARK-19946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-19946: -- Fix Version/s: 2.1.1 > DebugFilesystem.assertNoOpenStreams should report the open strea

[jira] [Commented] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen

[ https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965670#comment-15965670 ] Herman van Hovell commented on SPARK-20184: --- I just tried your example using th

[jira] [Resolved] (SPARK-20280) SharedInMemoryCache Weigher integer overflow

[ https://issues.apache.org/jira/browse/SPARK-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20280. --- Resolution: Fixed Assignee: Bogdan Raducanu Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-19518) IGNORE NULLS in first_value / last_value should be supported in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-19518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19518. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0 > IGNOR

[jira] [Resolved] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20243. --- Resolution: Fixed Assignee: Bogdan Raducanu Fix Version/s: 2.2.0 > De

[jira] [Resolved] (SPARK-20048) Cloning SessionState does not clone query execution listeners

[ https://issues.apache.org/jira/browse/SPARK-20048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20048. --- Resolution: Fixed Assignee: Kunal Khamar Fix Version/s: 2.2.0 > Cloni

[jira] [Resolved] (SPARK-20094) Should Prevent push down of IN subquery to Join operator

[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20094. --- Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.2.0 > Shoul

[jira] [Created] (SPARK-20126) Remove HiveSessionState

Herman van Hovell created SPARK-20126: - Summary: Remove HiveSessionState Key: SPARK-20126 URL: https://issues.apache.org/jira/browse/SPARK-20126 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944799#comment-15944799 ] Herman van Hovell commented on SPARK-20122: --- Yeah, I totally missed that. Anywa

[jira] [Resolved] (SPARK-20119) Flaky Test: org.apache.spark.sql.execution. DataSourceScanExecRedactionSuite

[ https://issues.apache.org/jira/browse/SPARK-20119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20119. --- Resolution: Fixed Fix Version/s: 2.2.0 > Flaky Test: org.apache.spark.sql.exec

[jira] [Commented] (SPARK-20122) Analyzer reports "unresolved operator 'Aggregate" for nonexistent window specifications

[ https://issues.apache.org/jira/browse/SPARK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944694#comment-15944694 ] Herman van Hovell commented on SPARK-20122: --- [~jlaskowski] Could you also post

[jira] [Commented] (SPARK-20111) codegen bug surfaced by GraphFrames issue 165

[ https://issues.apache.org/jira/browse/SPARK-20111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944089#comment-15944089 ] Herman van Hovell commented on SPARK-20111: --- [~josephkb] this might be already

[jira] [Closed] (SPARK-20106) Nonlazy caching of DataFrame after orderBy/sort

[ https://issues.apache.org/jira/browse/SPARK-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-20106. - Resolution: Not A Problem > Nonlazy caching of DataFrame after orderBy/sort > ---

[jira] [Commented] (SPARK-20106) Nonlazy caching of DataFrame after orderBy/sort

[ https://issues.apache.org/jira/browse/SPARK-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943133#comment-15943133 ] Herman van Hovell commented on SPARK-20106: --- Caching requires use the backing R

[jira] [Comment Edited] (SPARK-20106) Nonlazy caching of DataFrame after orderBy/sort

[ https://issues.apache.org/jira/browse/SPARK-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943133#comment-15943133 ] Herman van Hovell edited comment on SPARK-20106 at 3/27/17 12:03 PM: --

[jira] [Assigned] (SPARK-20086) issue with pyspark 2.1.0 window function

[ https://issues.apache.org/jira/browse/SPARK-20086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-20086: - Assignee: Herman van Hovell > issue with pyspark 2.1.0 window function > ---

[jira] [Resolved] (SPARK-20086) issue with pyspark 2.1.0 window function

[ https://issues.apache.org/jira/browse/SPARK-20086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20086. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 > issue with p

[jira] [Created] (SPARK-20100) Consolidate SessionState construction

Herman van Hovell created SPARK-20100: - Summary: Consolidate SessionState construction Key: SPARK-20100 URL: https://issues.apache.org/jira/browse/SPARK-20100 Project: Spark Issue Type: B

[jira] [Resolved] (SPARK-20046) Facilitate loop optimizations in a JIT compiler regarding sqlContext.read.parquet()

[ https://issues.apache.org/jira/browse/SPARK-20046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20046. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.2.0 > F

[jira] [Created] (SPARK-20070) Redact datasource explain output

Herman van Hovell created SPARK-20070: - Summary: Redact datasource explain output Key: SPARK-20070 URL: https://issues.apache.org/jira/browse/SPARK-20070 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19988) Flaky Test: OrcSourceSuite SPARK-19459/SPARK-18220: read char/varchar column written by Hive

[ https://issues.apache.org/jira/browse/SPARK-19988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929107#comment-15929107 ] Herman van Hovell commented on SPARK-19988: --- It is probably some other test cha

[jira] [Resolved] (SPARK-19946) DebugFilesystem.assertNoOpenStreams should report the open streams to help debugging

[ https://issues.apache.org/jira/browse/SPARK-19946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19946. --- Resolution: Fixed Assignee: Bogdan Raducanu Fix Version/s: 2.2.0 > De

[jira] [Commented] (SPARK-19971) Wired SELECT equal behaviour.

[ https://issues.apache.org/jira/browse/SPARK-19971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927753#comment-15927753 ] Herman van Hovell commented on SPARK-19971: --- [~tomtang] This has been fixed in

[jira] [Closed] (SPARK-19971) Wired SELECT equal behaviour.

[ https://issues.apache.org/jira/browse/SPARK-19971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-19971. - Resolution: Duplicate > Wired SELECT equal behaviour. > -- >

[jira] [Commented] (SPARK-19954) Joining to a unioned DataFrame does not produce expected result.

[ https://issues.apache.org/jira/browse/SPARK-19954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927071#comment-15927071 ] Herman van Hovell commented on SPARK-19954: --- This is reproducible on Spark 2.1.

[jira] [Resolved] (SPARK-13450) SortMergeJoin will OOM when join rows have lot of same keys

[ https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-13450. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.2.0 > SortMe

[jira] [Updated] (SPARK-19944) Move SQLConf from sql/core to sql/catalyst

[ https://issues.apache.org/jira/browse/SPARK-19944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-19944: -- Fix Version/s: 2.1.1 > Move SQLConf from sql/core to sql/catalyst > ---

[jira] [Commented] (SPARK-18591) Replace hash-based aggregates with sort-based ones if inputs already sorted

[ https://issues.apache.org/jira/browse/SPARK-18591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925841#comment-15925841 ] Herman van Hovell commented on SPARK-18591: --- [~maropu] I don't think the curren

[jira] [Resolved] (SPARK-19889) Make TaskContext callbacks synchronized

[ https://issues.apache.org/jira/browse/SPARK-19889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19889. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.2.0 >

[jira] [Resolved] (SPARK-18966) NOT IN subquery with correlated expressions may return incorrect result

[ https://issues.apache.org/jira/browse/SPARK-18966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18966. --- Resolution: Fixed Assignee: Nattavut Sutyanyong Fix Version/s: 2.2.0

[jira] [Created] (SPARK-19952) Remove specialized catalog related analysis exceptions

Herman van Hovell created SPARK-19952: - Summary: Remove specialized catalog related analysis exceptions Key: SPARK-19952 URL: https://issues.apache.org/jira/browse/SPARK-19952 Project: Spark

[jira] [Created] (SPARK-19951) Add string concatenate operator || to Spark SQL

Herman van Hovell created SPARK-19951: - Summary: Add string concatenate operator || to Spark SQL Key: SPARK-19951 URL: https://issues.apache.org/jira/browse/SPARK-19951 Project: Spark Iss

[jira] [Resolved] (SPARK-19933) TPCDS Q70 went wrong while explaining

[ https://issues.apache.org/jira/browse/SPARK-19933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19933. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.2.0 >

[jira] [Resolved] (SPARK-19923) Remove unnecessary type conversion per call in Hive

[ https://issues.apache.org/jira/browse/SPARK-19923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19923. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.2.0 > R

[jira] [Closed] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-19424. - Resolution: Not A Problem > Wrong runtime type in RDD when reading from avro with custom

[jira] [Commented] (SPARK-19424) Wrong runtime type in RDD when reading from avro with custom serializer

[ https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924564#comment-15924564 ] Herman van Hovell commented on SPARK-19424: --- [~amitnira] Like Sean said, you ar

<    1   2   3   4   5   6   7   8   9   10   >