[jira] [Reopened] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reopened SPARK-23593: --- PR was prematurely merged. > Add interpreted execution for InitializeJavaBean expression

[jira] [Assigned] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23593: - Assignee: Liang-Chi Hsieh > Add interpreted execution for InitializeJavaBean exp

[jira] [Resolved] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23593. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for Initial

[jira] [Resolved] (SPARK-23583) Add interpreted execution to Invoke expression

2018-04-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23583. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 > A

[jira] [Created] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

2018-04-04 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23864: - Summary: Add Unsafe* copy methods to UnsafeWriter Key: SPARK-23864 URL: https://issues.apache.org/jira/browse/SPARK-23864 Project: Spark Issue Type

[jira] [Resolved] (SPARK-23587) Add interpreted execution for MapObjects expression

2018-04-03 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23587. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 > Ad

[jira] [Resolved] (SPARK-23713) Clean-up UnsafeWriter classes

2018-04-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23713. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 > C

[jira] [Resolved] (SPARK-23794) UUID() should be stateful

2018-03-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23794. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 > UU

[jira] [Updated] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23599: -- Fix Version/s: 2.3.1 > The UUID() expression is too non-deterministic > ---

[jira] [Created] (SPARK-23794) UUID() should be stateful

2018-03-26 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23794: - Summary: UUID() should be stateful Key: SPARK-23794 URL: https://issues.apache.org/jira/browse/SPARK-23794 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413213#comment-16413213 ] Herman van Hovell commented on SPARK-23598: --- [~dongjoon] thanks for doing this.

[jira] [Commented] (SPARK-22239) User-defined window functions with pandas udf

2018-03-22 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410521#comment-16410521 ] Herman van Hovell commented on SPARK-22239: --- Unbouded windows should be relativ

[jira] [Resolved] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-22 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23599. --- Resolution: Fixed Fix Version/s: 2.4.0 > The UUID() expression is too non-dete

[jira] [Commented] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404511#comment-16404511 ] Herman van Hovell commented on SPARK-23599: --- PR 1 out of 2 has been merged. >

[jira] [Assigned] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23599: - Assignee: Liang-Chi Hsieh > The UUID() expression is too non-deterministic > ---

[jira] [Created] (SPARK-23713) Clean-up UnsafeWriter classes

2018-03-16 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23713: - Summary: Clean-up UnsafeWriter classes Key: SPARK-23713 URL: https://issues.apache.org/jira/browse/SPARK-23713 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-23712) Investigate replacing Code Generated UnsafeRowJoiner with an Interpreted version

2018-03-16 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23712: - Summary: Investigate replacing Code Generated UnsafeRowJoiner with an Interpreted version Key: SPARK-23712 URL: https://issues.apache.org/jira/browse/SPARK-23712

[jira] [Created] (SPARK-23711) Add fallback to interpreted execution logic

2018-03-16 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23711: - Summary: Add fallback to interpreted execution logic Key: SPARK-23711 URL: https://issues.apache.org/jira/browse/SPARK-23711 Project: Spark Issue T

[jira] [Resolved] (SPARK-23581) Add an interpreted version of GenerateUnsafeProjection

2018-03-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23581. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add an interpreted version of Generat

[jira] [Resolved] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23598. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 > W

[jira] [Resolved] (SPARK-23656) Assertion in XXH64Suite.testKnownByteArrayInputs() is not performed on big endian platform

2018-03-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23656. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 > A

[jira] [Assigned] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

2018-03-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23588: - Assignee: Takeshi Yamamuro > Add interpreted execution for CatalystToExternalMap

[jira] [Resolved] (SPARK-23602) PrintToStderr should behave the same in interpreted mode

2018-03-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23602. --- Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 > PrintT

[jira] [Resolved] (SPARK-23592) Add interpreted execution for DecodeUsingSerializer expression

2018-03-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23592. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for DecodeU

[jira] [Commented] (SPARK-23625) spark sql long-running mission will be dead

2018-03-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391013#comment-16391013 ] Herman van Hovell commented on SPARK-23625: --- [~gentlewang] you have probably ha

[jira] [Resolved] (SPARK-23620) Split thread dump lines by using the br tag

2018-03-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23620. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 > Split t

[jira] [Resolved] (SPARK-23591) Add interpreted execution for EncodeUsingSerializer expression

2018-03-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23591. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for EncodeU

[jira] [Resolved] (SPARK-23611) Extend ExpressionEvalHelper harness to also test failures

2018-03-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23611. --- Resolution: Fixed Fix Version/s: 2.4.0 > Extend ExpressionEvalHelper harness t

[jira] [Commented] (SPARK-23582) Add interpreted execution to StaticInvoke expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388742#comment-16388742 ] Herman van Hovell commented on SPARK-23582: --- That is a good start! I am just wo

[jira] [Commented] (SPARK-23346) Failed tasks reported as success if the failure reason is not ExceptionFailure

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388088#comment-16388088 ] Herman van Hovell commented on SPARK-23346: --- [~wuzhilon88] This is completely u

[jira] [Assigned] (SPARK-23592) Add interpreted execution for DecodeUsingSerializer expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23592: - Assignee: Marco Gaido > Add interpreted execution for DecodeUsingSerializer expr

[jira] [Updated] (SPARK-23580) Interpreted mode fallback should be implemented for all expressions & projections

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23580: -- Labels: release-notes (was: ) > Interpreted mode fallback should be implemented for al

[jira] [Resolved] (SPARK-23590) Add interpreted execution for CreateExternalRow expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23590. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for CreateE

[jira] [Assigned] (SPARK-23591) Add interpreted execution for EncodeUsingSerializer expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23591: - Assignee: Marco Gaido > Add interpreted execution for EncodeUsingSerializer expr

[jira] [Commented] (SPARK-23595) Add interpreted execution for ValidateExternalType expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387864#comment-16387864 ] Herman van Hovell commented on SPARK-23595: --- [~DylanGuedes] feel free to pick t

[jira] [Assigned] (SPARK-23611) Extend ExpressionEvalHelper harness to also test failures

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23611: - Assignee: Takeshi Yamamuro > Extend ExpressionEvalHelper harness to also test fa

[jira] [Assigned] (SPARK-23590) Add interpreted execution for CreateExternalRow expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23590: - Assignee: Marco Gaido > Add interpreted execution for CreateExternalRow expressi

[jira] [Commented] (SPARK-23582) Add interpreted execution to StaticInvoke expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387711#comment-16387711 ] Herman van Hovell commented on SPARK-23582: --- [~kiszk] Can we first do a small p

[jira] [Assigned] (SPARK-23582) Add interpreted execution to StaticInvoke expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23582: - Assignee: Kazuaki Ishizaki > Add interpreted execution to StaticInvoke expressio

[jira] [Resolved] (SPARK-23594) Add interpreted execution for GetExternalRowField expression

2018-03-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23594. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 > A

[jira] [Created] (SPARK-23611) Extend ExpressionEvalHelper harness to also test failures

2018-03-06 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23611: - Summary: Extend ExpressionEvalHelper harness to also test failures Key: SPARK-23611 URL: https://issues.apache.org/jira/browse/SPARK-23611 Project: Spark

[jira] [Resolved] (SPARK-23586) Add interpreted execution for WrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23586. --- Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 > Add in

[jira] [Assigned] (SPARK-23581) Add an interpreted version of GenerateUnsafeProjection

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23581: - Assignee: Herman van Hovell > Add an interpreted version of GenerateUnsafeProjec

[jira] [Resolved] (SPARK-23585) Add interpreted execution for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23585. --- Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 > Add in

[jira] [Created] (SPARK-23602) PrintToStderr should behave the same in interpreted mode

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23602: - Summary: PrintToStderr should behave the same in interpreted mode Key: SPARK-23602 URL: https://issues.apache.org/jira/browse/SPARK-23602 Project: Spark

[jira] [Commented] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386100#comment-16386100 ] Herman van Hovell commented on SPARK-23598: --- [~dvogelbacher] Do you have some c

[jira] [Resolved] (SPARK-23496) Locality of coalesced partitions can be severely skewed by the order of input partitions

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23496. --- Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.4.0 > Local

[jira] [Created] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23599: - Summary: The UUID() expression is too non-deterministic Key: SPARK-23599 URL: https://issues.apache.org/jira/browse/SPARK-23599 Project: Spark Issu

[jira] [Updated] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23599: -- Priority: Critical (was: Major) > The UUID() expression is too non-deterministic > ---

[jira] [Created] (SPARK-23597) Audit Spark SQL code base for non-interpreted expressions

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23597: - Summary: Audit Spark SQL code base for non-interpreted expressions Key: SPARK-23597 URL: https://issues.apache.org/jira/browse/SPARK-23597 Project: Spark

[jira] [Created] (SPARK-23596) Modify Dataset test harness to include interpreted execution

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23596: - Summary: Modify Dataset test harness to include interpreted execution Key: SPARK-23596 URL: https://issues.apache.org/jira/browse/SPARK-23596 Project: Spark

[jira] [Created] (SPARK-23595) Add interpreted execution for ValidateExternalType expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23595: - Summary: Add interpreted execution for ValidateExternalType expression Key: SPARK-23595 URL: https://issues.apache.org/jira/browse/SPARK-23595 Project: Spar

[jira] [Created] (SPARK-23594) Add interpreted execution for GetExternalRowField expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23594: - Summary: Add interpreted execution for GetExternalRowField expression Key: SPARK-23594 URL: https://issues.apache.org/jira/browse/SPARK-23594 Project: Spark

[jira] [Created] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23593: - Summary: Add interpreted execution for InitializeJavaBean expression Key: SPARK-23593 URL: https://issues.apache.org/jira/browse/SPARK-23593 Project: Spark

[jira] [Created] (SPARK-23592) Add interpreted execution for DecodeUsingSerializer expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23592: - Summary: Add interpreted execution for DecodeUsingSerializer expression Key: SPARK-23592 URL: https://issues.apache.org/jira/browse/SPARK-23592 Project: Spa

[jira] [Created] (SPARK-23591) Add interpreted execution for EncodeUsingSerializer expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23591: - Summary: Add interpreted execution for EncodeUsingSerializer expression Key: SPARK-23591 URL: https://issues.apache.org/jira/browse/SPARK-23591 Project: Spa

[jira] [Created] (SPARK-23590) Add interpreted execution for CreateExternalRow

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23590: - Summary: Add interpreted execution for CreateExternalRow Key: SPARK-23590 URL: https://issues.apache.org/jira/browse/SPARK-23590 Project: Spark Iss

[jira] [Updated] (SPARK-23590) Add interpreted execution for CreateExternalRow expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23590: -- Summary: Add interpreted execution for CreateExternalRow expression (was: Add interpre

[jira] [Created] (SPARK-23589) Add interpreted execution for ExternalMapToCatalyst expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23589: - Summary: Add interpreted execution for ExternalMapToCatalyst expression Key: SPARK-23589 URL: https://issues.apache.org/jira/browse/SPARK-23589 Project: Spa

[jira] [Created] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23588: - Summary: Add interpreted execution for CatalystToExternalMap expression Key: SPARK-23588 URL: https://issues.apache.org/jira/browse/SPARK-23588 Project: Spa

[jira] [Updated] (SPARK-23587) Add interpreted execution for MapObjects expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23587: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add interpreted executio

[jira] [Created] (SPARK-23587) Add interpreted execution for MapObjects expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23587: - Summary: Add interpreted execution for MapObjects expression Key: SPARK-23587 URL: https://issues.apache.org/jira/browse/SPARK-23587 Project: Spark

[jira] [Created] (SPARK-23586) Add interpreted execution for WrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23586: - Summary: Add interpreted execution for WrapOption expression Key: SPARK-23586 URL: https://issues.apache.org/jira/browse/SPARK-23586 Project: Spark

[jira] [Updated] (SPARK-23585) Add interpreted execution for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23585: -- Summary: Add interpreted execution for UnwrapOption expression (was: Add interpreted e

[jira] [Updated] (SPARK-23582) Add interpreted execution to StaticInvoke expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23582: -- Summary: Add interpreted execution to StaticInvoke expression (was: Add interpreted ex

[jira] [Updated] (SPARK-23585) Add interpreted execition for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23585: -- Summary: Add interpreted execition for UnwrapOption expression (was: Add interpreted m

[jira] [Updated] (SPARK-23584) Add interpreted execution to NewInstance expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23584: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add interpreted executio

[jira] [Updated] (SPARK-23585) Add interpreted mode for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23585: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add interpreted mode for

[jira] [Created] (SPARK-23584) Add interpreted execution to NewInstance expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23584: - Summary: Add interpreted execution to NewInstance expression Key: SPARK-23584 URL: https://issues.apache.org/jira/browse/SPARK-23584 Project: Spark

[jira] [Created] (SPARK-23585) Add interpreted mode for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23585: - Summary: Add interpreted mode for UnwrapOption expression Key: SPARK-23585 URL: https://issues.apache.org/jira/browse/SPARK-23585 Project: Spark Is

[jira] [Created] (SPARK-23582) Add interpreted execution to StaticInvoke

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23582: - Summary: Add interpreted execution to StaticInvoke Key: SPARK-23582 URL: https://issues.apache.org/jira/browse/SPARK-23582 Project: Spark Issue Typ

[jira] [Created] (SPARK-23583) Add interpreted execution to Invoke expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23583: - Summary: Add interpreted execution to Invoke expression Key: SPARK-23583 URL: https://issues.apache.org/jira/browse/SPARK-23583 Project: Spark Issu

[jira] [Created] (SPARK-23581) Add an interpreted version of GenerateUnsafeProjection

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23581: - Summary: Add an interpreted version of GenerateUnsafeProjection Key: SPARK-23581 URL: https://issues.apache.org/jira/browse/SPARK-23581 Project: Spark

[jira] [Created] (SPARK-23580) Interpreted mode fallback should be implemented for all expressions & projections

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23580: - Summary: Interpreted mode fallback should be implemented for all expressions & projections Key: SPARK-23580 URL: https://issues.apache.org/jira/browse/SPARK-23580

[jira] [Resolved] (SPARK-23546) Refactor non-stateful methods/values in CodegenContext

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23546. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Target Version/s: 2

[jira] [Resolved] (SPARK-17006) WithColumn Performance Degrades with Number of Invocations

2018-01-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17006. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.3.0 >

[jira] [Resolved] (SPARK-23223) Stacking dataset transforms performs poorly

2018-01-29 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23223. --- Resolution: Fixed Fix Version/s: 2.3.0 > Stacking dataset transforms performs

[jira] [Created] (SPARK-23223) Stacking dataset transforms performs poorly

2018-01-25 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23223: - Summary: Stacking dataset transforms performs poorly Key: SPARK-23223 URL: https://issues.apache.org/jira/browse/SPARK-23223 Project: Spark Issue T

[jira] [Commented] (SPARK-23201) Cannot create view when duplicate columns exist in subquery

2018-01-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16339687#comment-16339687 ] Herman van Hovell commented on SPARK-23201: --- +1 on closing. > Cannot create vi

[jira] [Updated] (SPARK-23208) GenArrayData produces illegal code

2018-01-24 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23208: -- Target Version/s: 2.3.0 > GenArrayData produces illegal code >

[jira] [Created] (SPARK-23208) GenArrayData produces illegal code

2018-01-24 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23208: - Summary: GenArrayData produces illegal code Key: SPARK-23208 URL: https://issues.apache.org/jira/browse/SPARK-23208 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-23173) from_json can produce nulls for fields which are marked as non-nullable

2018-01-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23173: -- Description: The {{from_json}} function uses a schema to convert a string into a Spark

[jira] [Updated] (SPARK-23173) from_json can produce nulls for fields which are marked as non-nullable

2018-01-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23173: -- Description: The {{from_json}} function uses a schema to convert a string into a Spark

[jira] [Created] (SPARK-23173) from_json can produce nulls for fields which are marked as non-nullable

2018-01-21 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23173: - Summary: from_json can produce nulls for fields which are marked as non-nullable Key: SPARK-23173 URL: https://issues.apache.org/jira/browse/SPARK-23173 Pro

[jira] [Commented] (SPARK-22923) Non-equi join(theta join) should use sort merge join

2018-01-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327881#comment-16327881 ] Herman van Hovell commented on SPARK-22923: --- You cannot use a shuffling join fo

[jira] [Resolved] (SPARK-9299) percentile and percentile_approx aggregate functions

2017-12-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-9299. -- Resolution: Fixed Fix Version/s: 2.1.0 > percentile and percentile_approx aggrega

[jira] [Commented] (SPARK-9299) percentile and percentile_approx aggregate functions

2017-12-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16285755#comment-16285755 ] Herman van Hovell commented on SPARK-9299: -- [~hyukjin.kwon] This can be safely cl

[jira] [Resolved] (SPARK-22721) BytesToBytesMap peak memory usage not accurate after reset()

2017-12-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22721. --- Resolution: Fixed Assignee: Juliusz Sompolski Fix Version/s: 2.3.0 >

[jira] [Updated] (SPARK-22637) CatalogImpl.refresh() has quadratic complexity for a view

2017-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-22637: -- Description: {{org.apache.spark.sql.internal.CatalogImpl.refreshTable}} uses {{foreach(

[jira] [Resolved] (SPARK-22431) Creating Permanent view with illegal type

2017-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22431. --- Resolution: Fixed Assignee: Sunitha Kambhampati Fix Version/s: 2.3.0

[jira] [Created] (SPARK-22637) CatalogImpl.refresh() has quadratic complexity for a view

2017-11-28 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-22637: - Summary: CatalogImpl.refresh() has quadratic complexity for a view Key: SPARK-22637 URL: https://issues.apache.org/jira/browse/SPARK-22637 Project: Spark

[jira] [Commented] (SPARK-22431) Creating Permanent view with illegal type

2017-11-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249756#comment-16249756 ] Herman van Hovell commented on SPARK-22431: --- I look forward to the PR :) > Cre

[jira] [Commented] (SPARK-22431) Creating Permanent view with illegal type

2017-11-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249511#comment-16249511 ] Herman van Hovell commented on SPARK-22431: --- [~ksunitha] Thanks for the thoroug

[jira] [Created] (SPARK-22431) Creating Permanent view with illegal type

2017-11-02 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-22431: - Summary: Creating Permanent view with illegal type Key: SPARK-22431 URL: https://issues.apache.org/jira/browse/SPARK-22431 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-19112) add codec for ZStandard

2017-11-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19112. --- Resolution: Fixed Assignee: Sital Kedia Fix Version/s: 2.3.0 > add co

[jira] [Commented] (SPARK-22405) Enrich the event information and add new event of ExternalCatalogEvent

2017-11-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233902#comment-16233902 ] Herman van Hovell commented on SPARK-22405: --- I think adding additional events i

[jira] [Commented] (SPARK-22405) Enrich the event information and add new event of ExternalCatalogEvent

2017-10-31 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227039#comment-16227039 ] Herman van Hovell commented on SPARK-22405: --- For some context. When implementin

[jira] [Resolved] (SPARK-22251) Metric "aggregate time" is incorrect when codegen is off

2017-10-12 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22251. --- Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.3.0 > Metri

[jira] [Resolved] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-10-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21907. --- Resolution: Fixed Fix Version/s: 2.3.0 > NullPointerException in UnsafeExterna

[jira] [Assigned] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-10-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-21907: - Assignee: Eyal Farago > NullPointerException in UnsafeExternalSorter.spill() > -

<    1   2   3   4   5   6   7   8   9   10   >