[jira] [Commented] (SPARK-45881) Use Higher Order aggregate functions from SQL

2024-02-18 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818356#comment-17818356 ] Steven Aerts commented on SPARK-45881: -- The pull request just got closed because of

[jira] [Created] (SPARK-45881) Use Higher Order aggregate functions from SQL

2023-11-10 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-45881: Summary: Use Higher Order aggregate functions from SQL Key: SPARK-45881 URL: https://issues.apache.org/jira/browse/SPARK-45881 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-44132) nesting full outer joins confuses code generator

2023-06-23 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736490#comment-17736490 ] Steven Aerts commented on SPARK-44132: -- [https://github.com/apache/spark/pull/41712

[jira] [Commented] (SPARK-44132) nesting full outer joins confuses code generator

2023-06-21 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17735973#comment-17735973 ] Steven Aerts commented on SPARK-44132: -- [~bersprockets] I did not think of that. A

[jira] [Updated] (SPARK-44132) nesting full outer joins confuses code generator

2023-06-21 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-44132: - Description: We are seeing issues with the code generator when querying java bean encoded data

[jira] [Updated] (SPARK-44132) nesting full outer joins confuses code generator

2023-06-21 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-44132: - Description: We are seeing issues with the code generator when querying java bean encoded data

[jira] [Updated] (SPARK-44132) nesting full outer joins confuses code generator

2023-06-21 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-44132: - Summary: nesting full outer joins confuses code generator (was: nesting full outer joins confus

[jira] [Created] (SPARK-44132) nesting full outer joins confuses confuses code generator

2023-06-21 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-44132: Summary: nesting full outer joins confuses confuses code generator Key: SPARK-44132 URL: https://issues.apache.org/jira/browse/SPARK-44132 Project: Spark Iss

[jira] [Commented] (SPARK-25050) Handle more than two types in avro union types when writing avro files

2022-05-11 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534741#comment-17534741 ] Steven Aerts commented on SPARK-25050: -- I created a PR for this issue. Not clear wh

[jira] [Updated] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-38130: - Description:  {{array_sort}} has check to see if the entries it has to sort are orderable. I th

[jira] [Created] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-38130: Summary: array_sort does not allow non-orderable datatypes Key: SPARK-38130 URL: https://issues.apache.org/jira/browse/SPARK-38130 Project: Spark Issue Type:

[jira] [Created] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

2021-07-02 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-35985: Summary: File source V2 ignores partition filters when empty readDataSchema Key: SPARK-35985 URL: https://issues.apache.org/jira/browse/SPARK-35985 Project: Spark

[jira] [Commented] (SPARK-35744) Performance degradation in avro SpecificRecordBuilders

2021-06-21 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367036#comment-17367036 ] Steven Aerts commented on SPARK-35744: -- Hi [~xkrogen] , we went a different path. 

[jira] [Commented] (SPARK-35744) Performance degradation in avro SpecificRecordBuilders

2021-06-14 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363119#comment-17363119 ] Steven Aerts commented on SPARK-35744: -- [~xkrogen] in the past we use them solely i

[jira] [Commented] (SPARK-35744) Performance degradation in avro SpecificRecordBuilders

2021-06-14 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362804#comment-17362804 ] Steven Aerts commented on SPARK-35744: -- [~Gengliang.Wang] in the avro java/scala wo

[jira] [Updated] (SPARK-35744) Performance degradation in avro SpecificRecordBuilders

2021-06-11 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-35744: - Description: Creating this bug to let you know that when we tested out spark 3.2.0 we saw a sig

[jira] [Created] (SPARK-35744) Performance degradation in avro SpecificRecordBuilders

2021-06-11 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-35744: Summary: Performance degradation in avro SpecificRecordBuilders Key: SPARK-35744 URL: https://issues.apache.org/jira/browse/SPARK-35744 Project: Spark Issue

[jira] [Created] (SPARK-30267) avro deserializer: ArrayList cannot be cast to GenericData$Array

2019-12-16 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-30267: Summary: avro deserializer: ArrayList cannot be cast to GenericData$Array Key: SPARK-30267 URL: https://issues.apache.org/jira/browse/SPARK-30267 Project: Spark

[jira] [Resolved] (SPARK-21211) Codegen CompileException: ExternalMapToCatalyst_value_isNull0 is not an rvalue

2017-06-26 Thread Steven Aerts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts resolved SPARK-21211. -- Resolution: Duplicate I assume this is a duplicate of SPARK-19104 > Codegen CompileException:

[jira] [Created] (SPARK-21211) Codegen CompileException: ExternalMapToCatalyst_value_isNull0 is not an rvalue

2017-06-26 Thread Steven Aerts (JIRA)
Steven Aerts created SPARK-21211: Summary: Codegen CompileException: ExternalMapToCatalyst_value_isNull0 is not an rvalue Key: SPARK-21211 URL: https://issues.apache.org/jira/browse/SPARK-21211 Projec

[jira] [Commented] (SPARK-19104) CompileException with Map and Case Class in Spark 2.1.0

2017-05-11 Thread Steven Aerts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006300#comment-16006300 ] Steven Aerts commented on SPARK-19104: -- We bumped into this issue also in java and w