[jira] [Updated] (SPARK-26990) Difference in handling of mixed-case partition column names after SPARK-26188

2019-03-11 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-26990: -- Fix Version/s: 2.4.1 > Difference in handling of mixed-case partition column names after SPARK

[jira] [Resolved] (SPARK-26990) Difference in handling of mixed-case partition column names after SPARK-26188

2019-03-11 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-26990. --- Resolution: Fixed > Difference in handling of mixed-case partition column names after SPARK-

[jira] [Created] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2019-04-17 Thread Bruce Robbins (JIRA)
Bruce Robbins created SPARK-27497: - Summary: Spark wipes out bucket spec in metastore when updating table stats Key: SPARK-27497 URL: https://issues.apache.org/jira/browse/SPARK-27497 Project: Spark

[jira] [Updated] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27497: -- Description: The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that

[jira] [Created] (SPARK-27498) Built-in parquet code path does not respect hive.enforce.bucketing

2019-04-17 Thread Bruce Robbins (JIRA)
Bruce Robbins created SPARK-27498: - Summary: Built-in parquet code path does not respect hive.enforce.bucketing Key: SPARK-27498 URL: https://issues.apache.org/jira/browse/SPARK-27498 Project: Spark

[jira] [Updated] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27497: -- Description: The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that

[jira] [Updated] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27497: -- Description: The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that

[jira] [Updated] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27497: -- Description: The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that

[jira] [Updated] (SPARK-27498) Built-in parquet code path does not respect hive.enforce.bucketing

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27498: -- Description: _Caveat: I can see how this could be intentional if Spark believes that the buil

[jira] [Updated] (SPARK-27498) Built-in parquet code path does not respect hive.enforce.bucketing

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27498: -- Description: _Caveat: I can see how this could be intentional if Spark believes that the buil

[jira] [Updated] (SPARK-27498) Built-in parquet code path does not respect hive.enforce.bucketing

2019-04-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27498: -- Description: _Caveat: I can see how this could be intentional if Spark believes that the buil

[jira] [Updated] (SPARK-27497) Spark wipes out bucket spec in metastore when updating table stats

2019-04-19 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27497: -- Description: The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that

[jira] [Updated] (SPARK-27498) Built-in parquet code path (convertMetastoreParquet=true) does not respect hive.enforce.bucketing

2019-04-19 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-27498: -- Summary: Built-in parquet code path (convertMetastoreParquet=true) does not respect hive.enfor

[jira] [Commented] (SPARK-27466) LEAD function with 'ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING' causes exception in Spark

2019-05-06 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834258#comment-16834258 ] Bruce Robbins commented on SPARK-27466: --- This _seems_ to be intentional, according

[jira] [Created] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-03-12 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-34731: - Summary: ConcurrentModificationException in EventLoggingListener when redacting properties Key: SPARK-34731 URL: https://issues.apache.org/jira/browse/SPARK-34731 P

[jira] [Commented] (SPARK-33098) Explicit or implicit casts involving partition columns can sometimes result in a MetaException.

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301037#comment-17301037 ] Bruce Robbins commented on SPARK-33098: --- Fixed by PR for SPARK-27421. > Explicit

[jira] [Resolved] (SPARK-33098) Explicit or implicit casts involving partition columns can sometimes result in a MetaException.

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-33098. --- Resolution: Duplicate > Explicit or implicit casts involving partition columns can sometimes

[jira] [Resolved] (SPARK-24814) Relationship between catalog and datasources

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-24814. --- Resolution: Resolved > Relationship between catalog and datasources > --

[jira] [Commented] (SPARK-24814) Relationship between catalog and datasources

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301038#comment-17301038 ] Bruce Robbins commented on SPARK-24814: --- Very old Jira, now obsolete. > Relations

[jira] [Resolved] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-24758. --- Resolution: Fixed > Create table wants to use /user/hive/warehouse in clean clone >

[jira] [Commented] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301039#comment-17301039 ] Bruce Robbins commented on SPARK-24758: --- Issue no longer present on master. > Cre

[jira] [Updated] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-03-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-34731: -- Affects Version/s: 3.1.1 > ConcurrentModificationException in EventLoggingListener when redact

[jira] [Updated] (SPARK-37175) Performance improvement to hash joins with many duplicate keys

2021-10-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37175: -- Attachment: hash_rel_examples.txt > Performance improvement to hash joins with many duplicate

[jira] [Created] (SPARK-37175) Performance improvement to hash joins with many duplicate keys

2021-10-31 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-37175: - Summary: Performance improvement to hash joins with many duplicate keys Key: SPARK-37175 URL: https://issues.apache.org/jira/browse/SPARK-37175 Project: Spark

[jira] [Updated] (SPARK-37175) Performance improvement to hash joins with many duplicate keys

2021-10-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37175: -- Description: I noticed that HashedRelations with many duplicate keys perform significantly sl

[jira] [Updated] (SPARK-37175) Performance improvement to hash joins with many duplicate keys

2021-10-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37175: -- Description: I noticed that HashedRelations with many duplicate keys perform significantly sl

[jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-11 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17442433#comment-17442433 ] Bruce Robbins commented on SPARK-37270: --- I can reproduce locally. In 3.1, the abov

[jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17442848#comment-17442848 ] Bruce Robbins commented on SPARK-37270: --- [~yumwang] Seems related to SPARK-33848.

[jira] [Created] (SPARK-38666) Missing aggregate filter checks

2022-03-26 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38666: - Summary: Missing aggregate filter checks Key: SPARK-38666 URL: https://issues.apache.org/jira/browse/SPARK-38666 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-38666) Missing aggregate filter checks

2022-03-26 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38666: -- Description: h3. Window function in filter {noformat} select sum(a) filter (where nth_value(a,

[jira] [Commented] (SPARK-38790) Unexpected behaviour for "IN" operator in spark when null is involved in array

2022-04-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517674#comment-17517674 ] Bruce Robbins commented on SPARK-38790: --- I think that might be correct. At least,

[jira] [Comment Edited] (SPARK-38790) Unexpected behaviour for "IN" operator in spark when null is involved in array

2022-04-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517674#comment-17517674 ] Bruce Robbins edited comment on SPARK-38790 at 4/5/22 7:50 PM: ---

[jira] [Commented] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17521414#comment-17521414 ] Bruce Robbins commented on SPARK-38823: --- This appears to be an optimization bug th

[jira] [Updated] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38823: -- Labels: correctness (was: ) > Incorrect result of dataset reduceGroups in java >

[jira] [Updated] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38823: -- Affects Version/s: 3.3.0 > Incorrect result of dataset reduceGroups in java >

[jira] [Commented] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17521894#comment-17521894 ] Bruce Robbins commented on SPARK-38823: --- By the way, here is some code that demos

[jira] [Commented] (SPARK-38667) Optimizer generates error when using inner join along with sequence

2022-04-14 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17522500#comment-17522500 ] Bruce Robbins commented on SPARK-38667: --- Strangely, I cannot reproduce on 3.2.1 (o

[jira] [Commented] (SPARK-38884) java.util.NoSuchElementException: key not found: numPartitions

2022-04-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17522885#comment-17522885 ] Bruce Robbins commented on SPARK-38884: --- {quote}what`s self-contained reproducer?{

[jira] [Commented] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-16 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523197#comment-17523197 ] Bruce Robbins commented on SPARK-38868: --- The issue is in {{EliminateOuterJoin}}. T

[jira] [Updated] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38868: -- Affects Version/s: 3.3.0 3.4.0 > `assert_true` fails unconditionnaly af

[jira] [Updated] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-18 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38868: -- Component/s: SQL > `assert_true` fails unconditionnaly after `left_outer` joins >

[jira] [Created] (SPARK-38990) date_trunc and trunc both fail with format from column in inline table

2022-04-21 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38990: - Summary: date_trunc and trunc both fail with format from column in inline table Key: SPARK-38990 URL: https://issues.apache.org/jira/browse/SPARK-38990 Project: Spa

[jira] [Created] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39061: - Summary: Incorrect results or NPE when using Inline function against an array of dynamically created structs Key: SPARK-39061 URL: https://issues.apache.org/jira/browse/SPARK-39

[jira] [Commented] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529702#comment-17529702 ] Bruce Robbins commented on SPARK-39061: --- Btw, dataframe example: {noformat} scala>

[jira] [Comment Edited] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529702#comment-17529702 ] Bruce Robbins edited comment on SPARK-39061 at 4/29/22 12:33 AM: -

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Affects Version/s: (was: 3.1.3) > Incorrect results or NPE when using Inline function agai

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Description: The following query returns incorrect results: {noformat} spark-sql> select inlin

[jira] [Created] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39093: - Summary: Dividing interval by integral can result in codegen compilation error Key: SPARK-39093 URL: https://issues.apache.org/jira/browse/SPARK-39093 Project: Spar

[jira] [Updated] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39093: -- Description: Assume this data: {noformat} create or replace temp view v1 as select * FROM VALU

[jira] [Updated] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39093: -- Affects Version/s: 3.3.0 > Dividing interval by integral can result in codegen compilation err

[jira] [Updated] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39093: -- Affects Version/s: 3.2.1 > Dividing interval by integral can result in codegen compilation err

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536865#comment-17536865 ] Bruce Robbins commented on SPARK-37544: --- Reproduction of the bug depends on your t

[jira] [Created] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-13 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39184: - Summary: ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones Key: SPARK-39184 URL: https://issues.apache.org/jira/browse/SPARK-39184 Proj

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17536913#comment-17536913 ] Bruce Robbins commented on SPARK-39184: --- I will take a stab at fixing this when th

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17537252#comment-17537252 ] Bruce Robbins commented on SPARK-39184: --- Some notes on what is happening. Let's t

[jira] [Commented] (SPARK-39418) DECODE docs refer to Oracle instead of Spark

2022-06-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17551801#comment-17551801 ] Bruce Robbins commented on SPARK-39418: --- Possibly a dup of SPARK-39286? > DECODE

[jira] [Created] (SPARK-39496) Inline eval path cannot handle null structs

2022-06-16 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39496: - Summary: Inline eval path cannot handle null structs Key: SPARK-39496 URL: https://issues.apache.org/jira/browse/SPARK-39496 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39496) Inline eval path cannot handle null structs

2022-06-18 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39496: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Inline eval path cannot handle null

[jira] [Commented] (SPARK-38614) After Spark update, df.show() shows incorrect F.percent_rank results

2022-06-19 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556126#comment-17556126 ] Bruce Robbins commented on SPARK-38614: --- Likely caused by [this|https://github.co

[jira] [Commented] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556427#comment-17556427 ] Bruce Robbins commented on SPARK-39524: --- When I apply the propose fix for SPARK-39

[jira] [Comment Edited] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556427#comment-17556427 ] Bruce Robbins edited comment on SPARK-39524 at 6/20/22 3:29 PM: --

[jira] [Resolved] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-39524. --- Resolution: Fixed > GeneratorFunctionSuite fails with Scala 2.13 > -

[jira] [Commented] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556429#comment-17556429 ] Bruce Robbins commented on SPARK-39525: --- Just like the GeneratorFunctionSuites iss

[jira] [Resolved] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-39525. --- Resolution: Fixed > AdaptiveQueryExecSuite fails with Scala 2.13 > -

[jira] [Comment Edited] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556429#comment-17556429 ] Bruce Robbins edited comment on SPARK-39525 at 6/20/22 3:36 PM: --

[jira] [Commented] (SPARK-39518) Plan stability test is broken with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556433#comment-17556433 ] Bruce Robbins commented on SPARK-39518: --- As with the GeneratorFunctionsSuite and A

[jira] [Commented] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556468#comment-17556468 ] Bruce Robbins commented on SPARK-39523: --- As with the GeneratorFunctionsSuite and A

[jira] [Comment Edited] (SPARK-39518) Plan stability test is broken with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556433#comment-17556433 ] Bruce Robbins edited comment on SPARK-39518 at 6/20/22 5:02 PM: --

[jira] [Comment Edited] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556468#comment-17556468 ] Bruce Robbins edited comment on SPARK-39523 at 6/20/22 5:03 PM: --

[jira] [Resolved] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-39523. --- Resolution: Fixed > JDBCV2Suite fails with Scala 2.13 > - >

[jira] [Commented] (SPARK-39536) to_date function is returning incorrect value

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556519#comment-17556519 ] Bruce Robbins commented on SPARK-39536: --- Seems like your date format string ('mm/d

[jira] [Created] (SPARK-35178) maven autodownload failing

2021-04-21 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-35178: - Summary: maven autodownload failing Key: SPARK-35178 URL: https://issues.apache.org/jira/browse/SPARK-35178 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-35178) maven autodownload failing

2021-04-21 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326874#comment-17326874 ] Bruce Robbins commented on SPARK-35178: --- I also posted https://issues.apache.org/j

[jira] [Commented] (SPARK-35178) maven autodownload failing

2021-04-21 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326910#comment-17326910 ] Bruce Robbins commented on SPARK-35178: --- In INFRA-21767, Daniel Gruno responded: {

[jira] [Commented] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-06-01 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355289#comment-17355289 ] Bruce Robbins commented on SPARK-34731: --- I am working from memory, but I remember

[jira] [Created] (SPARK-35817) Queries against wide Avro tables can be slow

2021-06-18 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-35817: - Summary: Queries against wide Avro tables can be slow Key: SPARK-35817 URL: https://issues.apache.org/jira/browse/SPARK-35817 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-35817) Queries against wide Avro tables can be slow

2021-06-18 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17365697#comment-17365697 ] Bruce Robbins commented on SPARK-35817: --- The referenced line of code is meant to r

[jira] [Commented] (SPARK-35817) Queries against wide Avro tables can be slow

2021-06-18 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17365764#comment-17365764 ] Bruce Robbins commented on SPARK-35817: --- [~xkrogen] Thanks! {quote}I guess we shou

[jira] [Created] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-37803: - Summary: When deserializing an Orc struct, reuse the result row when possible Key: SPARK-37803 URL: https://issues.apache.org/jira/browse/SPARK-37803 Project: Spark

[jira] [Commented] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468283#comment-17468283 ] Bruce Robbins commented on SPARK-37803: --- I will attempt a PR in the next few hours

[jira] [Updated] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Attachment: pr_results.txt > When deserializing an Orc struct, reuse the result row when possi

[jira] [Updated] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Attachment: master_results.txt > When deserializing an Orc struct, reuse the result row when p

[jira] [Created] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

2022-01-04 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-37812: - Summary: When deserializing an Orc struct, reuse the result row when possible Key: SPARK-37812 URL: https://issues.apache.org/jira/browse/SPARK-37812 Project: Spark

[jira] [Updated] (SPARK-37803) Create new benchmarks for struct deserializer improvement.

2022-01-04 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Description: Create new benchmarks for struct deserializer improvement (SPARK-37812) (was: Cr

[jira] [Updated] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

2022-01-04 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Description: Create new benchmarks for struct deserializer improvement. (was: For each Orc st

[jira] [Updated] (SPARK-37803) Create new benchmarks for struct deserializer improvement.

2022-01-04 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Summary: Create new benchmarks for struct deserializer improvement. (was: When deserializing

[jira] [Created] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

2022-01-06 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-37832: - Summary: Orc struct serializer should look up field converters in an array rather than a linked list Key: SPARK-37832 URL: https://issues.apache.org/jira/browse/SPARK-37832

[jira] [Commented] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

2022-01-06 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470235#comment-17470235 ] Bruce Robbins commented on SPARK-37832: --- I will post of PR shortly. > Orc struct

[jira] [Created] (SPARK-37947) Cannot use _outer generators in a lateral view

2022-01-17 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-37947: - Summary: Cannot use _outer generators in a lateral view Key: SPARK-37947 URL: https://issues.apache.org/jira/browse/SPARK-37947 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37947) Cannot use _outer generators in a lateral view

2022-01-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477412#comment-17477412 ] Bruce Robbins commented on SPARK-37947: --- While a minor issue (you could always use

[jira] [Commented] (SPARK-38000) Sort node incorrectly removed from the optimized logical plan

2022-01-24 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481392#comment-17481392 ] Bruce Robbins commented on SPARK-38000: --- I can reproduce on 3.2.0, but it seems to

[jira] [Created] (SPARK-38075) Hive script transform with order by and limit will return fake rows

2022-01-30 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38075: - Summary: Hive script transform with order by and limit will return fake rows Key: SPARK-38075 URL: https://issues.apache.org/jira/browse/SPARK-38075 Project: Spark

[jira] [Updated] (SPARK-38075) Hive script transform with order by and limit will return fake rows

2022-01-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38075: -- Affects Version/s: 3.2.0 > Hive script transform with order by and limit will return fake rows

[jira] [Updated] (SPARK-38075) Hive script transform with order by and limit will return fake rows

2022-01-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38075: -- Affects Version/s: 3.1.2 > Hive script transform with order by and limit will return fake rows

[jira] [Commented] (SPARK-38075) Hive script transform with order by and limit will return fake rows

2022-01-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484468#comment-17484468 ] Bruce Robbins commented on SPARK-38075: --- It's a small iterator issue. I will make

[jira] [Updated] (SPARK-38075) Hive script transform with order by and limit will return fake rows

2022-01-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38075: -- Affects Version/s: 3.2.1 > Hive script transform with order by and limit will return fake rows

[jira] [Created] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38133: - Summary: Grouping by timestamp_ntz will sometimes corrupt the results Key: SPARK-38133 URL: https://issues.apache.org/jira/browse/SPARK-38133 Project: Spark

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488441#comment-17488441 ] Bruce Robbins commented on SPARK-38133: --- I think I have a handle on what is causin

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488514#comment-17488514 ] Bruce Robbins commented on SPARK-38133: --- [~dongjoon]  >Does this happen on master

[jira] [Created] (SPARK-38146) UDAF fails with unsafe rows containing a TIMESTAMP_NTZ column

2022-02-08 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38146: - Summary: UDAF fails with unsafe rows containing a TIMESTAMP_NTZ column Key: SPARK-38146 URL: https://issues.apache.org/jira/browse/SPARK-38146 Project: Spark

  1   2   3   4   5   >