[
https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40963:
--
Summary: ExtractGenerator sets incorrect nullability in new Project (was:
containsNull in arr
[
https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40963:
--
Description:
Example:
{noformat}
select c1, explode(c4) as c5 from (
select c1, array(c3) as
[
https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40963:
--
Description:
Example:
{noformat}
select c1, explode(c4) as c5 from (
select c1, array(c3) as
[
https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40963:
--
Description:
Example:
{noformat}
select c1, explode(c4) as c5 from (
select c1, array(c3) as
[
https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40963:
--
Description:
Example:
{noformat}
select c1, explode(c4) as c5 from (
select c1, array(c3) as
[
https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40963:
--
Description:
Example:
{noformat}
select c1, explode(c4) as c5 from (
select c1, array(c3) as
Bruce Robbins created SPARK-41035:
-
Summary: Incorrect results or NPE when a literal is reused across
distinct aggregations
Key: SPARK-41035
URL: https://issues.apache.org/jira/browse/SPARK-41035
Proj
[
https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630125#comment-17630125
]
Bruce Robbins commented on SPARK-41035:
---
This is a bug in {{RewriteDistinctAggrega
[
https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41035:
--
Description:
This query produces incorrect results:
{noformat}
select a, count(distinct 100) a
Bruce Robbins created SPARK-41118:
-
Summary: to_number/try_to_number throws NullPointerException when
format is null
Key: SPARK-41118
URL: https://issues.apache.org/jira/browse/SPARK-41118
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-41118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41118:
--
Priority: Minor (was: Major)
> to_number/try_to_number throws NullPointerException when forma
Bruce Robbins created SPARK-41205:
-
Summary: Bad error message when try_to_binary called with
non-foldable format
Key: SPARK-41205
URL: https://issues.apache.org/jira/browse/SPARK-41205
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-41205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41205:
--
Priority: Minor (was: Major)
> Bad error message when try_to_binary called with non-foldable
[
https://issues.apache.org/jira/browse/SPARK-41205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637882#comment-17637882
]
Bruce Robbins commented on SPARK-41205:
---
Fixed by SPARK-41174.
> Bad error messag
[
https://issues.apache.org/jira/browse/SPARK-41205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-41205.
---
Resolution: Duplicate
> Bad error message when try_to_binary called with non-foldable format
Bruce Robbins created SPARK-41395:
-
Summary: InterpretedMutableProjection can corrupt unsafe buffer
when used with decimal data
Key: SPARK-41395
URL: https://issues.apache.org/jira/browse/SPARK-41395
[
https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41395:
--
Description:
The following returns the wrong answer:
{noformat}
set spark.sql.codegen.wholeSt
[
https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41395:
--
Affects Version/s: 3.2.3
> InterpretedMutableProjection can corrupt unsafe buffer when used wi
[
https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41395:
--
Affects Version/s: 3.3.1
> InterpretedMutableProjection can corrupt unsafe buffer when used wi
[
https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41395:
--
Description:
The following returns the wrong answer:
{noformat}
set spark.sql.codegen.wholeSt
Bruce Robbins created SPARK-41452:
-
Summary: to_char throws NullPointerException when format is null
Key: SPARK-41452
URL: https://issues.apache.org/jira/browse/SPARK-41452
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41452:
--
Description:
Example:
{noformat}
spark-sql> select to_char(454, null);
[INTERNAL_ERROR] The Sp
[
https://issues.apache.org/jira/browse/SPARK-39782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-39782:
--
Priority: Minor (was: Major)
> 3.2.2 Window function doc references TIMESTAMPNTZ
> --
Bruce Robbins created SPARK-39782:
-
Summary: 3.2.2 Window function doc references TIMESTAMPNTZ
Key: SPARK-39782
URL: https://issues.apache.org/jira/browse/SPARK-39782
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-39184:
--
Affects Version/s: 3.1.3
> ArrayIndexOutOfBoundsException for some date/time sequences in some
[
https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574412#comment-17574412
]
Bruce Robbins commented on SPARK-24914:
---
[~cabral1888] I think there already is a
[
https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574412#comment-17574412
]
Bruce Robbins edited comment on SPARK-24914 at 8/2/22 10:02 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574429#comment-17574429
]
Bruce Robbins commented on SPARK-24914:
---
I think it's "in progress" only because t
Bruce Robbins created SPARK-40002:
-
Summary: Limit pushed down through window using ntile function
Key: SPARK-40002
URL: https://issues.apache.org/jira/browse/SPARK-40002
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40002:
--
Summary: Limit improperly pushed down through window using ntile function
(was: Limit pushed
[
https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40002:
--
Labels: correctness (was: )
> Limit improperly pushed down through window using ntile functio
Bruce Robbins created SPARK-40152:
-
Summary: Codegen compilation error when using split_part
Key: SPARK-40152
URL: https://issues.apache.org/jira/browse/SPARK-40152
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17582045#comment-17582045
]
Bruce Robbins commented on SPARK-40152:
---
Seems to be a simple case of missing semi
Bruce Robbins created SPARK-40308:
-
Summary: str_to_map should accept non-foldable delimiter parameters
Key: SPARK-40308
URL: https://issues.apache.org/jira/browse/SPARK-40308
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40308:
--
Summary: str_to_map should accept non-foldable delimiter arguments (was:
str_to_map should ac
[
https://issues.apache.org/jira/browse/SPARK-40308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40308:
--
Description:
Currently, str_to_map requires the delimiter arguments to be foldable
expression
Bruce Robbins created SPARK-40382:
-
Summary: Reduce projections in Expand when multiple distinct
aggregations have semantically equivalent children
Key: SPARK-40382
URL: https://issues.apache.org/jira/browse/SPARK
Bruce Robbins created SPARK-40403:
-
Summary: Negative size in error message when unsafe array is too
big
Key: SPARK-40403
URL: https://issues.apache.org/jira/browse/SPARK-40403
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40403:
--
Priority: Minor (was: Major)
> Negative size in error message when unsafe array is too big
>
[
https://issues.apache.org/jira/browse/SPARK-40403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-40403:
--
Description:
When initializing an overly large unsafe array via
{{UnsafeArrayWriter#initializ
Bruce Robbins created SPARK-41535:
-
Summary: InterpretedUnsafeProjection and
InterpretedMutableProjection can corrupt unsafe buffer when used with calendar
interval data
Key: SPARK-41535
URL: https://issues.apach
[
https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17648251#comment-17648251
]
Bruce Robbins commented on SPARK-41535:
---
I will take a stab at fixing this shortly
[
https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41535:
--
Affects Version/s: 3.2.3
> InterpretedUnsafeProjection and InterpretedMutableProjection can co
[
https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41535:
--
Affects Version/s: 3.3.1
> InterpretedUnsafeProjection and InterpretedMutableProjection can co
[
https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653348#comment-17653348
]
Bruce Robbins commented on SPARK-41793:
---
[~cloud_fan] [~ulysses]
The change in be
Bruce Robbins created SPARK-41804:
-
Summary: InterpretedUnsafeProjection doesn't properly handle an
array of UDTs
Key: SPARK-41804
URL: https://issues.apache.org/jira/browse/SPARK-41804
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41804:
--
Description:
Reproduction steps:
{noformat}
// create a file of vector data
import org.apache.
[
https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41804:
--
Environment: (was: Reproduction steps:
{noformat}
// create a file of vector data
import or
[
https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653367#comment-17653367
]
Bruce Robbins commented on SPARK-41804:
---
I think I have a handle on what's going o
[
https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41804:
--
Description:
Reproduction steps:
{noformat}
// create a file of vector data
import org.apache.
Bruce Robbins created SPARK-41991:
-
Summary: Interpreted mode subexpression elimination can throw
exception during insert
Key: SPARK-41991
URL: https://issues.apache.org/jira/browse/SPARK-41991
Projec
[
https://issues.apache.org/jira/browse/SPARK-41991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-41991:
--
Affects Version/s: 3.3.1
> Interpreted mode subexpression elimination can throw exception duri
Bruce Robbins created SPARK-42384:
-
Summary: Mask function's generated code does not handle null input
Key: SPARK-42384
URL: https://issues.apache.org/jira/browse/SPARK-42384
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-42384:
--
Affects Version/s: 3.4.0
> Mask function's generated code does not handle null input
> ---
Bruce Robbins created SPARK-42401:
-
Summary: Incorrect results or NPE when inserting null value using
array_insert/array_append
Key: SPARK-42401
URL: https://issues.apache.org/jira/browse/SPARK-42401
[
https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-42401:
--
Labels: correctness (was: )
> Incorrect results or NPE when inserting null value using
> arr
[
https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-42401:
--
Summary: Incorrect results or NPE when inserting null value into array
using array_insert/arra
[
https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17688759#comment-17688759
]
Bruce Robbins commented on SPARK-42401:
---
There is another case:
{noformat}
spark-s
[
https://issues.apache.org/jira/browse/SPARK-48965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874352#comment-17874352
]
Bruce Robbins commented on SPARK-48965:
---
It's not just decimals. {{toJSON}} is sim
[
https://issues.apache.org/jira/browse/SPARK-48965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874352#comment-17874352
]
Bruce Robbins edited comment on SPARK-48965 at 8/16/24 6:52 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-48965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-48965:
--
Labels: correctness (was: )
> toJSON produces wrong values if DecimalType information is lost
[
https://issues.apache.org/jira/browse/SPARK-49261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875657#comment-17875657
]
Bruce Robbins commented on SPARK-49261:
---
{quote}It seems to be a correlation betwe
[
https://issues.apache.org/jira/browse/SPARK-49350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876366#comment-17876366
]
Bruce Robbins commented on SPARK-49350:
---
Possibly the same as SPARK-49000?
> Fold
[
https://issues.apache.org/jira/browse/SPARK-49350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877052#comment-17877052
]
Bruce Robbins commented on SPARK-49350:
---
[~Wayne Guo] Thanks for the update. Closi
[
https://issues.apache.org/jira/browse/SPARK-49350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-49350.
---
Resolution: Duplicate
> FoldablePropagation rule and ConstantFolding rule leads to wrong agg
[
https://issues.apache.org/jira/browse/SPARK-49261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-49261:
--
Fix Version/s: (was: 3.5.0)
> Correlation between lit and round during grouping
>
[
https://issues.apache.org/jira/browse/SPARK-49261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-49261:
--
Target Version/s: (was: 3.5.0)
> Correlation between lit and round during grouping
> ---
[
https://issues.apache.org/jira/browse/SPARK-45745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877165#comment-17877165
]
Bruce Robbins commented on SPARK-45745:
---
I will close as a duplicate of SPARK-4507
[
https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-40706.
---
Resolution: Duplicate
> IllegalStateException when querying array values inside a nested str
[
https://issues.apache.org/jira/browse/SPARK-45745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-45745.
---
Resolution: Duplicate
> Extremely slow execution of sum of columns in Spark 3.4.1
>
[
https://issues.apache.org/jira/browse/SPARK-48965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878658#comment-17878658
]
Bruce Robbins commented on SPARK-48965:
---
[~LDVSoft] are you looking to fix this? I
[
https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879050#comment-17879050
]
Bruce Robbins commented on SPARK-47193:
---
[~dongjoon]
I started to work on it, bu
[
https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879306#comment-17879306
]
Bruce Robbins commented on SPARK-48950:
---
By the way, there was a vectorization-rel
[
https://issues.apache.org/jira/browse/SPARK-49529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879956#comment-17879956
]
Bruce Robbins commented on SPARK-49529:
---
This actually matches Java 17's behavior.
[
https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879050#comment-17879050
]
Bruce Robbins edited comment on SPARK-47193 at 9/13/24 5:13 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17886449#comment-17886449
]
Bruce Robbins commented on SPARK-47193:
---
PR https://github.com/apache/spark/pull/4
Bruce Robbins created SPARK-50091:
-
Summary: Query fails when aggregate expression is in left-hand
operand of IN-subquery
Key: SPARK-50091
URL: https://issues.apache.org/jira/browse/SPARK-50091
Projec
[
https://issues.apache.org/jira/browse/SPARK-50091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-50091:
--
Affects Version/s: 3.5.2
(was: 3.5.0)
> Query fails when aggregate
[
https://issues.apache.org/jira/browse/SPARK-50091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-50091:
--
Description:
Consider this query:
{noformat}
create or replace temp view v1(c1, c2) as values
Bruce Robbins created SPARK-52339:
-
Summary: Relations may appear equal even though they are different
Key: SPARK-52339
URL: https://issues.apache.org/jira/browse/SPARK-52339
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-52339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-52339:
--
Labels: correctness (was: )
> Relations may appear equal even though they are different
> ---
401 - 481 of 481 matches
Mail list logo
