[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
When we store a BINARY value (e.g. {{BigInt("1").toByteArray)}} /
{{{}X'01'{
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17619715#comment-17619715
]
xsys commented on SPARK-40637:
--
Thank you for the response [~ivan.sadikov].
I just updated
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
When we store a BINARY value (e.g. {{BigInt("1").toByteArray)}} /
{{{}X'01'{
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
When we store a BINARY value (e.g. {{BigInt("1").toByteArray)}} /
{{{}X'01'{
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
When we store a BINARY value (e.g. {{BigInt("1").toByteArray)}} /
{{{}X'01'{
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
When we store a BINARY value (e.g. {{BigInt("1").toByteArray)}} /
{{{}X'01'{
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Summary: Spark-shell can correctly encode BINARY type but Spark-sql cannot
(was: DataFrame can correctly encode
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
When we store a BINARY value (e.g. {{BigInt("1").toByteArray)}} /
{{{}X'01'{
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Attachment: image-2022-10-18-12-15-05-576.png
> DataFrame can correctly encode BINARY type but SparkSQL cannot
>
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
[
https://issues.apache.org/jira/browse/SPARK-40630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40630:
-
Description:
h3. Describe the bug
When we construct a DataFrame with an invalid DATE/TIMESTAMP (e.g.
{{{}1969-
[
https://issues.apache.org/jira/browse/SPARK-40630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40630:
-
Description:
h3. Describe the bug
When we construct a DataFrame with an invalid DATE/TIMESTAMP (e.g.
{{{}1969-
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
).floatVal
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
xsys created SPARK-40637:
Summary: DataFrame can correctly encode BINARY type but SparkSQL
cannot
Key: SPARK-40637
URL: https://issues.apache.org/jira/browse/SPARK-40637
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
).floatVal
xsys created SPARK-40630:
Summary: Both SparkSQL and DataFrame insert invalid DATE/TIMESTAMP
as NULL
Key: SPARK-40630
URL: https://issues.apache.org/jira/browse/SPARK-40630
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-40630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40630:
-
Description:
h3. Describe the bug
When we construct a DataFrame with an invalid DATE/TIMESTAMP (e.g.
{{{}1969-
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
xsys created SPARK-40629:
Summary: FLOAT/DOUBLE division by 0 gives Infinity/-Infinity/NaN
in DataFrame but NULL in SparkSQL
Key: SPARK-40629
URL: https://issues.apache.org/jira/browse/SPARK-40629
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
).floatVal
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
).floatVal
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
xsys created SPARK-40624:
Summary: A DECIMAL value with division by 0 errors in DataFrame
but evaluates to NULL in SparkSQL
Key: SPARK-40624
URL: https://issues.apache.org/jira/browse/SPARK-40624
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40616:
-
Description:
h3. Describe the bug
We are trying to save {{DECIMAL}} values with high precision in a table using
[
https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40616:
-
Description:
h3. Describe the bug
We are trying to save {{DECIMAL}} values with high precision in a table using
[
https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40616:
-
Description:
h3. Describe the bug
We are trying to save {{DECIMAL}} values with high precision in a table using
[
https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40616:
-
Description:
h3. Describe the bug
We are trying to save {{DECIMAL}} values with high precision in a table using
xsys created SPARK-40616:
Summary: Loss of precision using SparkSQL shell on high-precision
DECIMAL types
Key: SPARK-40616
URL: https://issues.apache.org/jira/browse/SPARK-40616
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-40525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40525:
-
Description:
h3. Describe the bug
Storing an invalid INT value {{1.1}} using DataFrames via {{spark-shell}}
ex
[
https://issues.apache.org/jira/browse/SPARK-40525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40525:
-
Description:
h3. Describe the bug
Storing an invalid INT value {{1.1}} using DataFrames via {{spark-shell}}
ex
xsys created SPARK-40525:
Summary: Floating-point value with an INT/BYTE/SHORT/LONG type
errors out in DataFrame but evaluates to a rounded value in SparkSQL
Key: SPARK-40525
URL: https://issues.apache.org/jira/browse/SPA
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:23 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:23 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:22 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:22 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:21 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:21 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:20 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:20 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:18 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys edited comment on SPARK-40439 at 9/20/22 5:17 PM:
---
[~hyukjin.
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17607314#comment-17607314
]
xsys commented on SPARK-40439:
--
[~hyukjin.kwon]: Thank you for your response! Setting
{{sp
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40439:
-
Description:
h3. Describe the bug
We are trying to store a DECIMAL value {{333.22}} with more
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40439:
-
Description:
h3. Describe the bug
We are trying to store a DECIMAL value {{333.22}} with more
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40439:
-
Description:
h3. Describe the bug
We are trying to store a DECIMAL value {{333.22}} with more
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40439:
-
Description:
h3. Describe the bug
We are trying to store a DECIMAL value {{333.22}} with more
xsys created SPARK-40439:
Summary: DECIMAL value with more precision than what is defined in
the schema raises exception in SparkSQL but evaluates to NULL for DataFrame
Key: SPARK-40439
URL: https://issues.apache.org/jira
[
https://issues.apache.org/jira/browse/SPARK-40439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40439:
-
Description:
h3. Describe the bug
We are trying to store a DECIMAL value {{333.22}} with more
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40409:
-
Description:
h3. Describe the bug
We are trying to store a BYTE {{"-128"}} to a table created via Spark
DataFr
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40409:
-
Description:
h2. Describe the bug
We are trying to store a BYTE {{"-128"}} to a table created via Spark
DataFr
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40409:
-
Description:
h2. Describe the bug
We are trying to store a BYTE {{"-128"}} to a table created via Spark
DataFr
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40409:
-
Description:
h3. Describe the bug
We are trying to store a BYTE {{"-128"}} to a table created via Spark
DataFr
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40409:
-
Description:
h3. Describe the bug
We are trying to store a BYTE {{"-128"}} to a table created via Spark
DataFr
xsys created SPARK-40409:
Summary: IncompatibleSchemaException when BYTE stored from
DataFrame to Avro is read using spark-sql
Key: SPARK-40409
URL: https://issues.apache.org/jira/browse/SPARK-40409
Project:
[
https://issues.apache.org/jira/browse/SPARK-39158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39158:
-
Description:
h2. Describe the bug
We are trying to save a table containing a `{{{}DecimalType{}}}` column
cons
[
https://issues.apache.org/jira/browse/SPARK-39158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39158:
-
Description:
h2. Describe the bug
We are trying to save a table containing a `{{{}DecimalType{}}}` column
cons
[
https://issues.apache.org/jira/browse/SPARK-39158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39158:
-
Description:
h2. Describe the bug
We are trying to save a table containing a `DecimalType` column constructed
xsys created SPARK-39158:
Summary: A valid DECIMAL inserted by DataFrame cannot be read in
HiveQL
Key: SPARK-39158
URL: https://issues.apache.org/jira/browse/SPARK-39158
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531398#comment-17531398
]
xsys edited comment on SPARK-39075 at 5/3/22 8:34 PM:
--
Thanks for t
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531398#comment-17531398
]
xsys commented on SPARK-39075:
--
Thanks for the response, Erik.
I understand the concern. O
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39075:
-
Description:
h3. Describe the bug
We are trying to save a table constructed through a DataFrame with the {{Avro
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39075:
-
Description:
h3. Describe the bug
We are trying to save a table constructed through a DataFrame with the {{Avro
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39075:
-
Description:
h3. Describe the bug
We are trying to save a table constructed through a DataFrame with the {{Avro
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39075:
-
Description:
h3. Describe the bug
We are trying to save a table constructed through a DataFrame with the {{Avro
[
https://issues.apache.org/jira/browse/SPARK-39075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-39075:
-
Description:
h3. Describe the bug
We are trying to save a table constructed through a DataFrame with the {{Avro
xsys created SPARK-39075:
Summary: IncompatibleSchemaException when selecting data from
table stored from a DataFrame in Avro format with BYTE/SHORT
Key: SPARK-39075
URL: https://issues.apache.org/jira/browse/SPARK-39075
75 matches
Mail list logo
