xsys created SPARK-40630:
Summary: Both SparkSQL and DataFrame insert invalid DATE/TIMESTAMP
as NULL
Key: SPARK-40630
URL: https://issues.apache.org/jira/browse/SPARK-40630
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-40630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40630:
-
Description:
h3. Describe the bug
When we construct a DataFrame with an invalid DATE/TIMESTAMP (e.g.
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: Pull out complex join condition and infer more filters.png
> Reorder join keys impact
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via
[
https://issues.apache.org/jira/browse/SPARK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612017#comment-17612017
]
Apache Spark commented on SPARK-36290:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612016#comment-17612016
]
Apache Spark commented on SPARK-36290:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via
xsys created SPARK-40629:
Summary: FLOAT/DOUBLE division by 0 gives Infinity/-Infinity/NaN
in DataFrame but NULL in SparkSQL
Key: SPARK-40629
URL: https://issues.apache.org/jira/browse/SPARK-40629
Project:
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
[
https://issues.apache.org/jira/browse/SPARK-40620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40620.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38058
[
https://issues.apache.org/jira/browse/SPARK-40620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40620:
Assignee: Khalid Mammadov
> Deduplication of WorkerOffer build in
[
https://issues.apache.org/jira/browse/SPARK-38004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611943#comment-17611943
]
Kyle Kent commented on SPARK-38004:
---
[~itholic] Finally made the pull request. I had trouble building
[
https://issues.apache.org/jira/browse/SPARK-38004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38004:
Assignee: (was: Apache Spark)
> read_excel's parameter - mangle_dupe_cols is used to
[
https://issues.apache.org/jira/browse/SPARK-38004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38004:
Assignee: Apache Spark
> read_excel's parameter - mangle_dupe_cols is used to handle
[
https://issues.apache.org/jira/browse/SPARK-38004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611942#comment-17611942
]
Apache Spark commented on SPARK-38004:
--
User 'kentkr' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40165.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38054
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40165:
Assignee: BingKun Pan
> Update test plugins to latest versions
>
[
https://issues.apache.org/jira/browse/SPARK-40628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611913#comment-17611913
]
Apache Spark commented on SPARK-40628:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611912#comment-17611912
]
Apache Spark commented on SPARK-40628:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40628:
Assignee: (was: Apache Spark)
> Do not push complex left semi/anti join condition
[
https://issues.apache.org/jira/browse/SPARK-40628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40628:
Assignee: Apache Spark
> Do not push complex left semi/anti join condition through
Yuming Wang created SPARK-40628:
---
Summary: Do not push complex left semi/anti join condition through
project
Key: SPARK-40628
URL: https://issues.apache.org/jira/browse/SPARK-40628
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611909#comment-17611909
]
Apache Spark commented on SPARK-40409:
--
User 'ming95' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611910#comment-17611910
]
Apache Spark commented on SPARK-40409:
--
User 'ming95' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40409:
Assignee: (was: Apache Spark)
> IncompatibleSchemaException when BYTE stored from
[
https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40409:
Assignee: Apache Spark
> IncompatibleSchemaException when BYTE stored from DataFrame to
[
https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611898#comment-17611898
]
Qian Sun commented on SPARK-40569:
--
[~bjornjorgensen]Thanks for your share
> Expose port for spark
[
https://issues.apache.org/jira/browse/SPARK-38465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611896#comment-17611896
]
Khalid Mammadov commented on SPARK-38465:
-
Hi [~bozhang] [~maxgekk], I would like to look into
[
https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611858#comment-17611858
]
Apache Spark commented on SPARK-37935:
--
User 'MaxGekk' has created a pull request for this issue:
Max Gekk created SPARK-40627:
Summary: Eliminate error sub-classes
Key: SPARK-40627
URL: https://issues.apache.org/jira/browse/SPARK-40627
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Description:
{code:scala}
sql("CREATE TABLE t1 (itemid BIGINT, eventType STRING, dt STRING) USING
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Summary: Reorder join keys impact performance (was: Do not reorder join
keys in
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: Pull out complex join condition.png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: (was: Pull out complex join condition.png)
> Do not reorder join keys in
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: Pull out complex join condition.png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: change the aggregate key order.png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: default(join order will change).png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Description:
{code:scala}
sql("CREATE TABLE t1 (itemid BIGINT, eventType STRING, dt STRING)
[
https://issues.apache.org/jira/browse/SPARK-40509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611825#comment-17611825
]
Apache Spark commented on SPARK-40509:
--
User 'chaoqin-li1123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611826#comment-17611826
]
Apache Spark commented on SPARK-40509:
--
User 'chaoqin-li1123' has created a pull request for this
41 matches
Mail list logo
