[
https://issues.apache.org/jira/browse/SPARK-45424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772365#comment-17772365
]
Andy Grove commented on SPARK-45424:
The regression seems to have been introduced in
[
https://issues.apache.org/jira/browse/SPARK-45424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-45424:
---
Summary: Regression in CSV schema inference when timestamps do not match
specified timestampFormat
[
https://issues.apache.org/jira/browse/SPARK-45424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-45424:
---
Description:
There is a regression in Spark 3.5.0 when inferring the schema of CSV files
containing
Andy Grove created SPARK-45424:
--
Summary: Regression in CSV schema inference when timestampFormat
is specified
Key: SPARK-45424
URL: https://issues.apache.org/jira/browse/SPARK-45424
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-44616:
---
Description:
PR [https://github.com/apache/spark/pull/39555] changed DeferredObject to no
longer co
[
https://issues.apache.org/jira/browse/SPARK-44616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-44616:
---
Description:
PR https://github.com/apache/spark/pull/39555 changed DeferredObject to no
longer cont
Andy Grove created SPARK-44616:
--
Summary: Hive Generic UDF support no longer supports
short-circuiting of argument evaluation
Key: SPARK-44616
URL: https://issues.apache.org/jira/browse/SPARK-44616
Proje
[
https://issues.apache.org/jira/browse/SPARK-39991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-39991:
---
Description:
In QueryStageExec.computeStats we copy partial statistics from materlized query
stages
Andy Grove created SPARK-39991:
--
Summary: AQE should use available column statistics from completed
query stages
Key: SPARK-39991
URL: https://issues.apache.org/jira/browse/SPARK-39991
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503123#comment-17503123
]
Andy Grove commented on SPARK-30788:
[~cloud_fan] [~maxgekk] I think the fix version
[
https://issues.apache.org/jira/browse/SPARK-38060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-38060:
---
Description:
The behavior of the JSON option allowNonNumericNumbers is not consistent:
1. Some NaN
Andy Grove created SPARK-38060:
--
Summary: Inconsistent behavior from JSON option
allowNonNumericNumbers
Key: SPARK-38060
URL: https://issues.apache.org/jira/browse/SPARK-38060
Project: Spark
Is
Andy Grove created SPARK-3:
--
Summary: [SQL] Regression in AQEShuffleReadExec
Key: SPARK-3
URL: https://issues.apache.org/jira/browse/SPARK-3
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-3:
---
Description:
I am currently testing the RAPIDS Accelerator for Apache Spark with the Spark
3.2 rele
[
https://issues.apache.org/jira/browse/SPARK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-36076:
---
Summary: [SQL] ArrayIndexOutOfBounds in CAST string to timestamp (was:
[SQL] ArrayIndexOutOfBounds
[
https://issues.apache.org/jira/browse/SPARK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-36076:
---
Description:
I discovered this bug during some fuzz testing.
{code:java}
__
[
https://issues.apache.org/jira/browse/SPARK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-36076:
---
Description:
{code:java}
__
/ __/__ ___ _/ /__
_\ \/ _ \/ _ `/
Andy Grove created SPARK-36076:
--
Summary: [SQL] ArrayIndexOutOfBounds in CAST string to date
Key: SPARK-36076
URL: https://issues.apache.org/jira/browse/SPARK-36076
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-35881:
---
Affects Version/s: 3.0.3
3.1.2
> [SQL] AQE does not support columnar executio
[
https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-35881:
---
Description:
In AdaptiveSparkPlanExec, a query is broken down into stages and these stages
are exec
[
https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-35881:
---
Description:
In AdaptiveSparkPlanExec, a query is broken down into stages and these stages
are exec
[
https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-35881:
---
Description:
In AdaptiveSparkPlanExec, a query is broken down into stages and these stages
are exec
Andy Grove created SPARK-35881:
--
Summary: [SQL] AQE does not support columnar execution for the
final query stage
Key: SPARK-35881
URL: https://issues.apache.org/jira/browse/SPARK-35881
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-35767:
---
Priority: Minor (was: Major)
> [SQL] CoalesceExec can execute child plan twice
> --
Andy Grove created SPARK-35767:
--
Summary: [SQL] CoalesceExec can execute child plan twice
Key: SPARK-35767
URL: https://issues.apache.org/jira/browse/SPARK-35767
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347817#comment-17347817
]
Andy Grove commented on SPARK-32304:
[~dongjoon] This is the issue we just saw in br
[
https://issues.apache.org/jira/browse/SPARK-35353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-35353:
---
Summary: Cross-building docker images to ARM64 is failing (with Ubuntu
host) (was: Cross-building d
[
https://issues.apache.org/jira/browse/SPARK-35353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342066#comment-17342066
]
Andy Grove commented on SPARK-35353:
The issue seems specific to running on an Ubunt
Andy Grove created SPARK-35353:
--
Summary: Cross-building docker images to ARM64 is failing
Key: SPARK-35353
URL: https://issues.apache.org/jira/browse/SPARK-35353
Project: Spark
Issue Type: Bug
Andy Grove created SPARK-35093:
--
Summary: [SQL] AQE columnar mismatch on exchange reuse
Key: SPARK-35093
URL: https://issues.apache.org/jira/browse/SPARK-35093
Project: Spark
Issue Type: Bug
Andy Grove created SPARK-34682:
--
Summary: Regression in "operating on canonicalized plan" check in
CustomShuffleReaderExec
Key: SPARK-34682
URL: https://issues.apache.org/jira/browse/SPARK-34682
Project:
[
https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17296391#comment-17296391
]
Andy Grove commented on SPARK-34645:
I can reproduce this with Spark 3.1.1 + JDK 11
[
https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17296358#comment-17296358
]
Andy Grove commented on SPARK-34645:
I just confirmed that this only happens with JD
Andy Grove created SPARK-34645:
--
Summary: [K8S] Driver pod stuck in Running state after job
completes
Key: SPARK-34645
URL: https://issues.apache.org/jira/browse/SPARK-34645
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-33744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-33744:
---
Affects Version/s: 3.0.1
> Canonicalization error in SortAggregate
> ---
[
https://issues.apache.org/jira/browse/SPARK-33744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-33744:
---
Affects Version/s: (was: 3.1.0)
> Canonicalization error in SortAggregate
>
Andy Grove created SPARK-33744:
--
Summary: Canonicalization error in SortAggregate
Key: SPARK-33744
URL: https://issues.apache.org/jira/browse/SPARK-33744
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove resolved SPARK-32671.
Resolution: Invalid
I was mistaken about this issue.
> Race condition in MapOutputTracker.getStat
Andy Grove created SPARK-32671:
--
Summary: Race condition in MapOutputTracker.getStatistics
Key: SPARK-32671
URL: https://issues.apache.org/jira/browse/SPARK-32671
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994510#comment-16994510
]
Andy Grove commented on SPARK-29640:
Closing this as not a bug. We have confirmed th
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-29640:
---
Comment: was deleted
(was: We were finally able to get to a root cause on this so I'm documenting it
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994257#comment-16994257
]
Andy Grove commented on SPARK-29640:
We were finally able to get to a root cause on
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove resolved SPARK-29640.
Resolution: Not A Bug
> [K8S] Intermittent "java.net.UnknownHostException: kubernetes.default.svc"
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove reopened SPARK-29640:
Re-opening this as the issue came back and is ongoing. I am exploring other
solutions and will post h
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove resolved SPARK-29640.
Resolution: Not A Bug
Specifying TCP mode for DNS lookups did not help and this turned out to be a
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963175#comment-16963175
]
Andy Grove commented on SPARK-29640:
A hacky workaround is to wait for DNS to resolv
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-29640:
---
Description:
We are running into intermittent DNS issues where the Spark driver fails to
resolve "k
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-29640:
---
Description:
We are running into intermittent DNS issues where the Spark driver fails to
resolve "k
[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963059#comment-16963059
]
Andy Grove commented on SPARK-29640:
Installing node local dns cache daemon might be
Andy Grove created SPARK-29640:
--
Summary: [K8S] Make it possible to set DNS option to use TCP
instead of UDP
Key: SPARK-29640
URL: https://issues.apache.org/jira/browse/SPARK-29640
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-28921:
---
Affects Version/s: 2.3.0
2.3.1
2.4.0
[
https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove resolved SPARK-28925.
Resolution: Duplicate
> Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 an
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920411#comment-16920411
]
Andy Grove commented on SPARK-28921:
[~dongjoon] we are seeing it on both of the EKS
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-28921:
---
Summary: Spark jobs failing on latest versions of Kubernetes (1.15.3,
1.14.6, 1,13.10, 1.12.10, 1.11
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-28921:
---
Summary: Spark jobs failing on latest versions of Kubernetes (1.15.3,
1.14.6, 1,13.10, 1.11.10) (wa
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920133#comment-16920133
]
Andy Grove commented on SPARK-28921:
Here's a PR to fix against master branch since
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-28921:
---
Affects Version/s: 2.3.3
> Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13
[
https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919907#comment-16919907
]
Andy Grove edited comment on SPARK-28925 at 8/30/19 9:54 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919907#comment-16919907
]
Andy Grove edited comment on SPARK-28925 at 8/30/19 9:55 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-28925:
---
Affects Version/s: 2.3.3
> Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 a
[
https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919907#comment-16919907
]
Andy Grove commented on SPARK-28925:
This also impacts Spark 2.3.3
> Update Kuberne
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110785#comment-15110785
]
Andy Grove commented on SPARK-12932:
Here is a pull request to change the error messa
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110772#comment-15110772
]
Andy Grove commented on SPARK-12932:
After reviewing the code for this, I think it is
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109389#comment-15109389
]
Andy Grove commented on SPARK-12932:
OK, I updated the JIRA with more info. Yes, I ac
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-12932:
---
Description:
When trying to create a Dataset from an RDD of Person (all using the Java API),
I got t
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-12932:
---
Description:
When trying to create a Dataset from an RDD of Person (all using the Java API),
I got t
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-12932:
---
Description:
When trying to create a Dataset from an RDD of Person (all using the Java API),
I got t
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-12932:
---
Description:
When trying to create a Dataset from an RDD of Person (all using the Java API),
I got t
Andy Grove created SPARK-12932:
--
Summary: Cannot convert list of simple Java objects to Dataset (no
encoder found)
Key: SPARK-12932
URL: https://issues.apache.org/jira/browse/SPARK-12932
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated SPARK-12932:
---
Description:
When trying to create a Dataset from an RDD of Person (all using the Java API),
I get t
70 matches
Mail list logo
