ulysses you created SPARK-34725:
---
Summary: Do not show Statistics(sizeInBytes=8.0 EiB) if we don't
have valid stats
Key: SPARK-34725
URL: https://issues.apache.org/jira/browse/SPARK-34725
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300168#comment-17300168
]
Apache Spark commented on SPARK-34725:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34725:
Assignee: (was: Apache Spark)
> Do not show Statistics(sizeInBytes=8.0 EiB) if we don
[
https://issues.apache.org/jira/browse/SPARK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34725:
Assignee: Apache Spark
> Do not show Statistics(sizeInBytes=8.0 EiB) if we don't have val
[
https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300178#comment-17300178
]
Dmitry Kravchuk commented on SPARK-34588:
-
[~hyukjin.kwon] hey there.
I have so
Peter Toth created SPARK-34726:
--
Summary: Fix collectToPython timeouts
Key: SPARK-34726
URL: https://issues.apache.org/jira/browse/SPARK-34726
Project: Spark
Issue Type: Bug
Components
[
https://issues.apache.org/jira/browse/SPARK-34726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Toth updated SPARK-34726:
---
Affects Version/s: (was: 3.1.1)
2.4.7
> Fix collectToPython timeouts
> --
[
https://issues.apache.org/jira/browse/SPARK-34726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34726:
Assignee: (was: Apache Spark)
> Fix collectToPython timeouts
> --
[
https://issues.apache.org/jira/browse/SPARK-34726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34726:
Assignee: Apache Spark
> Fix collectToPython timeouts
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-34726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300203#comment-17300203
]
Apache Spark commented on SPARK-34726:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-34726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300206#comment-17300206
]
Apache Spark commented on SPARK-34726:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300263#comment-17300263
]
Maxim Gekk commented on SPARK-34727:
I am working on a fix.
> Difference in results
Maxim Gekk created SPARK-34727:
--
Summary: Difference in results of casting float to timestamp
Key: SPARK-34727
URL: https://issues.apache.org/jira/browse/SPARK-34727
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300264#comment-17300264
]
Hyukjin Kwon commented on SPARK-34588:
--
If it's a different issue from this, let's
[
https://issues.apache.org/jira/browse/SPARK-34724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34724.
--
Fix Version/s: 3.0.3
3.1.2
3.2.0
2.4.8
[
https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300307#comment-17300307
]
Apache Spark commented on SPARK-34727:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34727:
Assignee: (was: Apache Spark)
> Difference in results of casting float to timestamp
>
[
https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34727:
Assignee: Apache Spark
> Difference in results of casting float to timestamp
> --
[
https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300309#comment-17300309
]
Apache Spark commented on SPARK-34727:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34429.
--
Fix Version/s: 3.1.1
Assignee: Sean R. Owen
Resolution: Fixed
Resolved in comm
[
https://issues.apache.org/jira/browse/SPARK-34721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-34721:
---
Assignee: Maxim Gekk
> Add an year-month interval to a date
> -
[
https://issues.apache.org/jira/browse/SPARK-34721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-34721.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31812
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-3.
-
Resolution: Won't Fix
> Pushdown scalar-subquery filter to FileSourceScan
>
[
https://issues.apache.org/jira/browse/SPARK-34717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34717.
--
Resolution: Not A Problem
This isn't related to Spark's software. You have extraneous files in
[
https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300501#comment-17300501
]
Sean R. Owen commented on SPARK-34680:
--
Why do you think it's related to disk space
[
https://issues.apache.org/jira/browse/SPARK-34641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34641.
--
Resolution: Not A Problem
I think this is a transient CI env issue.
> ARM CI failed due to do
[
https://issues.apache.org/jira/browse/SPARK-34618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34618.
--
Resolution: Duplicate
> CVEs in library dependencies
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-34617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34617.
--
Resolution: Not A Problem
You're welcome to propose dependency updates in a PR if they're easy
[
https://issues.apache.org/jira/browse/SPARK-34587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34587.
--
Resolution: Won't Fix
> Replaces map and getOrElse(false/true) with exists/forall
> --
[
https://issues.apache.org/jira/browse/SPARK-34570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34570.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Resolved by https://github.com/apache/spark/pull
[
https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34564.
--
Resolution: Not A Problem
> DateTimeUtils.fromJavaDate fails for very late dates during castin
[
https://issues.apache.org/jira/browse/SPARK-34522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34522.
--
Resolution: Done
Yes, but I see no reason to have an open-ended umbrella. Report issues as you
Yuming Wang created SPARK-34728:
---
Summary: Remove all SQLConf.get if extends from Rule
Key: SPARK-34728
URL: https://issues.apache.org/jira/browse/SPARK-34728
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300533#comment-17300533
]
Yuming Wang commented on SPARK-34728:
-
I'm working on.
> Remove all SQLConf.get if
[
https://issues.apache.org/jira/browse/SPARK-33482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33482:
Assignee: Apache Spark
> V2 Datasources that extend FileScan preclude exchange reuse
> --
[
https://issues.apache.org/jira/browse/SPARK-33482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300548#comment-17300548
]
Apache Spark commented on SPARK-33482:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-33482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33482:
Assignee: (was: Apache Spark)
> V2 Datasources that extend FileScan preclude exchange
[
https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300573#comment-17300573
]
Sean R. Owen commented on SPARK-34517:
--
That's wild. I think this is a Breeze issue
[
https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300575#comment-17300575
]
Sean R. Owen commented on SPARK-34511:
--
What on this list probably affects Spark? w
[
https://issues.apache.org/jira/browse/SPARK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34403.
--
Resolution: Won't Fix
> Remove dependency to commons-httpclient, is not used and has vulnerabi
[
https://issues.apache.org/jira/browse/SPARK-34279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34279.
--
Resolution: Won't Fix
> Upgrade Junit from 4.x to 5.x
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300578#comment-17300578
]
Shixiong Zhu commented on SPARK-19256:
--
I read
[https://docs.google.com/document/d
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300591#comment-17300591
]
Cheng Su commented on SPARK-19256:
--
[~zsxwing] - sorry the design doc was years old, an
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300594#comment-17300594
]
Shixiong Zhu commented on SPARK-19256:
--
[~chengsu] Thanks for the answers. Sounds l
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300611#comment-17300611
]
Cheng Su commented on SPARK-19256:
--
[~zsxwing] - if users gets table path, and writes d
Cheng Su created SPARK-34729:
Summary: Faster execution for broadcast nested loop join (left
semi/anti with no condition)
Key: SPARK-34729
URL: https://issues.apache.org/jira/browse/SPARK-34729
Project: S
funny liu created SPARK-34730:
-
Summary: how use the idea and scala to develop the
spark,(configuration environment)
Key: SPARK-34730
URL: https://issues.apache.org/jira/browse/SPARK-34730
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300675#comment-17300675
]
Apache Spark commented on SPARK-34729:
--
User 'c21' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34729:
Assignee: Apache Spark
> Faster execution for broadcast nested loop join (left semi/anti
[
https://issues.apache.org/jira/browse/SPARK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34729:
Assignee: (was: Apache Spark)
> Faster execution for broadcast nested loop join (left
[
https://issues.apache.org/jira/browse/SPARK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300676#comment-17300676
]
Apache Spark commented on SPARK-34729:
--
User 'c21' has created a pull request for t
Bruce Robbins created SPARK-34731:
-
Summary: ConcurrentModificationException in EventLoggingListener
when redacting properties
Key: SPARK-34731
URL: https://issues.apache.org/jira/browse/SPARK-34731
P
[
https://issues.apache.org/jira/browse/SPARK-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abdeali Kothari updated SPARK-7276:
---
Attachment: test.py
> withColumn is very slow on dataframe with large number of columns
> ---
[
https://issues.apache.org/jira/browse/SPARK-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300724#comment-17300724
]
Abdeali Kothari commented on SPARK-7276:
confirm that even with 2.4 there is a s
[
https://issues.apache.org/jira/browse/SPARK-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300724#comment-17300724
]
Abdeali Kothari edited comment on SPARK-7276 at 3/13/21, 5:03 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300724#comment-17300724
]
Abdeali Kothari edited comment on SPARK-7276 at 3/13/21, 5:09 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-34730:
Fix Version/s: (was: 3.0.1)
> how use the idea and scala to develop the spark,(configuration e
[
https://issues.apache.org/jira/browse/SPARK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-34730:
Target Version/s: (was: 3.0.1)
> how use the idea and scala to develop the spark,(configuration
[
https://issues.apache.org/jira/browse/SPARK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-34730.
-
Resolution: Invalid
Please see IDE Setup: http://spark.apache.org/developer-tools.html#IDE%20Set
[
https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-34188.
--
Resolution: Not A Problem
applied another solution, not a problem anymore
> Char varchar length check
60 matches
Mail list logo