[
https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090352#comment-17090352
]
peay commented on SPARK-27039:
--
[~hyukjin.kwon] do you know if this was eventually back ported in 2.4.x?
[
https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786658#comment-16786658
]
peay commented on SPARK-27039:
--
For reference, I've realized you can also get an incomplete but non-empty
[
https://issues.apache.org/jira/browse/SPARK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786456#comment-16786456
]
peay commented on SPARK-24624:
--
I mean regular aggregation functions and Pandas UDF aggregation functions
[
https://issues.apache.org/jira/browse/SPARK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785920#comment-16785920
]
peay commented on SPARK-24624:
--
Are there plans to support something similar for aggregation functions?
>
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784260#comment-16784260
]
peay commented on SPARK-27019:
--
Yes, I had edited my message above shortly after posting - cannot reproduce
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784172#comment-16784172
]
peay edited comment on SPARK-27019 at 3/5/19 7:28 AM:
--
Great!
-Is that compatible
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784172#comment-16784172
]
peay commented on SPARK-27019:
--
Great! Is that compatible with my second observation above? (I tested
[
https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783711#comment-16783711
]
peay commented on SPARK-27039:
--
Interesting, thanks for checking. Yes, I can definitely live without that
[
https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783352#comment-16783352
]
peay commented on SPARK-27039:
--
Oops, sorry, I've edited the title. I meant _Arrow_, not Avro.
Maybe
[
https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27039:
-
Summary: toPandas with Arrow swallows maxResultSize errors (was: toPandas
with Avro swallows maxResultSize
peay created SPARK-27039:
Summary: toPandas with Avro swallows maxResultSize errors
Key: SPARK-27039
URL: https://issues.apache.org/jira/browse/SPARK-27039
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Attachment: application_1550040445209_4748
> Spark UI's SQL tab shows inconsistent values
>
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781718#comment-16781718
]
peay commented on SPARK-27019:
--
Attached: [^application_1550040445209_4748]
> Spark UI's SQL tab shows
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651
]
peay edited comment on SPARK-27019 at 3/1/19 1:06 PM:
--
Sure does.
I've done one
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651
]
peay commented on SPARK-27019:
--
Sure does.
I've done one more test, using no executors and running the
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Attachment: query-job-1.png
query-1-details.png
query-1-list.png
> Spark UI's
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781604#comment-16781604
]
peay commented on SPARK-27019:
--
OK, I can actually reproduce it pretty easily with pyspark:
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595
]
peay commented on SPARK-27019:
--
I don't really have a minimal example - this uses a bunch of python jobs
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595
]
peay edited comment on SPARK-27019 at 3/1/19 11:40 AM:
---
I don't really have a
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781583#comment-16781583
]
peay commented on SPARK-27019:
--
Also seeing this both for the Spark UI for live jobs, and when accessing
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Description:
Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the Spark
UI, where
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581
]
peay edited comment on SPARK-27019 at 3/1/19 11:10 AM:
---
Seems like the screenshots
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Attachment: screenshot-spark-ui-list.png
screenshot-spark-ui-details.png
> Spark UI's SQL tab
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581
]
peay commented on SPARK-27019:
--
Seems like the screenshot did not embed, attaching them instead.
> Spark
peay created SPARK-27019:
Summary: Spark UI's SQL tab shows inconsistent values
Key: SPARK-27019
URL: https://issues.apache.org/jira/browse/SPARK-27019
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644602#comment-16644602
]
peay commented on SPARK-24523:
--
I've started hitting the exact same error since I upgraded to EMR 5.17.
[
https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-24523:
-
Attachment: thread-dump.log
> InterruptedException when closing SparkContext
>
[
https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173139#comment-16173139
]
peay commented on SPARK-10925:
--
Same issue on Spark 2.1.0. I have been working around this using
peay created SPARK-21659:
Summary: FileStreamSink checks for _spark_metadata even if path
has globs
Key: SPARK-21659
URL: https://issues.apache.org/jira/browse/SPARK-21659
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay closed SPARK-21550.
Resolution: Duplicate
Fix Version/s: 2.2.0
> approxQuantiles throws "next on empty iterator" on empty data
[
https://issues.apache.org/jira/browse/SPARK-21551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103539#comment-16103539
]
peay commented on SPARK-21551:
--
Sure, does 15 seconds sound good?
> pyspark's collect fails when
peay created SPARK-21551:
Summary: pyspark's collect fails when getaddrinfo is too slow
Key: SPARK-21551
URL: https://issues.apache.org/jira/browse/SPARK-21551
Project: Spark
Issue Type: Bug
peay created SPARK-21550:
Summary: approxQuantiles throws "next on empty iterator" on empty
data
Key: SPARK-21550
URL: https://issues.apache.org/jira/browse/SPARK-21550
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672245#comment-15672245
]
peay edited comment on SPARK-18473 at 11/17/16 12:55 AM:
-
Ok, I see, thanks. The
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672245#comment-15672245
]
peay commented on SPARK-18473:
--
Ok, I see, thanks. The fix is in 2.0.3 though, not 2.0.2, correct?
>
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671624#comment-15671624
]
peay commented on SPARK-18473:
--
Ah, great, thanks. I had checked out the CHANGELOG but couldn't find
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-18473:
-
Description:
I have stumbled onto a corner case where an INNER join appears to return
incorrect results. I
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-18473:
-
Description:
I have stumbled onto a corner case where an INNER join appears to return
incorrect results. I
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-18473:
-
Description:
I have stumbled onto a corner case where an INNER join appears to return
incorrect results. I
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-18473:
-
Description:
I have stumbled onto a corner case where an INNER join appears to return
incorrect results. I
[
https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-18473:
-
Description:
I have stumbled onto a corner case where an INNER join appears to return
incorrect results. I
peay created SPARK-18473:
Summary: Correctness issue in INNER join result with window
functions
Key: SPARK-18473
URL: https://issues.apache.org/jira/browse/SPARK-18473
Project: Spark
Issue Type:
42 matches
Mail list logo
