[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784260#comment-16784260
]
peay commented on SPARK-27019:
--
Yes, I had edited my message above shortly after posting - cannot reproduce
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784194#comment-16784194
]
Shahid K I commented on SPARK-27019:
Please show me the screenshot of the sql page of the second
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784179#comment-16784179
]
Shahid K I commented on SPARK-27019:
Thanks [~peay] could you please share the event log for that
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784172#comment-16784172
]
peay commented on SPARK-27019:
--
Great! Is that compatible with my second observation above? (I tested
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826
]
shahid commented on SPARK-27019:
Yes. The issue happened because of the event reordering when the query
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781718#comment-16781718
]
peay commented on SPARK-27019:
--
Attached: [^application_1550040445209_4748]
> Spark UI's SQL tab shows
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670
]
shahid commented on SPARK-27019:
seems event reordering has happened. Job start event came after sql
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651
]
peay commented on SPARK-27019:
--
Sure does.
I've done one more test, using no executors and running the
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781638#comment-16781638
]
Jungtaek Lim commented on SPARK-27019:
--
Submitted date feels me as "-1", as UNIX epoch 0 represents
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781606#comment-16781606
]
shahid commented on SPARK-27019:
Seems event reordering has happened. ie. JobStart event came after
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781604#comment-16781604
]
peay commented on SPARK-27019:
--
OK, I can actually reproduce it pretty easily with pyspark:
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595
]
peay commented on SPARK-27019:
--
I don't really have a minimal example - this uses a bunch of python jobs
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781588#comment-16781588
]
shahid commented on SPARK-27019:
Hi [~peay] Could you please add test to reproduce it?
> Spark UI's SQL
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781583#comment-16781583
]
peay commented on SPARK-27019:
--
Also seeing this both for the Spark UI for live jobs, and when accessing
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581
]
peay commented on SPARK-27019:
--
Seems like the screenshot did not embed, attaching them instead.
> Spark
15 matches
Mail list logo
