[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521852#comment-17521852 ] Danny Guinther commented on SPARK-38792: I'm getting the impression that the problem may be with

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: what-is-this-code.jpg > Regression in time executor takes to do work sometime

[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521342#comment-17521342 ] Danny Guinther commented on SPARK-38792: Where does

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: executor-timing-debug-number-4.jpg > Regression in time executor takes to do

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: executor-timing-debug-number-2.jpg > Regression in time executor takes to do

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: executor-timing-debug-number-5.jpg > Regression in time executor takes to do

[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518998#comment-17518998 ] Danny Guinther commented on SPARK-38792: I added yet another kind of dummy job that aims to

[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518460#comment-17518460 ] Danny Guinther commented on SPARK-38792: I added another kind of dummy job that doesn't farm

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work sometime after v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Summary: Regression in time executor takes to do work sometime after v3.0.1 ? (was:

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: dummy-job-query.png > Regression in time executor takes to do work since v3.0.1

[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518323#comment-17518323 ] Danny Guinther commented on SPARK-38792: Things move through the Spark UI for my application too

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: dummy-job-job.jpg > Regression in time executor takes to do work since v3.0.1 ?

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: min-time-way-up.jpg > Regression in time executor takes to do work since v3.0.1

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: (was: min-time-way-up.jpg) > Regression in time executor takes to do work

[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518273#comment-17518273 ] Danny Guinther commented on SPARK-38792: To further try to understand what is going on here, I

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: min-time-way-up.jpg > Regression in time executor takes to do work since v3.0.1

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Description: Hello! I'm sorry to trouble you with this, but I'm seeing a noticeable

[jira] [Comment Edited] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517704#comment-17517704 ] Danny Guinther edited comment on SPARK-38792 at 4/5/22 9:09 PM: I don't

[jira] [Commented] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517704#comment-17517704 ] Danny Guinther commented on SPARK-38792: I don't know if it is helpful, but the runtime

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Description: Hello! I'm sorry to trouble you with this, but I'm seeing a noticeable

[jira] [Updated] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

[ https://issues.apache.org/jira/browse/SPARK-38792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-38792: --- Attachment: what-s-up-with-exec-actions.jpg > Regression in time executor takes to do work

[jira] [Created] (SPARK-38792) Regression in time executor takes to do work since v3.0.1 ?

Danny Guinther created SPARK-38792: -- Summary: Regression in time executor takes to do work since v3.0.1 ? Key: SPARK-38792 URL: https://issues.apache.org/jira/browse/SPARK-38792 Project: Spark

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464042#comment-17464042 ] Danny Guinther commented on SPARK-37391: I've created three PRs to facilitate backporting this

[jira] [Commented] (SPARK-37715) Docker integration tests: Tweak docs and remove unneeded dependency

[ https://issues.apache.org/jira/browse/SPARK-37715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463879#comment-17463879 ] Danny Guinther commented on SPARK-37715: PR here: https://github.com/apache/spark/pull/34979 >

[jira] [Created] (SPARK-37715) Docker integration tests: Tweak docs and remove unneeded dependency

Danny Guinther created SPARK-37715: -- Summary: Docker integration tests: Tweak docs and remove unneeded dependency Key: SPARK-37715 URL: https://issues.apache.org/jira/browse/SPARK-37715 Project:

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447529#comment-17447529 ] Danny Guinther commented on SPARK-37391: Here's an example stacktrace for one of the blocked

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447512#comment-17447512 ] Danny Guinther commented on SPARK-37391: [~hyukjin.kwon] , sorry, I seem to have gotten confused

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Attachment: so-much-blocking.jpg > SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Attachment: spark-regression-dashes.jpg > SIGNIFICANT bottleneck introduced by fix for

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Summary: SIGNIFICANT bottleneck introduced by fix for SPARK-32001 (was: SIGNIFICANT

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Description: The fix for https://issues.apache.org/jira/browse/SPARK-32001 (

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Description: The fix for SPARK-34497 (

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Description: The fix for SPARK-34497 ( [https://github.com/apache/spark/pull/31622] ) does

[jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Guinther updated SPARK-37391: --- Description: The fix for SPARK-34497 ([https://github.com/apache/spark/pull/31622)] does

[jira] [Created] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497

Danny Guinther created SPARK-37391: -- Summary: SIGNIFICANT bottleneck introduced by fix for SPARK-34497 Key: SPARK-37391 URL: https://issues.apache.org/jira/browse/SPARK-37391 Project: Spark

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826378#comment-16826378 ] Danny Guinther commented on SPARK-19335: Any update on this? Also, please forgive this dumb