[jira] [Commented] (SPARK-45792) SPIP: ShuffleManager short name registration via SparkPlugin

2023-11-04 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782931#comment-17782931 ] Alessandro Bellina commented on SPARK-45792: Added a link to an issue that needs to be

[jira] [Created] (SPARK-45792) SPIP: ShuffleManager short name registration via SparkPlugin

2023-11-04 Thread Alessandro Bellina (Jira)
Alessandro Bellina created SPARK-45792: -- Summary: SPIP: ShuffleManager short name registration via SparkPlugin Key: SPARK-45792 URL: https://issues.apache.org/jira/browse/SPARK-45792 Project:

[jira] [Created] (SPARK-45762) Shuffle managers defined in user jars are not available for some launch modes

2023-11-01 Thread Alessandro Bellina (Jira)
Alessandro Bellina created SPARK-45762: -- Summary: Shuffle managers defined in user jars are not available for some launch modes Key: SPARK-45762 URL: https://issues.apache.org/jira/browse/SPARK-45762

[jira] [Commented] (SPARK-39131) "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred

2022-05-10 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534362#comment-17534362 ] Alessandro Bellina commented on SPARK-39131: I'll take a crack at a patch today that can be

[jira] [Updated] (SPARK-39131) "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred

2022-05-09 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-39131: --- Description: We would like to propose a slight change in the order of execution of

[jira] [Updated] (SPARK-39131) "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred

2022-05-09 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-39131: --- Description: We would like to propose a slight change in the order of execution of

[jira] [Updated] (SPARK-39131) "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred

2022-05-09 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-39131: --- Component/s: SQL > "Exists" is optimized too late (to LeftSemi) preventing filters

[jira] [Updated] (SPARK-39131) "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred

2022-05-09 Thread Alessandro Bellina (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-39131: --- Description: We would like to propose a slight change in the order of execution of

[jira] [Created] (SPARK-39131) "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred

2022-05-09 Thread Alessandro Bellina (Jira)
Alessandro Bellina created SPARK-39131: -- Summary: "Exists" is optimized too late (to LeftSemi) preventing filters to be inferred Key: SPARK-39131 URL: https://issues.apache.org/jira/browse/SPARK-39131

[jira] [Created] (SPARK-29780) The UI can access into the ResourceAllocator, whose data structures are being updated from scheduler threads

2019-11-06 Thread Alessandro Bellina (Jira)
Alessandro Bellina created SPARK-29780: -- Summary: The UI can access into the ResourceAllocator, whose data structures are being updated from scheduler threads Key: SPARK-29780 URL:

[jira] [Commented] (SPARK-28679) Spark Yarn ResourceRequestHelper shouldn't lookup setResourceInformation is no resources specified

2019-08-09 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904004#comment-16904004 ] Alessandro Bellina commented on SPARK-28679: Working on it. > Spark Yarn

[jira] [Updated] (SPARK-27558) NPE in TaskCompletionListener due to Spark OOM in UnsafeExternalSorter causing tasks to hang

2019-04-24 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-27558: --- Description: We see an NPE in the UnsafeInMemorySorter.getMemoryUsage function (due

[jira] [Created] (SPARK-27558) NPE in TaskCompletionListener due to Spark OOM in UnsafeExternalSorter causing tasks to hang

2019-04-24 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-27558: -- Summary: NPE in TaskCompletionListener due to Spark OOM in UnsafeExternalSorter causing tasks to hang Key: SPARK-27558 URL:

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-03-05 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784853#comment-16784853 ] Alessandro Bellina commented on SPARK-26944: [~shaneknapp] nice!! thank you > Python

[jira] [Commented] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-23 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775908#comment-16775908 ] Alessandro Bellina commented on SPARK-26809: If you provide an alias for the concatenated

[jira] [Comment Edited] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina edited comment on SPARK-26809 at 2/23/19 3:25 AM: -

[jira] [Comment Edited] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina edited comment on SPARK-26809 at 2/23/19 3:25 AM: -

[jira] [Comment Edited] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina edited comment on SPARK-26809 at 2/23/19 3:25 AM: -

[jira] [Commented] (SPARK-26809) insert overwrite directory + concat function => error

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775772#comment-16775772 ] Alessandro Bellina commented on SPARK-26809: This does it. Didn't need the limit to

[jira] [Commented] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775125#comment-16775125 ] Alessandro Bellina commented on SPARK-26945: [~hyukjin.kwon] thanks for taking a look. Seems

[jira] [Comment Edited] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775117#comment-16775117 ] Alessandro Bellina edited comment on SPARK-26944 at 2/22/19 1:07 PM: -

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-22 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775117#comment-16775117 ] Alessandro Bellina commented on SPARK-26944: Hmm, I have a subsequent build from the same

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-21 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774800#comment-16774800 ] Alessandro Bellina commented on SPARK-26944: [~shivuson...@gmail.com] [~hyukjin.kwon] I

[jira] [Updated] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-21 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-26944: --- Description: I had a pr where the python unit tests failed.  The tests point at the

[jira] [Created] (SPARK-26945) Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop

2019-02-20 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-26945: -- Summary: Python streaming tests flaky while cleaning temp directories after StreamingQuery.stop Key: SPARK-26945 URL:

[jira] [Created] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

2019-02-20 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-26944: -- Summary: Python unit-tests.log not available in artifacts for a build in Jenkins Key: SPARK-26944 URL: https://issues.apache.org/jira/browse/SPARK-26944

[jira] [Updated] (SPARK-26895) When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails to resolve globs owned by target user

2019-02-15 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-26895: --- Summary: When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails

[jira] [Updated] (SPARK-26895) When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails to resolve globs owned by target uer

2019-02-15 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-26895: --- Summary: When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails

[jira] [Updated] (SPARK-26895) When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails to resolve globs

2019-02-15 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessandro Bellina updated SPARK-26895: --- Summary: When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit fails

[jira] [Commented] (SPARK-26895) When running spark 2.3 as a proxy user --proxy-user, SparkSubmit fails to resolve globs

2019-02-15 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769666#comment-16769666 ] Alessandro Bellina commented on SPARK-26895: I am working on this. > When running spark 2.3

[jira] [Created] (SPARK-26895) When running spark 2.3 as a proxy user --proxy-user, SparkSubmit fails to resolve globs

2019-02-15 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-26895: -- Summary: When running spark 2.3 as a proxy user --proxy-user, SparkSubmit fails to resolve globs Key: SPARK-26895 URL:

[jira] [Commented] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2019-01-14 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742519#comment-16742519 ] Alessandro Bellina commented on SPARK-26257: [~tcondie] I think you should share the design

[jira] [Commented] (SPARK-26285) Add a metric source for accumulators (aka AccumulatorSource)

2018-12-05 Thread Alessandro Bellina (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710970#comment-16710970 ] Alessandro Bellina commented on SPARK-26285: I can't assign this issue, but I am putting up

[jira] [Created] (SPARK-26285) Add a metric source for accumulators (aka AccumulatorSource)

2018-12-05 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-26285: -- Summary: Add a metric source for accumulators (aka AccumulatorSource) Key: SPARK-26285 URL: https://issues.apache.org/jira/browse/SPARK-26285 Project:

[jira] [Created] (SPARK-25043) spark-sql should print the appId and master on startup

2018-08-07 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-25043: -- Summary: spark-sql should print the appId and master on startup Key: SPARK-25043 URL: https://issues.apache.org/jira/browse/SPARK-25043 Project: Spark