Re: [Internet]Re: Improving Dynamic Allocation Logic for Spark 4+

2023-08-08 Thread Holden Karau
ical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Tue, 8 Aug 2023 at 15:49, kalyan wrote: > >> +1 to enhancements in DEA. Long time due! >> >> There

Re: ASF board report draft for August 2023

2023-08-08 Thread Holden Karau
Maybe add a link to the 4.0 JIRA where we are tracking the current plans for 4.0? On Tue, Aug 8, 2023 at 9:33 AM Dongjoon Hyun wrote: > Thank you, Matei. > > It looks good to me. > > Dongjoon > > On Mon, Aug 7, 2023 at 22:54 Matei Zaharia > wrote: > >> It’s time to send our quarterly report to

Re: Dynamic allocation does not deallocate executors

2023-08-08 Thread Holden Karau
ny > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage

Re: Dynamic resource allocation for structured streaming [SPARK-24815]

2023-08-07 Thread Holden Karau
Oooh fascinating. I’m going on call this week so it will take me awhile but I do want to review this :) On Mon, Aug 7, 2023 at 5:30 PM Pavan Kotikalapudi wrote: > Hi Spark Dev, > > I have extended traditional DRA to work for structured streaming > use-case. > > Here is an initial Implementation

Re: Improving Dynamic Allocation Logic for Spark 4+

2023-08-07 Thread Holden Karau
Oh great point On Mon, Aug 7, 2023 at 2:23 PM bo yang wrote: > Thanks Holden for bringing this up! > > Maybe another thing to think about is how to make dynamic allocation more > friendly with Kubernetes and disaggregated shuffle storage? > > > > On Mon, Aug 7, 2023

[jira] [Commented] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

2023-08-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751796#comment-17751796 ] Holden Karau commented on SPARK-44050: -- Ah interesting, it sounds like the fix would be to retry

[jira] [Commented] (SPARK-44508) Add user guide for Python UDTFs

2023-08-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751795#comment-17751795 ] Holden Karau commented on SPARK-44508: -- I'm not sure this should be a blocker. > Add user gu

Improving Dynamic Allocation Logic for Spark 4+

2023-08-07 Thread Holden Karau
So I wondering if there is interesting in revisiting some of how Spark is doing it's dynamica allocation for Spark 4+? Some things that I've been thinking about: - Advisory user input (e.g. a way to say after X is done I know I need Y where Y might be a bunch of GPU machines) - Configurable

Re: Dynamic allocation does not deallocate executors

2023-08-07 Thread Holden Karau
I think you need to set "spark.dynamicAllocation.shuffleTracking.enabled=true" to false. On Mon, Aug 7, 2023 at 2:50 AM Mich Talebzadeh wrote: > Yes I have seen cases where the driver gone but a couple of executors > hanging on. Sounds like a code issue. > > HTH > > Mich Talebzadeh, > Solutions

[jira] [Commented] (SPARK-24282) Add support for PMML export for the Standard Scaler Stage

2023-08-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751758#comment-17751758 ] Holden Karau commented on SPARK-24282: -- I don't think were going to do this anymore. > Add supp

[jira] [Resolved] (SPARK-28740) Add support for building with bloop

2023-08-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-28740. -- Resolution: Won't Fix > Add support for building with bl

[jira] [Commented] (SPARK-32111) Cleanup locks and docs in CoarseGrainedSchedulerBackend

2023-08-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751754#comment-17751754 ] Holden Karau commented on SPARK-32111: -- I think this could be a good target for Spark 4.0

[jira] [Updated] (SPARK-32111) Cleanup locks and docs in CoarseGrainedSchedulerBackend

2023-08-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-32111: - Target Version/s: 4.0.0 Affects Version/s: 4.0.0 > Cleanup locks and d

[Python-Dev] Re: Some pattern annoyance

2023-08-02 Thread Steve Holden
Hi Chris, Nice to see you on the list. While this is definitely off-topic, I trust I might be given license by the list's few remaining readers to point out that the match-case construct is for _structural_ pattern matching. As I wrote in the latest Nutshell: "Resist the temptation to use match

[jira] [Updated] (SPARK-44578) Support pushing down BoundFunction in DSv2

2023-07-31 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-44578: - Description: See [https://github.com/apache/iceberg/pull/7886#discussion_r1257537662

[jira] [Created] (SPARK-44592) Add history link to previous run on SS HA

2023-07-28 Thread Holden Karau (Jira)
Holden Karau created SPARK-44592: Summary: Add history link to previous run on SS HA Key: SPARK-44592 URL: https://issues.apache.org/jira/browse/SPARK-44592 Project: Spark Issue Type

[jira] [Created] (SPARK-44578) Support pushing down UDFs in DSv2

2023-07-27 Thread Holden Karau (Jira)
Holden Karau created SPARK-44578: Summary: Support pushing down UDFs in DSv2 Key: SPARK-44578 URL: https://issues.apache.org/jira/browse/SPARK-44578 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-37562) Add Spark History Server Links for Kubernetes & other CMs

2023-07-26 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747676#comment-17747676 ] Holden Karau commented on SPARK-37562: -- So (in theory) the cluster administrator has some base

[jira] [Created] (SPARK-44529) Add a flag to resolve docker tags to hashes at launch time

2023-07-24 Thread Holden Karau (Jira)
Holden Karau created SPARK-44529: Summary: Add a flag to resolve docker tags to hashes at launch time Key: SPARK-44529 URL: https://issues.apache.org/jira/browse/SPARK-44529 Project: Spark

[jira] [Created] (SPARK-44511) Allow insertInto to succeed with partion columns specified when they match those on the target table

2023-07-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-44511: Summary: Allow insertInto to succeed with partion columns specified when they match those on the target table Key: SPARK-44511 URL: https://issues.apache.org/jira/browse/SPARK

[kwin] [Bug 472445] New: Persistent blackscreen on X11 and Wayland after changing screen resolution

2023-07-20 Thread Holden
T EXPECTED RESULT SOFTWARE/OS VERSIONS Linux/KDE Plasma: Opensuse tumbleweed, kernel 6.4.3.1-default (64 bit) KDE Plasma Version: 5.27.6 KDE Frameworks Version: 5.108.0 Qt Version: 5.15.10 ADDITIONAL INFORMATION holden@tumble-dell:~$ sudo coredumpctl gdb 3309 PID: 3309 (kwin_wayland

[LincolnTalk] Solar Panel Inverters

2023-07-19 Thread sarah cannon holden
Does anyone have a suggestion for someone who can install 2 replacement inverters for our solar panels? Two have failed. Thank you. Sarah -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at https://pairlist9.pair.net/mailman/private/lincoln/.

Re: [VOTE][SPIP] Python Data Source API

2023-07-07 Thread Holden Karau
+1 On Fri, Jul 7, 2023 at 9:55 AM huaxin gao wrote: > +1 > > On Fri, Jul 7, 2023 at 8:59 AM Mich Talebzadeh > wrote: > >> +1 for me >> >> Mich Talebzadeh, >> Solutions Architect/Engineering Lead >> Palantir Technologies Limited >> London >> United Kingdom >> >> >>view my Linkedin profile

[LincolnTalk] Stucco Repair

2023-07-05 Thread Sarah Cannon Holden
I know names have been here before but in this heat the archives are beyond me!! Any suggestions for Stucco repair on old house? Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at https://pairlist9.pair.net/mailman/private

[LincolnTalk] Appliance Repair

2023-07-05 Thread Sarah Cannon Holden
Any suggestions for Frigidaire refrigerator repair? Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at https://pairlist9.pair.net/mailman/private/lincoln/. Change your subscription settings at https://pairlist9.pair.net

[LincolnTalk] Babysitting and Tutoring

2023-06-21 Thread sarah cannon holden
My granddaughter asked me to post this letter to LincolnTalk. Sarah Hello, My name is Cannon Martin, and I will be a junior in high school next year. I am spending most of the summer in Lincoln with my grandparents as I rehab an ACL injury, and *I am looking

Re: [VOTE][SPIP] PySpark Test Framework

2023-06-21 Thread Holden Karau
? On Wed, Jun 21, 2023 at 8:30 AM Reynold Xin wrote: > +1 > > This is a great idea. > > > On Wed, Jun 21, 2023 at 8:29 AM, Holden Karau > wrote: > >> I’d like to start with a +1, better Python testing tools integrated into >> the project make sense. >> >

Re: [VOTE][SPIP] PySpark Test Framework

2023-06-21 Thread Holden Karau
I’d like to start with a +1, better Python testing tools integrated into the project make sense. On Wed, Jun 21, 2023 at 8:11 AM Amanda Liu wrote: > Hi all, > > I'd like to start the vote for SPIP: PySpark Test Framework. > > The high-level summary for the SPIP is that it proposes an official

Re: [VOTE][RESULT] Release Plan for Apache Spark 4.0.0 (June 2024)

2023-06-20 Thread Holden Karau
hread/xhkgj60j361gdpywoxxz7qspp2w80ry6 >> >> Could you reply there to collect your timeline suggestions? We can >> discuss more there. >> >> Dongjoon. >> >> >> >> On Mon, Jun 19, 2023 at 1:58 PM Herman van Hovell >> wrote: >> &

Re: Gauging interest in: ScalaFix + Scala Steward for Spark 4.0

2023-06-12 Thread Holden Karau
Yup I think buidling consensus on what goes in 4.X is something we’ll need to do. On Mon, Jun 12, 2023 at 11:56 AM Dongjoon Hyun wrote: > Thank you for sharing those. I'm also interested in taking advantage of > it. Also, I hope `spark-upgrade` can help us in line with Spark 4.0. > > However,

Gauging interest in: ScalaFix + Scala Steward for Spark 4.0

2023-06-12 Thread Holden Karau
My self and a few folks have been working on a spark-upgrade project (focused on getting folks onto current versions of Spark). Since it looks like were starting the discussion around Spark 4 I was thinking now could be a good time for us to consider if we want to try and integrate auto-upgrade

Re: [VOTE] Release Plan for Apache Spark 4.0.0 (June 2024)

2023-06-12 Thread Holden Karau
-0 I'd like to see more of a doc around what we're planning on for a 4.0 before we pick a target release date etc. (feels like cart before the horse). But it's a weak preference. On Mon, Jun 12, 2023 at 11:24 AM Xiao Li wrote: > Thanks for starting the vote. > > I do have a concern about the

Re: JDK version support policy?

2023-06-07 Thread Holden Karau
So JDK 11 is still supported in open JDK until 2026, I'm not sure if we're going to see enough folks moving to JRE17 by the Spark 4 release unless we have a strong benefit from dropping 11 support I'd be inclined to keep it. On Tue, Jun 6, 2023 at 9:08 PM Dongjoon Hyun wrote: > I'm also +1 on

Re: ASF policy violation and Scala version issues

2023-06-06 Thread Holden Karau
So I think if the Spark PMC wants to ask Databricks something that could be reasonable (although I'm a little fuzzy as to the ask), but that conversation might belong on private@ (I could be wrong of course). On Tue, Jun 6, 2023 at 3:29 AM Mich Talebzadeh wrote: > I concur with you Sean. > > If

[cobirds] Boulder County Bird Survey Volunteer

2023-05-24 Thread Holden Maxfield
Hi all, this is Holden Maxfield, I typically cover the Bluebell Canyon route every summer for the Boulder County Ecosystem Stewardship Initiative, but I will be unable to this summer and was wondering if anyone would be interested in picking up this area. I usually visit anywhere from 4-10

[LincolnTalk] Magazines

2023-05-15 Thread Sarah Cannon Holden
Before I toss old New Yorker and Living magazines, does anyone want them? Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at https://pairlist9.pair.net/mailman/private/lincoln/. Change your subscription settings at https

[LincolnTalk] Eurail Global Pass

2023-05-12 Thread sarah cannon holden
Does anyone out there have experience making reservations using a Eurail Pass? I am completely perplexed but I am probably just missing some little trick. If you can give any help I would be most grateful. Sarah -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org.

Re: [BVARC] Yaesu FTM-200DR, FTM-300DR or FTM-500DR?

2023-05-07 Thread David Holden via BVARC
I have the FTM-300D and used a Lido mount that works well. The mount attaches to floor using the seat bolt and gives you a flexible conduit up to where you attach the faceplate. See pics on Lido mount’s website. I have the radio base under the seat and hear it adequately but I think a remote

[LincolnTalk] Tent

2023-04-30 Thread Sarah Cannon Holden
Someone advertised a mosquito netted tent here. Is it still available? Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at https://pairlist9.pair.net/mailman/private/lincoln/. Change your subscription settings at https

Re: Is there any way to set the parallelism of operators like group by, join?

2023-04-16 Thread Holden Karau
To a (small) degree Sparks “new” AQE might be able to help depending on what kind of operations Beam is compiling it down to. Have you tried setting spark.sql.adaptive.enabled & spark.sql.adaptive.coalescePartitions.enabled On Mon, Apr 17, 2023 at 10:34 AM Reuven Lax via user wrote: > I see.

[LincolnTalk] URAIL PASS - EUROPE

2023-04-14 Thread sarah cannon holden
Could anyone who has used a urail pass in Europe give me an assessment of its worth if one rides a train ten times in a two week period? Any suggestions or insights are appreciated. Thank you. Sarah -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the

Re: Slack for Spark Community: Merging various threads

2023-04-07 Thread Holden Karau
I think there was some concern around how to make any sync channel show up in logs / index / search results? On Fri, Apr 7, 2023 at 9:41 AM Dongjoon Hyun wrote: > Thank you, All. > > I'm very satisfied with the focused and right questions for the real > issues by removing irrelevant claims. :)

Re: [python-uk] PyCon US - anyone going?

2023-04-05 Thread Steve Holden
//anvil.works > > Tel: +1 650-468-0667 > > > *Proud Sponsors of PyCon 2023 <https://us.pycon.org>* > > > > On Tue, Apr 4, 2023 at 7:58 PM Steve Holden wrote: > >> Hi all, >> >> Is anyone going to PyCon in Salt Lake City this year? >> >

[python-uk] PyCon US - anyone going?

2023-04-04 Thread Steve Holden
Hi all, Is anyone going to PyCon in Salt Lake City this year? I'm donating a swag bag (empty) from the very first PyCon as a PyLadies auction lot, but the carriage prices are shocking to get it there in time, so I was wondering if some kind soul might be able to carry it over there for me. Kind

Re: Apache Spark 3.2.4 EOL Release?

2023-04-04 Thread Holden Karau
+1 On Tue, Apr 4, 2023 at 11:04 AM L. C. Hsieh wrote: > +1 > > Sounds good and thanks Dongjoon for driving this. > > On 2023/04/04 17:24:54 Dongjoon Hyun wrote: > > Hi, All. > > > > Since Apache Spark 3.2.0 passed RC7 vote on October 12, 2021, branch-3.2 > > has been maintained and served well

Re: [LincolnTalk] Town meeting - thank yous

2023-03-27 Thread sarah cannon holden
sure you will become very involved in the life of Lincoln once you move in. With best wishes, Sarah Cannon Holden On Mon, Mar 27, 2023 at 10:47 AM Scott L. Rodman wrote: > As someone planning a move this year to Lincoln, it was a great pleasure > to attend Saturday’s Annual Town M

[LincolnTalk] Annual Town Meeting 2023

2023-03-24 Thread Sarah Cannon Holden
residents. Sarah Cannon Holden Town Meeting Moderator -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at https://pairlist9.pair.net/mailman/private/lincoln/. Change your subscription settings at https://pairlist9.pair.net/mailman/listinfo/lincoln.

Re: Ammonite as REPL for Spark Connect

2023-03-22 Thread Holden Karau
I am +1 to the general concept of including Ammonite magic 彩. On Wed, Mar 22, 2023 at 4:58 PM Herman van Hovell wrote: > Ammonite is maintained externally by Li Haoyi et al. We are including it > as a 'provided' dependency. The integration bits and pieces (1 file) are > included in Apache

Re: [BVARC] extra exam.

2023-03-20 Thread David Holden via BVARC
Marc, Very funny! Nice write-up. Also, don’t take this the wrong way but you are not good at taking tests.  - David WJ9O > On Mar 20, 2023, at 3:21 PM, M Reiter via BVARC wrote: > >  > so maybe this is for the VEC, maybe I am just venting, It took me 22 tries > to pass the Extra Exam,

[Boatanchors] Winter 2023 Classic Exchange phone

2023-03-13 Thread howard holden
The phone Classic Exchange for Winter 2023 will be Sunday Mar 19 1400Z to Mar 20 and 0800Z Tuesday Mar 21 1400Z to Mar 22 0800Z. The CX is a no-pressure contest celebrating the older commercial and Home Brew equipment that was the pride and joy of ham shacks many decades ago. The object is to

[jira] [Created] (SPARK-42762) Improve Logging for disconnects during exec id request

2023-03-11 Thread Holden Karau (Jira)
Holden Karau created SPARK-42762: Summary: Improve Logging for disconnects during exec id request Key: SPARK-42762 URL: https://issues.apache.org/jira/browse/SPARK-42762 Project: Spark Issue

[LincolnTalk] Two questions.

2023-03-07 Thread sarah cannon holden
A couple of questions - totally unrelated! 1. Would it be a good/bad idea to install an induction cooktop in a summer rental cottage? We have to replace what is there, Any suggestions are welcome. 2. Does anyone have recommendations for good coastline hikes in England? Either staying in one

[Boatanchors] Classic Exchange CW Winter 2023

2023-02-25 Thread howard holden
The CW Classic Exchange is Sunday Mar 5 1400Z to Mar 6 0800Z and Tuesday Mar 7 1400Z to March 8 0800Z The CX is a no-pressure contest celebrating the older commercial and Home Brew equipment that was the pride and joy of ham shacks many decades ago. The object is to encourage restoration,

[LincolnTalk] Electric Cooktops

2023-02-23 Thread sarah cannon holden
I would welcome recommendations for a 36" electric cooktop...with and without a downdraft vent. This is for a rental cottage in Maine so needs to be easy to clean and sturdy! Thank you, Sarah -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Browse the archives at

Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-18 Thread Holden Karau
Is there someone focused on streaming work these days who would want to shepherd this? On Sat, Feb 18, 2023 at 5:02 PM Dongjoon Hyun wrote: > Thank you for considering me, but may I ask what makes you think to put me > there, Mich? I'm curious about your reason. > > > I have put dongjoon.hyun

Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-18 Thread Holden Karau
Is there someone focused on streaming work these days who would want to shepherd this? On Sat, Feb 18, 2023 at 5:02 PM Dongjoon Hyun wrote: > Thank you for considering me, but may I ask what makes you think to put me > there, Mich? I'm curious about your reason. > > > I have put dongjoon.hyun

[Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-18 Thread Lowell R Holden
%MEM VSZ RSS 11.8 6102932 1934020 Cleaned the result up manually a bit to only be the memory parts. This show that the leak is still there. -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to gnome-shell-extension-desktop-icons in

[Desktop-packages] [Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-18 Thread Lowell R Holden
%MEM VSZ RSS 11.8 6102932 1934020 Cleaned the result up manually a bit to only be the memory parts. This show that the leak is still there. -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to gnome-shell-extension-desktop-icons in Ubuntu.

[Desktop-packages] [Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-16 Thread Lowell R Holden
It did not seem to do anything to relieve the issue. Attached is about an hour and 10 minutes in that state after a reboot. ** Attachment added: "gslog_notrash.txt"

[Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-16 Thread Lowell R Holden
It did not seem to do anything to relieve the issue. Attached is about an hour and 10 minutes in that state after a reboot. ** Attachment added: "gslog_notrash.txt"

Re: [VOTE] Release Spark 3.3.2 (RC1)

2023-02-13 Thread Holden Karau
That’s legit, if the patch author isn’t comfortable with a backport then let’s leave it be  On Mon, Feb 13, 2023 at 9:59 AM Dongjoon Hyun wrote: > Hi, All. > > As the author of that `Improvement` patch, I strongly disagree with giving > the wrong idea which Python 3.11 is officially supported

Re: [VOTE] Release Spark 3.3.2 (RC1)

2023-02-13 Thread Holden Karau
I’d be in favor of a back porting with the idea its a bug fix for a language (admittedly not a version we’ve supported before) On Mon, Feb 13, 2023 at 9:19 AM L. C. Hsieh wrote: > If it is not supported in Spark 3.3.x, it looks like an improvement at > Spark 3.4. > For such cases we usually do

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-13 Thread Holden Karau
technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Fri, 10 Feb 2023 at 18:58, Holden Karau wrote: > >> Ok so the first iteration of this is booked

[jira] [Commented] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes

2023-02-12 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687664#comment-17687664 ] Holden Karau commented on SPARK-42411: -- The other option is something around

__builtin_(add|mul)_overflow methods generate duplicate operations if both operands are const

2023-02-12 Thread David Shane Holden via Gcc
I requested a bugzilla account a few days ago and haven't heard back so I'm just going to report this here. #include #include #include bool add(uint8_t *r, const uint8_t *a, const uint8_t *b) { return __builtin_add_overflow(*a, *b, r); } bool mul(uint8_t *r, const uint8_t *a, const

[Desktop-packages] [Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-10 Thread Lowell R Holden
Disabling that extension seems to have fixed the leak. From the start I had appindicator also disabled, would you like me to enable it to see if this set up causes appindicator to spam the log every few seconds as well? I'll attach the log from gnome-shell to show the difference. ** Attachment

[Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-10 Thread Lowell R Holden
Disabling that extension seems to have fixed the leak. From the start I had appindicator also disabled, would you like me to enable it to see if this set up causes appindicator to spam the log every few seconds as well? I'll attach the log from gnome-shell to show the difference. ** Attachment

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-10 Thread Holden Karau
:) On Wed, Feb 8, 2023 at 12:27 PM Mich Talebzadeh wrote: > That sounds like a good plan Holden! > > > Let us go for it > > >view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mi

[Desktop-packages] [Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-09 Thread Lowell R Holden
The extensions directory does not exist, so I have no unsupported extensions. Here is the requested log file. ** Attachment added: "gslog.txt" https://bugs.launchpad.net/ubuntu/+source/gnome-shell-extension-desktop-icons/+bug/2006675/+attachment/5646014/+files/gslog.txt -- You received this

[Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-09 Thread Lowell R Holden
The extensions directory does not exist, so I have no unsupported extensions. Here is the requested log file. ** Attachment added: "gslog.txt" https://bugs.launchpad.net/ubuntu/+source/gnome-shell-extension-desktop-icons/+bug/2006675/+attachment/5646014/+files/gslog.txt -- You received this

[Desktop-packages] [Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-09 Thread Lowell R Holden
I believe the memory leak still exists. It is now 1.3 GB in size. I was reporting the size given by system monitor in the processes tab, which appears to be physical memory. I don't know the best way of getting all the data, so here is the relevant data about memory size from what I got using ps

[Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-09 Thread Lowell R Holden
I believe the memory leak still exists. It is now 1.3 GB in size. I was reporting the size given by system monitor in the processes tab, which appears to be physical memory. I don't know the best way of getting all the data, so here is the relevant data about memory size from what I got using ps

[Desktop-packages] [Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-08 Thread Lowell R Holden
I let it run for a bit, but it appears it isn't just the desktop icons. I will sleep with my set up in the state where the leak happens to fully confirm since it only has gone from 120 to 240 MB. Let me know how I can collect and post data after letting it leak for a while and I will do so when I

[Bug 2006675] Re: Memory leak when hdmi switcher is not sending data/not outputting

2023-02-08 Thread Lowell R Holden
I let it run for a bit, but it appears it isn't just the desktop icons. I will sleep with my set up in the state where the leak happens to fully confirm since it only has gone from 120 to 240 MB. Let me know how I can collect and post data after letting it leak for a while and I will do so when I

[Bug 2006675] [NEW] Memory leak when hdmi switcher is not sending data/not outputting

2023-02-08 Thread Lowell R Holden
Public bug reported: Main problem: Gnome-shell has a memory leak when my hdmi switcher is on a channel that is currently not inputting hdmi (i.e. desktop on hdmi 2 but hdmi 3 is selected with nothing inserted). This memory leak does not happen if signal is being sent through the hdmi switcher

[Desktop-packages] [Bug 2006675] [NEW] Memory leak when hdmi switcher is not sending data/not outputting

2023-02-08 Thread Lowell R Holden
Public bug reported: Main problem: Gnome-shell has a memory leak when my hdmi switcher is on a channel that is currently not inputting hdmi (i.e. desktop on hdmi 2 but hdmi 3 is selected with nothing inserted). This memory leak does not happen if signal is being sent through the hdmi switcher

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Holden Karau
t;>>>>>> Greetings everyone! >>>>>>>>> I am super new to this group and currently leading some work to >>>>>>>>> deploy spark on k8 for my company o9 Solutions. >>>>>>>>> I would love to join the discus

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Holden Karau
doodle for the following week with more european friendly times. Let me know what folks think :) On Tue, Feb 7, 2023 at 3:23 PM Holden Karau wrote: > Hi Folks, > > It seems like we could maybe use some additional shared context around > Spark on Kube so I’d like to try and schedule a vi

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Holden Karau
Awesome, I guess I should have asked folks for timezones that they’re in. On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo wrote: > Hello Holden, > > We are interested in Spark on k8s and would like the opportunity to > speak with devs about what we're looking for slash better ways to

Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Holden Karau
with coffee and Spark devs does not sound like your thing, just trying to make something informal so we can have a better understanding of everyone’s goals here. Cheers, Holden :) -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to

[jira] [Created] (SPARK-42361) Add an option to use external storage to distribute JAR set in cluster mode on Kube

2023-02-06 Thread Holden Karau (Jira)
Holden Karau created SPARK-42361: Summary: Add an option to use external storage to distribute JAR set in cluster mode on Kube Key: SPARK-42361 URL: https://issues.apache.org/jira/browse/SPARK-42361

[jira] [Created] (SPARK-42261) K8s will not allocate more execs if there are any pending execs until next snapshot

2023-01-31 Thread Holden Karau (Jira)
Holden Karau created SPARK-42261: Summary: K8s will not allocate more execs if there are any pending execs until next snapshot Key: SPARK-42261 URL: https://issues.apache.org/jira/browse/SPARK-42261

[jira] [Created] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

2023-01-31 Thread Holden Karau (Jira)
Holden Karau created SPARK-42260: Summary: Log when the K8s Exec Pods Allocator Stalls Key: SPARK-42260 URL: https://issues.apache.org/jira/browse/SPARK-42260 Project: Spark Issue Type

[jira] [Created] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Holden Karau (Jira)
Holden Karau created SPARK-42173: Summary: IPv6 address mapping can fail with sparse addresses Key: SPARK-42173 URL: https://issues.apache.org/jira/browse/SPARK-42173 Project: Spark Issue

[jira] [Created] (SPARK-42035) Add a config flag to force exit on JDK major version mismatch

2023-01-12 Thread Holden Karau (Jira)
Holden Karau created SPARK-42035: Summary: Add a config flag to force exit on JDK major version mismatch Key: SPARK-42035 URL: https://issues.apache.org/jira/browse/SPARK-42035 Project: Spark

[LincolnTalk] Town Moderator Asks for your VOTE

2023-01-10 Thread sarah cannon holden
and perspectives - and I am ever hopeful that they will step forth to serve on a board or committee.I look forward to seeing you at Town Meeting on Saturday, March 25th and I ask for your vote on Monday, March 27, 2023. Sarah Cannon Holden Weston Road -- The LincolnTalk mailing list. To post, send

Re: [LincolnTalk] Any Ice Skating Stories?

2022-12-22 Thread Sarah Cannon Holden
coln-boun...@lincolntalk.org> On Behalf Of Sarah Cannon Holden Sent: Thursday, December 22, 2022 5:52 PM To: Susan Taylor <svhtay...@comcast.net> Cc: LincolnTalk <lincoln@lincolntalk.org> Subject: Re: [LincolnTalk] Any Ice Skating Stories? I remember skating on Long Pond in the

Re: [LincolnTalk] Any Ice Skating Stories?

2022-12-22 Thread Sarah Cannon Holden
I remember skating on Long Pond in the 1950s. Anyone know where it is? Sarah Cannon Holden > On Dec 22, 2022, at 2:15 PM, Susan Taylor wrote: > > Just for fun, share your favorite stories/memories of ice skating in Lincoln! > I remember thick black ice on Beaver Pond in the 1

[Python-Dev] Re: Feature Request: Adding Way to Annotate Class Variables Distinct from Instance Variables

2022-12-21 Thread Steve Holden
Well, the first comment is that this isn't really the best list to ask such questions on, since it was created for the Python developers to discuss the development of the language and its implementation. Further, such discussions nowadays take place on discuss.python.org, and you can find more

[jira] [Resolved] (SPARK-33782) Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

2022-12-12 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33782. -- Fix Version/s: 3.4.0 Assignee: Pralabh Kumar Resolution: Fixed > Pl

[spark] branch master updated: [SPARK-33782][K8S][CORE] Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

2022-12-12 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new af8dd411aa9 [SPARK-33782][K8S][CORE] Place

Re: [PySpark] Reader/Writer for bgzipped data

2022-12-06 Thread Holden Karau
Take a look at https://github.com/nielsbasjes/splittablegzip :D On Tue, Dec 6, 2022 at 7:46 AM Oliver Ruebenacker < oliv...@broadinstitute.org> wrote: > > Hello Holden, > > Thank you for the response, but what is "splittable gzip"? > > Best, Oliver

Re: [PySpark] Reader/Writer for bgzipped data

2022-12-06 Thread Holden Karau
There is the splittable gzip Hadoop input format, maybe someone could extend that to use support bgzip? On Tue, Dec 6, 2022 at 1:43 PM Oliver Ruebenacker < oliv...@broadinstitute.org> wrote: > > Hello Chris, > > Yes, you can use gunzip/gzip to uncompress a file created by bgzip, but > to

In Remembrance of Kyle

2022-12-05 Thread Holden Karau
r them and I'll collect them and pass them on to his family. Take care of each other. Hugs & Love, Holden

Re: [VOTE] New Provider: Cloudera

2022-12-03 Thread Holden Karau
non-binding +1 On Sat, Dec 3, 2022 at 3:55 AM Jarek Potiuk wrote: > I think cloudera is important player in our ecosystem and as long as > it passes all the bars (i.e. 2.3.0+ compatibility and good > non-conflicting dependencies, passing all the tests, I am +1. > > On Sat, Dec 3, 2022 at 12:51

Re: Syndicate Apache Spark Twitter to Mastodon?

2022-12-01 Thread Holden Karau
r) > For Federated features, I think Slack would be a better platform, a lot > of Apache Big data projects have slack for federated features > > чт, 1 дек. 2022 г., 02:33 Holden Karau : > >> I agree that there is probably a majority still on twitter, but it would >> be a syndica

Re: Syndicate Apache Spark Twitter to Mastodon?

2022-11-30 Thread Holden Karau
devs are still using Twitter. > > > чт, 1 дек. 2022 г., 01:35 Holden Karau : > >> Do we want to start syndicating Apache Spark Twitter to a Mastodon >> instance. It seems like a lot of software dev folks are moving over there >> and it would be good to reach our users wh

Syndicate Apache Spark Twitter to Mastodon?

2022-11-30 Thread Holden Karau
Do we want to start syndicating Apache Spark Twitter to a Mastodon instance. It seems like a lot of software dev folks are moving over there and it would be good to reach our users where they are. Any objections / concerns? Any thoughts on which server we should pick if we do this? -- Twitter:

[LincolnTalk] A momentary change of focus.

2022-11-28 Thread sarah cannon holden
part of that history would be interesting to others in Lincoln. Sarah Cannon Holden In 1943 my father, Bradford Cannon, led the team of surgeons who cared for the survivors of the Cocoanut Grove fire. Fifty years later, my brother Laurie was a senior captain with United Airlines. The first

Re: Dataproc serverless for Spark

2022-11-28 Thread Holden Karau
This sounds like a great question for the Google DataProc folks (I know there was some interesting work being done around it but I left before it was finished so I don't want to provide a possibly incorrect answer). If your a GCP customer try reaching out to their support for details. On Mon,

<    1   2   3   4   5   6   7   8   9   10   >