Hi Haseeb, I think the user mailing list is what you're looking for, people are usually pretty active on here if you present a direct question about apache spark. I've linked below the community guidelines which says which mailing lists are for what etc
https://spark.apache.org/community.html There's a few resources below for cluster management and code performance tweaks but if you write declaratively in Spark the planning engine does a pretty good job of optimising jobs, it's hard to answer without a specific problem presented, hope the docs get you started https://spark.apache.org/docs/latest/cluster-overview.html https://spark.apache.org/docs/latest/tuning.html https://spark.apache.org/docs/latest/sql-performance-tuning.html On Thu, Sep 28, 2023 at 3:22 PM Haseeb Khalid <haseeb.kha...@purelogics.net> wrote: > Dear Support Team, > > I hope this message finds you well. My name is Haseeb Khalid, and I am > reaching out to discuss a scenario related to processing speed in Apache > Spark. > > I have been utilizing these technologies in our projects, and we have > encountered a specific use case where we are seeking to optimize processing > speed. Given the critical nature of this requirement, I would greatly > appreciate the opportunity to discuss this with a knowledgeable > representative from your team. > > I am particularly interested in understanding any best practices, > configuration tweaks, or architectural considerations that can be employed > to enhance processing speed in our specific scenario. > > Would it be possible to schedule a call or exchange emails to delve deeper > into this matter? I am available at your convenience and can accommodate > any preferred mode of communication. > > I genuinely value the expertise of the Apache Spark communities and > believe that your insights will be instrumental in achieving our objectives. > > Thank you very much for your time and consideration. I look forward to > hearing from you soon. > > -- > > Thanks & Best Regards, > > *Haseeb Khalid* > > *Senior Data Analyst* > > +92 306 4436 790 > > >