Just to add - the latest version is 0.8.3, it seems to support 3.3: "Support Spark 3.3 / Scala 2.12 , Spark 3.4 / Scala 2.12 and Scala 2.13, Spark 3.5 / Scala 2.12 and Scala 2.13" Releases · graphframes/graphframes (github.com)<https://github.com/graphframes/graphframes/releases> Ofir ________________________________ From: Russell Jurney <russell.jur...@gmail.com> Sent: Friday, March 15, 2024 11:43 PM To: brad.boil...@fcc-fac.ca.invalid <brad.boil...@fcc-fac.ca.invalid> Cc: user@spark.apache.org <user@spark.apache.org> Subject: [External] Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?
There is an implementation for Spark 3, but GraphFrames isn't released often enough to match every point version. It supports Spark 3.4. Try it - it will probably work. https://spark-packages.org/package/graphframes/graphframes Thanks, Russell Jurney @rjurney<http://twitter.com/rjurney> russell.jur...@gmail.com<mailto:russell.jur...@gmail.com> LI<http://linkedin.com/in/russelljurney> FB<http://facebook.com/jurney> datasyndrome.com<http://datasyndrome.com> Book a time on Calendly<https://calendly.com/rjurney_personal/30min> On Fri, Jan 12, 2024 at 7:55 AM Boileau, Brad <brad.boil...@fcc-fac.ca.invalid> wrote: Hello, I was hoping to use a distribution of GraphFrames for AWS Glue 4 which has spark 3.3, but there is no found distribution for Spark 3.3 at this location: https://spark-packages.org/package/graphframes/graphframes Do you have any advice on the best compatible version to use for Spark 3.3? Sincerely, Brad Boileau Senior Product Architect / Architecte produit sénior Farm Credit Canada | Financement agricole Canada 1820 Hamilton Street / 1820, rue Hamilton Regina SK S4P 2B8 Tel/Tél. : 306-359, C/M: 306-737-8900 fcc.ca<https://www.fcc-fac.ca/en.html> / fac.ca<https://www.fcc-fac.ca/fr.html> FCC social media<https://www.fcc-fac.ca/en/about-fcc/social-media.html> / Médias sociaux FAC<https://www.fcc-fac.ca/fr/a-propos-de-FAC/social-media.html> [2QA=] This email, including attachments, is confidential. You may not share this email with any third party. If you are not the intended recipient, any redistribution or copying of this email is prohibited. If you have received this email in error or cannot comply with these restrictions, please delete or destroy it entirely and immediately without making a copy and notify us by return email. Ce courriel (y compris toutes les pièces jointes qu’il comporte) est confidentiel. Vous ne pouvez pas partager ce courriel avec des tiers. Si vous n’êtes pas le destinataire prévu, toute divulgation, reproduction, copie ou distribution de ce courriel est strictement interdite. Si vous avez reçu ce courriel par erreur ou ne pouvez pas respecter ces restrictions, merci de le supprimer ou de le détruire complètement et immédiatement, sans le dupliquer, et de nous aviser par retour de courriel. Unsubscribe from FCC marketing-related messages.<mailto:fccunsubscr...@fcc.ca?Subject=Unsubscribe+from+FCC+marketing-related+messages&Body=Please+unsubscribe+me+from+all+FCC+Marketing+messages+including:%0A%0A+·+FCC+Knowledge+Newsletter%0A+·+FCC+Events%0A+·+AgExpert%0A+I+understand+that+I+will+still+receive+messages+related+to+business+transactions.> (Customers will still receive messages related to business transactions.) Se désabonner pour ne plus recevoir de messages liés au marketing de la part de FAC.<mailto:facenli...@fac.ca?Subject=Se+désabonner+de+la+liste+d’envoi+de+messages+électroniques+de+FAC&Body=Je+me+désabonne+de+tout+message+de+marketing+de+FAC,+y+compris+:%0A%0A+·+L'infolettre+de+Savoir+FAC%0A+·+Événements+de+FAC%0A+·+AgExpert%0A+Je+comprends+que+je+continuerai+de+recevoir+des+messages+concernant+mes+transactions.> (Les clients continueront de recevoir des messages concernant leurs transactions.)
