Re: [External] Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?

2024-03-17 Thread Ofir Manor
ases> Ofir From: Russell Jurney Sent: Friday, March 15, 2024 11:43 PM To: brad.boil...@fcc-fac.ca.invalid Cc: user@spark.apache.org Subject: [External] Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3? There is an implementa

Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?

2024-03-15 Thread Russell Jurney
There is an implementation for Spark 3, but GraphFrames isn't released often enough to match every point version. It supports Spark 3.4. Try it - it will probably work. https://spark-packages.org/package/graphframes/graphframes Thanks, Russell Jurney @rjurney

[GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?

2024-01-12 Thread Boileau, Brad
Hello, I was hoping to use a distribution of GraphFrames for AWS Glue 4 which has spark 3.3, but there is no found distribution for Spark 3.3 at this location: https://spark-packages.org/package/graphframes/graphframes Do you have any advice on the best compatible version to use for Spark 3.3?