Hi Mike, I'm not sure about the minimum requirements of a machine for running Spark. But to run some Pyspark scripts (and Jupiter notbebooks) on a local machine, I found the following steps are the easiest.
I installed Amazon corretto and updated the java_home variable as instructed here https://docs.aws.amazon.com/corretto/latest/corretto-11-ug/downloads-list.html (Any other java works too, I'm used to corretto from work). Then installed the Pyspark module using pip, which enabled me run Pyspark on my machine. -Sadha On Mon, Jul 29, 2024, 12:51 PM mike Jadoo <mikejad...@gmail.com> wrote: > Hello, > > I am trying to run Pyspark on my computer without success. I follow > several different directions from online sources and it appears that I need > to get a faster computer. > > I wanted to ask what are some recommendations for computer specifications > to run PySpark (Apache Spark). > > Any help would be greatly appreciated. > > Thank you, > > Mike >
