Re: Issue with Running Spark in Jupyter Notebook

2021-06-24 Thread Artemis User
Looks like you didn't set up your environment properly.  I assume you are running this from a standalone python program instead of from the pyspark shell.  I would first run your code from the pyspark shell, then follow the spark python installation guide to set up your python environment

Issue with Running Spark in Jupyter Notebook

2021-06-24 Thread Hsu, Philip
Hi there, My name is Philip, a master’s student at Imperial College London. I’m trying to use Spark to complete my course work assignment. I ran the following code: from pyspark import SparkContext sc = SparkContext.getOrCreate() and got the following error message: Py4JJavaError: An error