Hi Felix and Tomoas,
Thanks a lot for your information. I figured out the environment variable
PYSPARK_PYTHON is the secret key.
My current approach is to start iPython notebook on the namenode,
export PYSPARK_PYTHON=/opt/local/anaconda/bin/ipython
/opt/local/anaconda/bin/ipython notebook --prof
Hi,
You can try
PYSPARK_DRIVER_PYTHON=/path/to/ipython PYSPARK_DRIVER_PYTHON_OPTS="notebookâ
/path/to//pyspark
/Tomas
> On 11 May 2015, at 22:17, Bin Wang wrote:
>
> Hey there,
>
> I have installed a python interpreter in certain location, say
> "/opt/local/anaconda".
>
> Is there anyth
Hey there,
I have installed a python interpreter in certain location, say
"/opt/local/anaconda".
Is there anything that I can specify the Python interpreter while
developing in iPython notebook? Maybe a property in the while creating the
Sparkcontext?
I know that I can put "#!/opt/local/anacond
