Hi Guys,
Pyspark is not picking up correct python version on azure hdinsight
property setup in spark2-env
PYSPARK_PYTHON=${PYSPARK3_PYTHON:-/usr/bin/anaconda/envs/py35/bin/python3}
export
PYSPARK_DRIVER_PYTHON=${PYSPARK3_PYTHON:-/usr/bin/anaconda/envs/py35/bin/python3}
Thanks
