Hi Aishwarya,
Yes, it is quite strange that Jupyter isn't running on the PySpark kernel even
though it's being started in that manner. The good news is that we do use this
everyday, so once we find the root issue with your Jupyter, it should work
great! Let's try temporarily removing all of t
Hi sir,
The sc NameError persists.
(1) There is only one jupyter server running. And that was started with the
pyspark command in the previous mail.
(2) Two kernels are appearing in the change kernel option - Python3 and
Python2. Tried with both of them and the result is the same.
How is jupyter
Hi Aishwarya,
Unfortunately this mailing list removes all images, so I can't view your
screenshot. I'm assuming that it is the same issue with the missing
SparkContext `sc` object, but please let me know if it is a different issue.
This sounds like it could be an issue with multiple kernels i
We had another query, sir. We read the entire MachineLearning.ipynb code.
in it the training samples and the validation samples have both been
evaluated separately and their respective losses and accuracies obtained.
Why are the training samples being evaluated again if they were used to
train the
Hello sir,
The NameError is occuring again sir. Why does it keep resurfacing?
Attaching the screenshot of the error.
On 25-Apr-2017 2:50 AM, wrote:
> Hi Aishwarya,
>
> For the error message, that just means that the SystemML jar isn't being
> found. Can you add a `--driver-class-path $SYSTEMM
Hi Aishwarya,
For the error message, that just means that the SystemML jar isn't being found.
Can you add a `--driver-class-path $SYSTEMML_HOME/target/SystemML.jar` to the
invocation of Jupyter? I.e. `PYSPARK_PYTHON=python3
PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS="notebook" p
Further more :
What is the output of MachineLearning.ipynb you're obtaining sir?
We are actually nearing our deadline for our problem.
Thanks a lot.
On 24-Apr-2017 2:58 PM, "Aishwarya Chaurasia"
wrote:
Hello sir,
Thanks a lot for replying sir. But unfortunately it did not work. Although
the Nam
Hello sir,
Thanks a lot for replying sir. But unfortunately it did not work. Although
the NameError did not appear this time but another error came about :
https://paste.fedoraproject.org/paste/TUMtSIb88Q73FYekwJmM7V5M1UNdIG
YhyRLivL9gydE=
This error was obtained after executing the second block
Hey,
Thank you so much for your help sir. We were finally able to run
preprocess.py without any errors. And the results obtained were
satisfactory i.e we got five set of data frames like you said we would.
But alas! when we tried to run MachineLearning.ipynb the same NameError
came : https://past