Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-27 Thread dusenberrymw
Hi Aishwarya, Yes, it is quite strange that Jupyter isn't running on the PySpark kernel even though it's being started in that manner. The good news is that we do use this everyday, so once we find the root issue with your Jupyter, it should work great! Let's try temporarily removing all of t

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-26 Thread Aishwarya Chaurasia
Hi sir, The sc NameError persists. (1) There is only one jupyter server running. And that was started with the pyspark command in the previous mail. (2) Two kernels are appearing in the change kernel option - Python3 and Python2. Tried with both of them and the result is the same. How is jupyter

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-25 Thread dusenberrymw
Hi Aishwarya, Unfortunately this mailing list removes all images, so I can't view your screenshot. I'm assuming that it is the same issue with the missing SparkContext `sc` object, but please let me know if it is a different issue. This sounds like it could be an issue with multiple kernels i

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-25 Thread Aishwarya Chaurasia
We had another query, sir. We read the entire MachineLearning.ipynb code. in it the training samples and the validation samples have both been evaluated separately and their respective losses and accuracies obtained. Why are the training samples being evaluated again if they were used to train the

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-25 Thread Aishwarya Chaurasia
Hello sir, The NameError is occuring again sir. Why does it keep resurfacing? Attaching the screenshot of the error. On 25-Apr-2017 2:50 AM, wrote: > Hi Aishwarya, > > For the error message, that just means that the SystemML jar isn't being > found. Can you add a `--driver-class-path $SYSTEMM

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-24 Thread dusenberrymw
Hi Aishwarya, For the error message, that just means that the SystemML jar isn't being found. Can you add a `--driver-class-path $SYSTEMML_HOME/target/SystemML.jar` to the invocation of Jupyter? I.e. `PYSPARK_PYTHON=python3 PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS="notebook" p

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-24 Thread Aishwarya Chaurasia
Further more : What is the output of MachineLearning.ipynb you're obtaining sir? We are actually nearing our deadline for our problem. Thanks a lot. On 24-Apr-2017 2:58 PM, "Aishwarya Chaurasia" wrote: Hello sir, Thanks a lot for replying sir. But unfortunately it did not work. Although the Nam

Re: Please reply ASAP : Regarding incubator systemml/breast_cancer project

2017-04-24 Thread Aishwarya Chaurasia
Hello sir, Thanks a lot for replying sir. But unfortunately it did not work. Although the NameError did not appear this time but another error came about : https://paste.fedoraproject.org/paste/TUMtSIb88Q73FYekwJmM7V5M1UNdIG YhyRLivL9gydE= This error was obtained after executing the second block

Re: Please reply asap : Regarding incubator systemml/breast_cancer project

2017-04-23 Thread Aishwarya Chaurasia
Hey, Thank you so much for your help sir. We were finally able to run preprocess.py without any errors. And the results obtained were satisfactory i.e we got five set of data frames like you said we would. But alas! when we tried to run MachineLearning.ipynb the same NameError came : https://past