Re: New Google Summer of Code 2017 Student - Krishna Kalyan

2017-05-10 Thread Deron Eriksson
Welcome Krishna! Deron On Wed, May 10, 2017 at 7:20 PM, wrote: > Welcome, Krishna! Looking forward to working with you! For a bit of my > background related to the project, I've been heavily focused on deep > learning by building a DML library for DL (in `scripts/nn`) and working on > an app

Re: New Google Summer of Code 2017 Student - Krishna Kalyan

2017-05-10 Thread dusenberrymw
Welcome, Krishna! Looking forward to working with you! For a bit of my background related to the project, I've been heavily focused on deep learning by building a DML library for DL (in `scripts/nn`) and working on an applied DL project (in `projects/breast_cancer`). I've also worked on the e

Re: Improve SystemML execution speed in Spark

2017-05-10 Thread Niketan Pansare
Hi Arijit, Can you please put timing counters around below code to understand 20-30 seconds you observe: 1. Creation of SparkContext: sc = SparkContext("local[*]", "test") 2. Converting pandas to Pyspark dataframe: > train_data= pd.read_csv("data1.csv") > test_data = pd.read_csv("data2.csv")

Improve SystemML execution speed in Spark

2017-05-10 Thread arijit chakraborty
Hi, I'm creating a process in SystemML, and running it through spark. I'm running the code in the following way: # Spark Specifications: import os import sys import pandas as pd import numpy as np spark_path = "C:\spark" os.environ['SPARK_HOME'] = spark_path os.environ['HADOOP_HOME'] = spar

Jenkins build is back to normal : SystemML-DailyTest #980

2017-05-10 Thread jenkins
See