Re: Windows10 + pyspark + ipython + csv file loading with timestamps

2017-12-18 Thread Szuromi Tamás 
Hi Esa,

I'm using it like this:
https://gist.github.com/tromika/1cda392242fdd66befe7970d80380216

cheers,

2017-12-16 11:04 GMT+01:00 Esa Heikkinen <heikk...@student.tut.fi>:

> Hi
>
> Does anyone have any hints or example (code) how to get combination:
> Windows10 + pyspark + ipython notebook + csv file loading with timestamps
> (timeseries data) to dataframe or RDD to work ?
>
> I have already installed windows10 + pyspark + ipython notebook and they
> seem to work, but my python code in notebook does not, because "spark
> context" may not work ?
>
> What commands should be put into the beginning of the notebook ? sc =
> SparkContext.getOrCreate() ? spark = SparkSession(sc) ?
>
> I have installed: spark-2.2.1-bin-hadoop2.7  and ipython 6.1.0 to
> Windows10.
>
> 
>
> Eras
>

Windows10 + pyspark + ipython + csv file loading with timestamps

2017-12-16 Thread Esa Heikkinen 

Hi

Does anyone have any hints or example (code) how to get combination: 
Windows10 + pyspark + ipython notebook + csv file loading with 
timestamps (timeseries data) to dataframe or RDD to work ?


I have already installed windows10 + pyspark + ipython notebook and they 
seem to work, but my python code in notebook does not, because "spark 
context" may not work ?


What commands should be put into the beginning of the notebook ? sc = 
SparkContext.getOrCreate() ? spark = SparkSession(sc) ?


I have installed: spark-2.2.1-bin-hadoop2.7  and ipython 6.1.0 to Windows10.



Eras