VS: VS: Using Spark as a simulator

2017-07-07 Thread Esa Heikkinen
y: 7. heinäkuuta 2017 10:04 Vastaanottaja: Esa Heikkinen Kopio: Mahesh Sawaiker; user@spark.apache.org Aihe: Re: VS: Using Spark as a simulator Spark dropped Akka some time ago... I think the main issue he will face is a library for simulating the state machines (randomly), storing a huge amoun

Re: VS: Using Spark as a simulator

2017-07-07 Thread Jörn Franke
ts, which you can then process functional/set operators. > > You would want to read about PairRDDs. > > From: Esa Heikkinen [mailto:esa.heikki...@student.tut.fi] > Sent: Wednesday, June 21, 2017 1:12 PM > To: Jörn Franke > Cc: user@spark.apache.org > Subject: VS: Using

VS: Using Spark as a simulator

2017-07-07 Thread Esa Heikkinen
you will get a RDD of scala objects, which you can then process functional/set operators. You would want to read about PairRDDs. From: Esa Heikkinen [mailto:esa.heikki...@student.tut.fi] Sent: Wednesday, June 21, 2017 1:12 PM To: Jörn Franke Cc: user@spark.apache.org Subject: VS: Using Spark a

VS: Using Spark as a simulator

2017-06-21 Thread Esa Heikkinen
Hi Thanks for the answer. I think my simulator includes a lot of parallel state machines and each of them generates log file (with timestamps). Finally all events (rows) of all log files should combine as time order to (one) very huge log file. Practically the combined huge log file can