Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
ave to be scanned using the book's id and the retrieved data is >> > joined together. >> > >> > As I'm new to Spark I'm not sure if I can leverage Spark's processing model &g

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Michael Segel
prox. 25 tables (each containing 10k-700k >> > entries) have to be scanned using the book's id and the retrieved data is >> > joined together. >> > >> > As I'm new to Spark I'm not sure if I can leverage Spark's processing model >

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Mich Talebzadeh
taining 10k-700k > > entries) have to be scanned using the book's id and the retrieved data is > > joined together. > > > > As I'm new to Spark I'm not sure if I can leverage Spark's processing > model > > for this use case. > > > > >

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > -

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
g 10k-700k> entries) have to be scanned using the book's id and the retrieved data is> joined together. > > As I'm new to Spark I'm not sure if I can leverage Spark's processing model> for this use case.> > > > > > --> View this message

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Michael Segel
if I can leverage Spark's processing model > for this use case. > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Mich Talebzadeh
total approx. 25 tables (each containing 10k-700k > > entries) have to be scanned using the book's id and the retrieved data is > > joined together. > > > > As I'm new to Spark I'm not sure if I can leverage Spark's processing > model >

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Jean Georges Perrin
the book's id and the retrieved data is >> > joined together. >> > >> > As I'm new to Spark I'm not sure if I can leverage Spark's processing model >> > for this use case. >> > >> > >> > >> >

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
e to be scanned using the book's id and the retrieved data is> joined together. > > As I'm new to Spark I'm not sure if I can leverage Spark's processing model> for this use case.> > > > > > --> View this message in context: http://apache-spark-user

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Mich Talebzadeh
rocessing > model > > for this use case. > > > > > > > > > > > > -- > > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html > > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > > > - > > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > > >

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
f I can leverage Spark's processing model > for this use case. > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Jean Georges Perrin
message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > -

Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread dabuki
o Spark I'm not sure if I can leverage Spark's processing model for this use case. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html Sent from the Apache Spark User Lis