Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
x. 25 tables (each containing 10k-700k >> > entries) have to be scanned using the book's id and the retrieved data is >> > joined together. >> > >> > As I'm new to Spark I'm not sure if I can leverage Spark's processing model >> > for this use cas

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Michael Segel
otal approx. 25 tables (each containing 10k-700k >> > entries) have to be scanned using the book's id and the retrieved data is >> > joined together. >> > >> > As I'm new to Spark I'm not sure if I can leverage Spark's processing model >> > for this

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Mich Talebzadeh
les. In total approx. 25 tables (each containing 10k-700k > > entries) have to be scanned using the book's id and the retrieved data is > > joined together. > > > > As I'm new to Spark I'm not sure if I can leverage Spark's processing > model > > for this use case. &

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
iew this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > -

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
s processing model> for this use case.> > > > > > --> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-databa

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Michael Segel
sure if I can leverage Spark's processing model > for this use case. > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.htm

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Mich Talebzadeh
involve access to multiple > > database tables. In total approx. 25 tables (each containing 10k-700k > > entries) have to be scanned using the book's id and the retrieved data is > > joined together. > > > > As I'm new to Spark I'm not sure if I can leverage Spark's proc

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Jean Georges Perrin
have to be scanned using the book's id and the retrieved data is >> > joined together. >> > >> > As I'm new to Spark I'm not sure if I can leverage Spark's processing model >> > for this use case. >> > >> > >> > >> > >

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html> Sent from the Apache Spark User List mailing list archive at Nabble.com.> > -> To unsubscribe e-mail: user-unsubscr...@spark.apache.org>

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Mich Talebzadeh
n leverage Spark's processing > model > > for this use case. > > > > > > > > > > > > -- > > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-t

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Andreas Bauer
ge Spark's processing model > for this use case. > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html

Re: Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread Jean Georges Perrin
iew this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > >

Is Spark suited for replacing a batch job using many database tables?

2016-07-06 Thread dabuki
not sure if I can leverage Spark's processing model for this use case. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-Spark-suited-for-replacing-a-batch-job-using-many-database-tables-tp27300.html Sent from the Apache Spark User List mailing list archive