Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-17 Thread Emmanuel Bernard
Got it now. That being said, if Alan is correct (one JVM per M/R task run per node), we will need to implement C/S local key and keyset lookup. Emmanuel On 14 Mar 2014, at 12:34, Sanne Grinovero sa...@infinispan.org wrote: On 14 March 2014 09:06, Emmanuel Bernard emman...@hibernate.org wrote:

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-17 Thread Alan Field
To: infinispan -Dev List infinispan-dev@lists.jboss.org Sent: Monday, March 17, 2014 11:31:34 AM Subject: Re: [infinispan-dev] Infinispan - Hadoop integration Got it now. That being said, if Alan is correct (one JVM per M/R task run per node), we will need to implement C/S local key and keyset

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-17 Thread Gustavo Fernandes
...@hibernate.org *To: *infinispan -Dev List infinispan-dev@lists.jboss.org *Sent: *Monday, March 17, 2014 11:31:34 AM *Subject: *Re: [infinispan-dev] Infinispan - Hadoop integration Got it now. That being said, if Alan is correct (one JVM per M/R task run per node), we will need to implement C/S local

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-17 Thread Emmanuel Bernard
] Infinispan - Hadoop integration Got it now. That being said, if Alan is correct (one JVM per M/R task run per node), we will need to implement C/S local key and keyset lookup. Emmanuel On 14 Mar 2014, at 12:34, Sanne Grinovero sa...@infinispan.org wrote: On 14 March 2014 09:06, Emmanuel

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-14 Thread Emmanuel Bernard
On 13 mars 2014, at 23:39, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:19, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 22:17, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:05, Mircea Markus mmar...@redhat.com wrote: On Mar 13,

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-14 Thread Sanne Grinovero
On 14 March 2014 09:06, Emmanuel Bernard emman...@hibernate.org wrote: On 13 mars 2014, at 23:39, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:19, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 22:17, Sanne Grinovero sa...@infinispan.org wrote: On 13 March

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-14 Thread Mircea Markus
On Mar 14, 2014, at 9:06, Emmanuel Bernard emman...@hibernate.org wrote: On 13 mars 2014, at 23:39, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:19, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 22:17, Sanne Grinovero sa...@infinispan.org wrote: On

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-14 Thread Alan Field
] Infinispan - Hadoop integration On Mar 14, 2014, at 9:06, Emmanuel Bernard emman...@hibernate.org wrote: On 13 mars 2014, at 23:39, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:19, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 22:17, Sanne

[infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Mircea Markus
Hi, I had a very good conversation with Jonathan Halliday, Sanne and Emmanuel around the integration between Infinispan and Hadoop. Just to recap, the goal is to be able to run Hadoop M/R tasks on data that is stored in Infinispan in order to gain speed. (once we have a prototype in place, one

[infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Mircea Markus
Hi, I had a very good conversation with Jonathan Halliday, Sanne and Emmanuel around the integration between Infinispan and Hadoop. Just to recap, the goal is to be able to run Hadoop M/R tasks on data that is stored in Infinispan in order to gain speed. (once we have a prototype in place, one

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Ales Justin
- also important to notice that we will have both an Hadoop and an Infinispan cluster running in parallel: the user will interact with the former in order to run M/R tasks. Hadoop will use Infinispan (integration achieved through InputFormat and OutputFormat ) in order to get the data to be

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Mircea Markus
On Mar 13, 2014, at 20:59, Ales Justin ales.jus...@gmail.com wrote: - also important to notice that we will have both an Hadoop and an Infinispan cluster running in parallel: the user will interact with the former in order to run M/R tasks. Hadoop will use Infinispan (integration achieved

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Sanne Grinovero
On 13 March 2014 22:05, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 20:59, Ales Justin ales.jus...@gmail.com wrote: - also important to notice that we will have both an Hadoop and an Infinispan cluster running in parallel: the user will interact with the former in order to

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Mircea Markus
On Mar 13, 2014, at 22:17, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:05, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 20:59, Ales Justin ales.jus...@gmail.com wrote: - also important to notice that we will have both an Hadoop and an Infinispan

Re: [infinispan-dev] Infinispan - Hadoop integration

2014-03-13 Thread Sanne Grinovero
On 13 March 2014 22:19, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 22:17, Sanne Grinovero sa...@infinispan.org wrote: On 13 March 2014 22:05, Mircea Markus mmar...@redhat.com wrote: On Mar 13, 2014, at 20:59, Ales Justin ales.jus...@gmail.com wrote: - also important to