thx, this is what I needed
2017-03-02 11:07 GMT+01:00 Ted Yu <yuzhih...@gmail.com>:
> Daniel:
> If you don't pass your ExecutorService to HTable ctor, the following would
> be called:
>
> public static ThreadPoolExecutor getDefaultExecutor(Configuration conf)
> {
>
> int maxThreads = conf.getInt("hbase.htable.threads.max", Integer.
> MAX_VALUE);
>
> Note the default value.
>
> When the number of regions involved is high, consider adjusting the above
> config.
>
> On Wed, Mar 1, 2017 at 11:04 PM, Daniel Połaczański <
> dpolaczan...@gmail.com>
> wrote:
>
> > Yes. I am using batch variant. I will try your variant
> >
> > 02.03.2017 7:53 AM "Jingcheng Du" <dujin...@gmail.com> napisał(a):
> >
> > What APIs are you using to execute the coprocessor?
> > HTable#batchCoprocessorService? It executes the coprocessors regions by
> > regions in each region server.
> > How about using coprocessorService? This API should run coprocessors in
> > parallel for different regions.
> >
> > 2017-03-02 14:32 GMT+08:00 Daniel Połaczański <dpolaczan...@gmail.com>:
> >
> > > I invoke my business logic which is similar to map reduce paradigm.
> > > Everything works. Only performance is problem that regions are not
> > > processed parallely.
> > > I'm thinking about some hack like invoking 4 times rpc from client
> when i
> > > have 4 regions
> > >
> > > 02.03.2017 00:43 "Ted Yu" <yuzhih...@gmail.com> napisał(a):
> > >
> > > > To my knowledge, there is no support for this type of combination of
> > map
> > > > reduce and coprocessor.
> > > >
> > > > On Wed, Mar 1, 2017 at 2:55 PM, Daniel Połaczański <
> > > dpolaczan...@gmail.com
> > > > >
> > > > wrote:
> > > >
> > > > > It is something like map reduce processing.
> > > > > I want to run map and combine phase inside in a coprocessor for
> every
> > > > > region separately, return partial results to the client. On the
> > client
> > > > > invoke reduce phase and store result in another hbase table.
> > > > >
> > > > > 2017-03-01 23:26 GMT+01:00 Ted Yu <yuzhih...@gmail.com>:
> > > > >
> > > > > > Can you describe your use case in more detail ?
> > > > > >
> > > > > > What type of custom coprocessor are you loading to the region
> > server
> > > ?
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > On Wed, Mar 1, 2017 at 2:24 PM, Daniel Połaczański <
> > > > > dpolaczan...@gmail.com
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > > Let's assume that we have cluster consisting from one
> > RegionServer
> > > > and
> > > > > > the
> > > > > > > RegionsServer contains one table consisting from 3 regions.
> > > > > > >
> > > > > > > I would like to process regions in coprocessor parallely. Is
> it
> > > > > > possible?
> > > > > > >
> > > > > > > I observed that currenlty it invokes coproprocessor with all
> the
> > > > > regions
> > > > > > > one by one. So it process at the beginig region1, when finished
> > > > process
> > > > > > > regions2 and ...
> > > > > > >
> > > > > > > Is it possible to change this behaviour?
> > > > > > >
> > > > > > > Regards
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
