Forgot to add, I'm on HBase 1.0.0-cdh5.4.5, so can't use HBaseContext. And spark version is 1.6.1
[image: http://] Tariq, Mohammad about.me/mti [image: http://] <http://about.me/mti> On Thu, Jun 16, 2016 at 10:12 PM, Mohammad Tariq <donta...@gmail.com> wrote: > Hi group, > > I have a streaming job which reads data from Kafka, performs some > computation and pushes the result into HBase. Actually the results are > pushed into 3 different HBase tables. So I was wondering what could be the > best way to achieve this. > > Since each executor will open its own HBase connection and write data to a > regionserver independent of rest of the executors I feel this is a bit of > overkill. How about collecting the results of each micro batch and putting > them in one shot at the end of that batch? > > If so what should be the way to go about this? > > Many thanks! > > > [image: http://] > > Tariq, Mohammad > about.me/mti > [image: http://] > <http://about.me/mti> > >
