If your transaction messages are all in a single data topic then you could
perhaps use compressed message set for each transaction- that way you dont
need control messages and thus would be atomic (message sets are stored at
a single physical offset and delivered the same way to consumers).
Not su
while trying to recover the logs.
--
Michal Haris
Software Engineer
www.visualdna.com | t: +44 (0) 207 734 7033
Unfortunately can't see any rebalance in the logs will have to wait for it
to occur again.
On 29 January 2013 18:20, Neha Narkhede wrote:
> Please can you file a JIRA and attach the full consumer rebalancing log4j
> file ?
>
>
> On Tue, Jan 29, 2013 at 10:18 AM, Michal Har
Same here, summary was need as we have a fairly large ecosystem of multiple
0.7.2 clusters and I am planning to test upgrade to 0.8.
However, one thing creeping at the back of my mind regarding 0.8 is
something i have spotted in one thread few weeks ago namely that the
rebalance behaviour of produ
esn't care about partitioning by key, messages will be sent to partitions
> that are currently available.
>
> Thanks,
>
> Jun
>
> On Thu, Feb 7, 2013 at 3:11 PM, Michal Haris >wrote:
>
> > Same here, summary was need as we have a fairly large ecosystem of
> multipl
essage for the
> partition in the async mode and consistently throw an exception to the
> caller in the sync mode.
>
> Thanks,
>
> Jun
>
> On Fri, Feb 8, 2013 at 1:41 AM, Michal Haris >wrote:
>
> > So if the produces are partitioning by key we have to have replica
e message for the
> partition in the async mode and consistently throw an exception to the
> caller in the sync mode.
>
> Thanks,
>
> Jun
>
> On Fri, Feb 8, 2013 at 1:41 AM, Michal Haris >wrote:
>
> > So if the produces are partitioning by key we have to have re
Hi I need to detect and handle exceptions that occur in the
ProducerSendThread of async producer but can't find any discussion or
example how to capture them. Anybody can point me to some resource ?
Thanks
l the
> exceptions in handle().
>
> Thanks,
>
> Jun
>
> On Fri, Feb 22, 2013 at 1:34 AM, Michal Haris >wrote:
>
> > Hi I need to detect and handle exceptions that occur in the
> > ProducerSendThread of async producer but can't find any discussion or
Hi guys,
Is it possible to have both 0.7 and 0.8 clients running within same process
? We would like to migrate to 0.8 only some of the topics initially so we
would need some consumers to have connection to both clusters. I remember a
mention of migration tool that consumes from 0.7 and produces t
Hi, is it possible or has anybody tried/needed to balance partitions
between consumers unevenly or based on some custom function ? Ideally with
Kafka 0.7
Michal Haris
;
> Guozhang
>
>
> On Thu, Aug 22, 2013 at 11:00 AM, Michal Haris
> wrote:
>
> > Hi, is it possible or has anybody tried/needed to balance partitions
> > between consumers unevenly or based on some custom function ? Ideally
> with
> > Kafka 0.7
> >
>
12 matches
Mail list logo
