ver to skip over the uncommitted
records from the previous poll.
Martin
On 31 March 2016 at 16:10, Martin Skøtt <martin.sko...@falconsocial.com>
wrote:
> We have recently had great success with committing records in smaller
> batches between poll()'s. Something along these lin
We have recently had great success with committing records in smaller
batches between poll()'s. Something along these lines:
records = consumer.poll()
foreach record:
process record
On 31 March 2016 at 12:13, Daniel Fanjul
wrote:
> Hi all,
>
> My problem:
Hi,
Regarding item 1, the maximum can be configured in the broker by changing
group.max.session.timeout.ms.
Regards,
Martin
On 2 March 2016 at 15:09, Gligor Vanessa wrote:
> Hello,
>
> I am using Kafka higher consumer 0.9.0. I am not using the auto commit for
> the
> in case we later changed the logic to only permit commits on assigned
partitions
I experienced this yesterday and was wondering why Kafka allows commits to
partitions from other consumers than the assigned one. Does any one know of
the reasoning behind this?
Martin
On 5 Jan 2016 18:29, "Jason
. any overridden
> settings).
>
> -Jason
>
> On Mon, Nov 30, 2015 at 8:12 AM, Martin Skøtt <
> martin.sko...@falconsocial.com> wrote:
>
> > Well, I made the problem go away, but I'm not sure why it works :-/
> >
> > Previously I used a time out
remained, but less frequent
Not really sure what is going on, but happy that the problem went away :-)
Martin
On 30 November 2015 at 15:33, Martin Skøtt <martin.sko...@falconsocial.com>
wrote:
> Hi Guozhang,
>
> I have done some testing with various values of heartbeat.interval.ms a
reasing it and see
> if this issue goes away.
>
> At the same time, we have some better error handling fixes in trunk which
> will be included in the next point release.
>
> https://issues.apache.org/jira/browse/KAFKA-2860
>
> Guozhang
>
>
>
> On Wed, Nov 25, 2015 at 6:
have 13 topics
with two partitions each and a replication factor of 1. I run one producer
and once consumer also on the same machine.
--
Martin Skøtt
)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:829)
Does anyone have any input on what might be happening?
--
Martin Skøtt
On 18 November 2015 at 19:16, Guozhang Wang <wangg...@gmail.com> wrote:
> Hello Martin,
>
> Could you paste the consumer config values in this thread as well? And is
> the consumer co-located with the broker?
>
> Guozhang
>
> On Wed, Nov 18, 2015 at 7:40 AM, Martin Skøtt <
10 matches
Mail list logo