Hi Claus

Yes, my Camel ride started about 8 years ago and it continues :-)

I just searched the Camel Jira and found an already existing ticket for my 
problem: CAMEL-15106

Thanks a lot
Stephan


-----Ursprüngliche Nachricht-----
Von: Claus Ibsen <claus.ib...@gmail.com> 
Gesendet: Montag, 24. August 2020 09:44
An: users@camel.apache.org
Betreff: Re: Access native KafkaConsumer in Camel RoutePolicy

Hi Stephan

I recall you have used Camel a long time ago.

About the pause/resume, then you are welcome to create a JIRA ticket so we can 
look at adding this API to camel-kafka consumer.

From a route policy, you can get hold on the consumer which you can cast to 
KafkaConsumer (Camel's) and then with the new pause/resume api use that.

On Mon, Aug 24, 2020 at 9:02 AM Burkard Stephan <stephan.burk...@visana.ch> 
wrote:
>
> Hi
>
> **I also posted this question on StackOverflow** => 
> https://stackoverflow.com/q/63519628/8035582
>
>
> I "monitor" the number of consecutive failures in my Camel processing 
> pipeline with a Camel RoutePolicy.
>
> When a threshold of failures is reached, I want to pause the processing for a 
> configured amount of time because it probably means that the data from 
> another system is not yet ready and therefore every message fails.
>
> Since the source of my pipeline is a Kafka topic, I should not just stop the 
> whole route because the broker would assume my consumer died and rebalance.
>
> The best way to "pause" topic consumption seems to be to pause[1] the 
> KafkaConsumer (the native, not the one of Camel). Like this, the consumer 
> continues to poll the broker, but it does not fetch any messages.
>
> **How can I access the native KafkaConsumer from the RoutePolicy 
> context to call the pause and resume methods?**
>
>
> The spring-kafka listener containers offers these methods[2], but when I use 
> a Spring consumer, I would need to connect it with my Camel routes and it 
> would get hairy to commit messages.
>
> [1] 
> https://kafka.apache.org/24/javadoc/org/apache/kafka/clients/consumer/
> KafkaConsumer.html#pause-java.util.Collection-
> [2] 
> https://docs.spring.io/spring-kafka/docs/2.2.14.RELEASE/reference/html
> /#pause-resume
>
> Thanks
> Stephan
>
>


--
Claus Ibsen
-----------------
http://davsclaus.com @davsclaus
Camel in Action 2: https://www.manning.com/ibsen2

Reply via email to