Configuring custom Kafka producer/consumer properties on Camel Kafka component/endpoint?

2019-10-08 Thread Erik Boye
Hi, Is there any way to configure custom Kafka producer/consumer properties on the Camel Kafka component/endpoint (without "breaking in")? I specifically want to configure the Confluent Kafka property with key 'value.subject.name.strategy': https://docs.confluent.io/current/schema-registry/seri

Re: [Camel-K]: It cannot start due to "exec: \"kamel\": executable file not found in $PATH"

2019-10-08 Thread Luca Morandini
> Hi, > I've updated the master to use M3-SNAPSHOT, since we've cut a release of M2 > last saturday. That did the trick, thanks a lot. Cheers, Luca Morandini

netty tcp consumer not reading large payload

2019-10-08 Thread Rohan Emmanuel
Hi, I have problem reading large payload using the netty TCP component. The payload is getting read in chunks, can you please guide me as to how can I read the entire payload -- Regards, Rohan Emmanuel

Re: netty tcp consumer not reading large payload

2019-10-08 Thread Omar Al-Safi
I think there is some few information here, like how did you use it, how does your route looks like ..etc. Also did you take a look at netty example here https://github.com/apache/camel/tree/master/examples/camel-example-netty-http ? On Tue, 8 Oct 2019 at 13:49, Rohan Emmanuel wrote: > Hi, > I h

Re: too many objects

2019-10-08 Thread Mantas Gridinas
What is the actual route definition you're using? I would try swapping out http4 component for regular http component. On Mon, Oct 7, 2019 at 2:34 PM arshid wrote: > > > > Hi all, > > > > I am reading a csv file around 300 gb and then splitting it and parsing it to > json and sending it to rest

Re: netty tcp consumer not reading large payload

2019-10-08 Thread Rohan Emmanuel
hi, i am using camel as a standalone java application. This application is to read input using TCP when client connects to it. attaching the route below, i see that after reading initial 1024 bytes, the route flow proceeded to other procesors with partail data. i want to be able to read entire mess

RE: netty tcp consumer not reading large payload [General Use]

2019-10-08 Thread Walke, Martin (Leonardo, UK)
Hi, The example you probably want is: https://github.com/apache/camel/tree/master/examples/camel-example-netty-custom-correlation It's a good example of what's required. Don't get side-tracked by netty-http examples as they're not what you want for a TCP stream. Does your message have an 'end-

Re: netty tcp consumer not reading large payload

2019-10-08 Thread Claus Ibsen
Hi You need to configure what codec you use so camel-netty knows what the data protocol is, eg what is the condition for a message to start/end etc. Is it text based or binary etc. And if its text based what are the terminating characters (new line or something else). AFAIR the default is java ob

How to set dynamic value to routeid

2019-10-08 Thread Imran Raza Khan
i tried following and its not working from("direct:test") .routeId("${body.topicName}") from("direct:test") .routeId(simple("${body.topicName}").toString()) Above both didnt work

Re: How to set dynamic value to routeid

2019-10-08 Thread Claus Ibsen
Hi You cannot set a dynamic route id, its assigned once during starting the route. On Tue, Oct 8, 2019 at 7:15 PM Imran Raza Khan wrote: > > i tried following and its not working > > from("direct:test") > .routeId("${body.topicName}") > > from("direct:test") > .routeId(simple("${body.topicN

Re: too many objects

2019-10-08 Thread Willem Jiang
The TempfileManager is used in the CachedOutputStream.java[1]. If you can provide your route, we can see if disable the stream cache[2] have any side effects on your route. [1]https://github.com/apache/camel/blob/master/core/camel-support/src/main/java/org/apache/camel/converter/stream/CachedOutpu