Re: downloading large files in chunks

http://camel.apache.org/netty4-http.html Look at netty and see if that works. It can control chunk size but it is also streaming in any case so you may not even need to be concerned about it. Brad On Thu, Sep 1, 2016 at 8:53 PM, S Ahmed wrote: > Does it have to be ftp, I just need http? > > O

Re: downloading large files in chunks

Does it have to be ftp, I just need http? On Thu, Sep 1, 2016 at 5:31 PM, Quinn Stevenson wrote: > Check out the section on the ftp component page about “Using a Local Work > Directory” (http://people.apache.org/~dkulp/camel/ftp2.html < > http://people.apache.org/~dkulp/camel/ftp2.html>) - I thi

Re: Camel BeanIODataFormat Configure ErrorHandler for BeanIO Reader

By the way, I almost forgot to ask. How big are your input files? If they aren't enormous you can unmarshal the whole file in one gulp and if something is not right it will break right there without any processing. If it succeeds you simply iterate over the now unmarshaled beans. On Thu, Sep 1, 2

Re: Pulling multiple files in simultaneously

Would something like this work? I’m not sure how far you can push the concurrentConsumers for SEDA though. http://camel.apache.org/schema/spring";> 1000 1000 > On

Re: CXFRS swagger integration

The one on the Swagger site looked like it was putting together passable code and I didn't get into it in any depth. But it had a very distinct structure and lay out that I wouldn't use or like. It could be modified of course. I'll have to run it again and see what it looks like again. Brad On

Re: downloading large files in chunks

Check out the section on the ftp component page about “Using a Local Work Directory” (http://people.apache.org/~dkulp/camel/ftp2.html ) - I think that may be what you’re after. > On Sep 1, 2016, at 9:30 AM, S Ahmed wrote: > > Hello, > > Is th

Re: CXFRS swagger integration

I think the one available at the Swagger website is the only one, looks like it is pretty active. I'll ask one of CXF users to reply to this tread Sergey On 01/09/16 19:57, Brad Johnson wrote: As a related note, is there and Eclipse plugin or Java library that converts Swagger yml files into C

Re: Disabling concurrency in camel route

True enough. I've had to deal with that before by using an aggregator and assigning sequential numbers to the records as they go through and the aggregate the results. Obviously that won't work if the records have to be processed in the exact order they come in and not just written out in the sam

Re: Disabling concurrency in camel route

True enough. I used a resequencer to make sure they went in and out. ${body} exchangeProperty.CamelSplitIndex ... in.header.seqnum On Thu, Sep 1, 2016 at 2:08 PM, Quinn Stevenson wrote: > I’d be careful with configuring the number of consumers on the SEDA queue > if you need to pres

Re: Disabling concurrency in camel route

I’d be careful with configuring the number of consumers on the SEDA queue if you need to preserve order - you’ll likely get stuff processed out-of-order. > On Sep 1, 2016, at 1:00 PM, Brad Johnson wrote: > > I'd second what Quinn said. The other nice thing about the SEDA queue is > you can di

Re: Exception when suspending splitter

I don’t know if split supports suspend/resume - I think it would have to be the underlying component (in this case the file component). Also, I believe suspend/resume is for a route or a context - not an exchange. I think the route is trying to complete the current exchange (i.e. the current f

RE: First time create SFTP File and then Append to same in loop.

Yes. Deleting the file is one option. Really a hack in my opinion. Also, it is SFTP and lot of customers protect SFTP folders by not allowing Delete of files and only write/override of file data. Dynamic URI concept was known to me I forgot. Thanks Claus. Regards, Arpit. -Original Mes

Re: Disabling concurrency in camel route

I'd second what Quinn said. The other nice thing about the SEDA queue is you can directly configure the number of threads that are consuming from it. On Thu, Sep 1, 2016 at 1:50 PM, Quinn Stevenson wrote: > When I’ve hit situations like this, I’ve used the SEDA component to > serialize the proc

Re: CXFRS swagger integration

As a related note, is there and Eclipse plugin or Java library that converts Swagger yml files into CXF interfaces and data models. I find myself in situations lately where it is more likely that I'm being given a swagger file rather than creating one. But the Java generator on the website for Sw

Re: Disabling concurrency in camel route

When I’ve hit situations like this, I’ve used the SEDA component to serialize the processing after the message was received. All of the processing winds up in the SEDA route, and the actual receiving route (in this case, from Netty) just calls the SEDA route. Something like

Re: Karaf - org.apache.camel.RuntimeCamelException: java.lang.IllegalArgumentException: Cannot find RouteContext with id "routes-id"

Ok!, I packaged all xmls in bundle jar and that worked. -- View this message in context: http://camel.465427.n5.nabble.com/Karaf-org-apache-camel-RuntimeCamelException-java-lang-IllegalArgumentException-Cannot-find-RouteCon-tp5787066p5787102.html Sent from the Camel - Users mailing list archi

Re: Camel BeanIODataFormat Configure ErrorHandler for BeanIO Reader

If that works then great. If you want to reject the file you'll likely have to run the file twice. The first for validation and the second for processing. Remember if you're streaming these and processing them and then get a bad record like the one with the missing field, you've already processe

Re: CXFRS swagger integration

Hi On 31/08/16 20:46, cacert wrote: Hi Sergey, After setting this property I can see swagger.json is generated but still can not see swagger ui when I follow the link. when I list my restfull services it prints: Endpoint address: http://localhost:8080/api/rest Swagger : http://localhost:8080/a

Camel Kafka Component

I am trying to find more information on Camel Kafka component. There seems to be just one page on the web regarding this component and is not very well documented. I have two specific questions. 1. When the message comes in, there should be associated acknowledgment associated with the message

RE: downloading large files in chunks

Hello, Is there an example of how to download a large file in chunks and save the file as the file downloads. The goal is not to hold the entire file in memory and then save it to disk. Thanks.

Re: Split EIP not using defined thread pool size

Hi, thanks for this information...this means i can "stack" thread pools I think that fact should be in the documentation as an example how NOT to do it?! ;) Best regards -- View this message in context: http://camel.465427.n5.nabble.com/Split-EIP-not-using-defined-thread-pool-size-tp5787075

Re: First time create SFTP File and then Append to same in loop.

Why don't you have append as Claus suggested but include a bean at the end of the route which deletes the file? You don't need to then change the uri configuration or any looping. On Wed, Aug 31, 2016 at 7:23 PM, Goyal, Arpit [via Camel] < ml-node+s465427n5787068...@n5.nabble.com> wrote: > Hi Cla

Re: Split EIP not using defined thread pool size

You are using 2 x thread pools, the parallel processing from splitter, and then a 2nd threads. Configure this only on the splitter with the executorServiceRef http://camel.apache.org/splitter And read the thread pool docs http://camel.apache.org/threading-model.html And if you have Camel in Acti

Re: First time create SFTP File and then Append to same in loop.

See this FAQ about dynamic to http://camel.apache.org/how-to-use-a-dynamic-uri-in-to.html On Wed, Aug 31, 2016 at 7:22 PM, Goyal, Arpit wrote: > Hi Clause, > > The problem is -- First time execution creates the file and in loop appends > the data. Now the process ends and file is available at SF

Re: Karaf - org.apache.camel.RuntimeCamelException: java.lang.IllegalArgumentException: Cannot find RouteContext with id "routes-id"

Your xml files must be in the same bundle. On Wed, Aug 31, 2016 at 6:25 PM, pthotapalle wrote: > Hi, > > I am using my camel routes on Karaf. Tried to keep routes in separate bundle > (just xmls in deploy folder) and tied them with in main > mycamelcontext.xml > > Here are my files look like.

Re: 2.18-SNAPSHOT download assistance

Hello Scott, Camel 2.18.0 should be released by the end of September. Cheers, Andrea -- Andrea Cosentino -- Apache Camel PMC Member Apache Karaf Committer Apache Servicemix Committer Email: ancosen1...@yahoo.com Twitter: @oscerd2 Github: oscerd On Thursday, Se

Re: Camel BeanIODataFormat Configure ErrorHandler for BeanIO Reader

Hello Brad, Here is an expected file (simplified down for discussion) "FHDR","1","t","20160" "LFHDR","p","4","2016" "TRNSFRREQ","p","2","A","4","U","a" "LFTRLR","p","1","4" "FTRLR","5","4" When a user sends in a bad file (2 FHDR files) I want to reject the file. "FHDR","1","t","20160" "FHDR","1"

Re: CXFRS swagger integration

Hi Sergey, After setting this property I can see swagger.json is generated but still can not see swagger ui when I follow the link. when I list my restfull services it prints: Endpoint address: http://localhost:8080/api/rest Swagger : http://localhost:8080/api/rest/api-docs?url=/api/rest/swagger

Karaf - org.apache.camel.RuntimeCamelException: java.lang.IllegalArgumentException: Cannot find RouteContext with id "routes-id"

Hi, I am using my camel routes on Karaf. Tried to keep routes in separate bundle (just xmls in deploy folder) and tied them with in main mycamelcontext.xml Here are my files look like. *mycamelcontext.xml* http://www.springframework.org/schema/beans"; xmlns:xsi="http://www.w3.org/2001

Re: 2.18-SNAPSHOT download assistance

Hello Claus, Thanks for the information, I was able to put that version into my POM and it pulled it down. Would you happen to know when this becomes a release? Just looking for a time-frame. Thanks Scott -- View this message in context: http://camel.465427.n5.nabble.com/2-18-SNAPSHOT-downloa