Re: How to read data from a paginated API and upload it as multipart file to S3 page by page

2023-08-04 Thread Federico Mariani
Hi Sahil, I already replied in zulip chat, but you can start with the following snippet: from("direct:upload") .loopDoWhile(simple("${body} != '[]'")) .choice() .when(simple("${exchangeProperty.CamelLoopIndex} > 0")) // API page start from 1

Re: How to read data from a paginated API and upload it as multipart file to S3 page by page

2023-08-04 Thread Sahil Upneja
Hi Ralf, Thanks for your Response. Sorry I could not understand much as I am very new to camel. Can you please share some article or code snippet (a small example) which is implementing something like this. That will be really a great help. Thanks in advance Regards Sahil On Tue, Aug 1, 2023

Re: How to read data from a paginated API and upload it as multipart file to S3 page by page

2023-07-31 Thread Claussnitzer, Ralf
Hi Sahil, as far as I know the HTTP producer does not support polling based on headers. You could trigger the individual HTTP requests by using sort of an event loop: Event/Message driven consumer route (direct or jms) that makes the actual request and emits a follow-up event for the next page ba

How to read data from a paginated API and upload it as multipart file to S3 page by page

2023-07-31 Thread Sahil Upneja
Hi Everyone ! I am trying to read data from a paginated API , Since the whole data is huge so I want to read one page from paginated API and upload it as multipart file to S3 and then read 2nd page & upload it to S3 and so on. Could you please let me know if this usecase is achievable through Cam