Hello We are trying to read files using the following connector https://github.com/apache/camel-kafka-connector-examples/tree/main/sftp/sftp-source The connector send the whole file in one record to kafka which it is failing with big files
It is possible to override the apply method to convert the whole record into small batches? public R apply(R r) { We unsuccessfully tried a couple of thing but not luck Thanks in advance [Emails signature size.png] Sergio Meana Chief Quant Developer| Data Scientist DARK SECURITIES LTD Email smeana[@](mailto:mario.lebr...@bcssmz.org)darksecurities.com Tel +44 7732581034 This email and any files transmitted with it are confidential and may be privileged or otherwise protected from disclosure, and are intended solely for the use of the individual or entity to whom they are addressed. If you received this email in error please notify the sender immediately and permanently delete all copies of this email and its attachments from your system. Any unauthorised use, copying, distribution, or disclosure of this email and its attachments is prohibited; to the fullest extent permitted by law Dark Securities LTD does not accept any liability or responsibility with respect to any action taken by you in reliance on the contents of this email and its attachments.