[
https://issues.apache.org/jira/browse/CAMEL-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guillaume Nodet updated CAMEL-23240:
------------------------------------
Description:
Add a new camel-bulk component that provides structured bulk processing for
collections of items.
Features:
- Configurable chunk sizes for processing large collections in manageable chunks
- Error thresholds: abort processing when failure ratio exceeds a configurable
limit
- Max failed records: abort after an absolute number of failures
- Multi-step pipelines with accept policies (ALL, NO_FAILURES, FAILURES_ONLY)
- Watermark tracking for resume-from-last-position capability (index-based and
value-based)
- Parallel processing support within chunks
- Aggregation strategies for combining results
- onComplete callback for post-processing notifications
- Producer-only component with URI format bulk:jobName[?options]
- Uses CamelBulk* header prefix to avoid collision with core Exchange.BATCH_*
headers
was:
Add a new camel-batch component that provides structured batch processing for
collections of items.
Features:
- Configurable chunk sizes for processing large collections in manageable
batches
- Error thresholds: abort processing when failure ratio exceeds a configurable
limit
- Watermark tracking for resume-from-last-position capability
- Parallel processing support
- Aggregation strategies for combining batch results
- Producer-only component with URI format batch:jobName[?options]
Summary: Add camel-bulk component for structured bulk processing (was:
Add camel-batch component for structured batch processing)
> Add camel-bulk component for structured bulk processing
> -------------------------------------------------------
>
> Key: CAMEL-23240
> URL: https://issues.apache.org/jira/browse/CAMEL-23240
> Project: Camel
> Issue Type: New Feature
> Reporter: Guillaume Nodet
> Assignee: Guillaume Nodet
> Priority: Major
> Fix For: 4.19.0
>
>
> Add a new camel-bulk component that provides structured bulk processing for
> collections of items.
> Features:
> - Configurable chunk sizes for processing large collections in manageable
> chunks
> - Error thresholds: abort processing when failure ratio exceeds a
> configurable limit
> - Max failed records: abort after an absolute number of failures
> - Multi-step pipelines with accept policies (ALL, NO_FAILURES, FAILURES_ONLY)
> - Watermark tracking for resume-from-last-position capability (index-based
> and value-based)
> - Parallel processing support within chunks
> - Aggregation strategies for combining results
> - onComplete callback for post-processing notifications
> - Producer-only component with URI format bulk:jobName[?options]
> - Uses CamelBulk* header prefix to avoid collision with core Exchange.BATCH_*
> headers
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
