davsclaus opened a new pull request, #3172: URL: https://github.com/apache/camel-kamelets/pull/3172
Part of #3170: `aws-kinesis-source` can choose where in the stream it starts reading. Today it always starts at the oldest record the stream keeps (`TRIM_HORIZON`), so it reads the whole stream again each time the integration starts. ### New options | Option | What it does | |---|---| | `iteratorType` | Where it starts reading: `TRIM_HORIZON` (default, today's behaviour), `LATEST`, `AT_SEQUENCE_NUMBER`, `AFTER_SEQUENCE_NUMBER` or `AT_TIMESTAMP` | | `sequenceNumber` | Required for, and used only by, the two sequence-number types | | `messageTimestamp` | Required for, and used only by, `AT_TIMESTAMP`. Takes an ISO 8601 UTC time such as `2026-11-17T08:00:00Z`, or milliseconds since 1970 | ### Descriptions - The "Good to know" paragraph says the start position applies again on every start: it is not remembered across restarts. - With `LATEST`, the records written while the integration was stopped are not read. - The KCL consumer (`useKclConsumers`) keeps its position in DynamoDB and ignores `iteratorType`. This comes from reading the component source, not from a run. - The partial page has a new section, "Where it starts reading". ### Verification Tested against the `floci/floci` AWS stand-in. The stream `s3170` held `old-1`, `old-2` and `old-3`, and a new record was added after the route started. | Case | Records read | |---|---| | Options unset | `old-1`, `old-2`, `old-3` (as before) | | `LATEST` | Only the new record | | `AT_SEQUENCE_NUMBER`, the sequence number of `old-2` | `old-2`, `old-3`, the new record | | `AFTER_SEQUENCE_NUMBER`, the same sequence number | `old-3`, the new record | | `AT_TIMESTAMP`, ISO time and then milliseconds | Only the new record, with both formats | | `AT_SEQUENCE_NUMBER` without `sequenceNumber` | The route does not start: "Sequence Number must be specified ..." | `./mvnw clean install` passed twice, the first time with `-DskipTests`. _Claude Code on behalf of Claus Ibsen_ 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
