davsclaus opened a new pull request, #28848: URL: https://github.com/apache/camel/pull/28848
https://issues.apache.org/jira/browse/CAMEL-26483 Four answers of the AI tools gave a wrong fix in the r25 run of the local-model benchmark (qwen3.6 35B on Ollama). Three of them came from the r24 changes (#28718, #28723). **A field of the body a pollEnrich replaced (route-enrich-and-dedupe step 2)** - After a pollEnrich of the customer file, the log read `${body[orderId]}`, a field of the order that the pollEnrich replaced. The answer said to add `unmarshal: json`. Two runs did that, lost the order and failed. - Now the answer says that the pollEnrich replaced the body, and gives the fix: `variableReceive: customer` on the pollEnrich, then `unmarshal: {json: {}, variableSend: customer, variableReceive: customer}`. - The fields of the JSON files decide whose field it is. The AI tools now also read the files of the directory that a pollEnrich or a poll reads. When the fields do not tell, both fixes are given. - A field read on the body that is a field of the file in a variable now points to that variable, such as `${variable.customer[name]}`. **A variable for ${property.x} (run-order-generator step 1)** - Asked to set a variable, the model wrote setProperty and `${property.orderId}`, followed the hint `${exchangeProperty.orderId}`, and failed. This happened in 3 runs of 8, and in r24 and r23. - The hint now says where the route keeps the value: `${variable.x}` for setVariable, `${header.x}` for setHeader. For setProperty, or when nothing sets the value, it adds that Camel keeps a value of the route in a variable. **An exception class with no key (contracts-openapi-server step 3)** - An exception class written as a bare line under onException was told to become a key with a value. - Under onException and doCatch, a class name now gets the two lines to write: `exception:` with the class as a list item. **No trigger note for noErrorHandler** - The note that an error handler acts only on an exception also showed on the noErrorHandler sample (7 answers). - The kind asked for decides now. **Tests** - camel-yaml-dsl-validator: 339 tests pass. - The AI tool tests in camel-jbang-core: 824 tests pass, with 1 skipped as before. - The reference files of the benchmark steps (85 files), and the routes of the 2137 passed steps of the r23 to r25 runs, get the same reports as before. 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_016Y4dDi5iQNgtHrDdz2NpwF -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
