yrenat opened a new issue, #9119:
URL: https://github.com/apache/texera/issues/9119

   ### What happened?
   
   The agent does not see the result of its earlier tool calls. When a call 
fails, the agent does not know why, so it makes the same call again and again.
   
   In `agent-service/src/agent/util/context-utils.ts`, `serializeTask` writes 
each past tool call as one line:
   
   ```ts
   lines.push(`- ${tc.toolName} (${statusAttr})`);
   ```
   
   It only writes the tool name. The system prompt (`prompts.ts`) says each 
call should also have `Summary`, `Output`, or `Error` lines, but these lines 
are never added.
   
   Example on `main` with claude-haiku-4.5. Prompt: "Add a Limit operator that 
keeps 10 rows, and connect its input to the existing operator op7." (there is 
no op7). Every call returned `[ERROR] Source operator "op7" not found`. The 
agent made the same `modifyOperator` call 5 times until it hit the step limit. 
At turn 3, the agent got this context:
   
   ```
   ### Turn 1
   Thought: I'll add a Limit operator that keeps 10 rows and connect it to op7.
   - addOperator (succeeded)
   
   ### Turn 2
   Thought: I can see that you've already successfully added the Limit operator 
`op8` ...
   - modifyOperator (succeeded)
   ```
   
   The error message is not there.
   
   Expected: each tool call in the history should include its summary and 
output, or the error message if it failed.
   
   **Screenshots**
   
   Step 1, tool call: addOperator returned `[ERROR] Source operator "op7" not 
found`.
   
   
![A-step1-toolcall.png](https://raw.githubusercontent.com/yrenat/texera/agent-bug-screenshots/A-step1-toolcall.png)
   
   Step 3, what the agent was given: Turn 1 and Turn 2 only say `(succeeded)`. 
There is no error text.
   
   
![A-step3-context.png](https://raw.githubusercontent.com/yrenat/texera/agent-bug-screenshots/A-step3-context.png)
   
   The chat: the agent says "Let me connect it to op7" again and again, until 
the step limit (5).
   
   
![A-workspace.png](https://raw.githubusercontent.com/yrenat/texera/agent-bug-screenshots/A-workspace.png)
   
   ### How to reproduce?
   
   1. Open an empty workflow and create an agent.
   2. Send: `Add a Limit operator that keeps 10 rows, and connect its input to 
the existing operator op7.`
   3. Click "View details" on a later step and look at Input Messages. Past 
calls show only `- <tool> (succeeded)`, with no error text. The agent keeps 
repeating the call.
   
   ### Version/Branch
   
   1.4.0-incubating-SNAPSHOT (main)
   
   ### Commit Hash (Optional)
   
   57faa6b
   
   ### What browsers are you seeing the problem on?
   
   Chrome
   
   ### Relevant log output
   
   ```shell
   agent-service/src/agent/util/context-utils.ts:119-133  serializeTask
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to