kitalkuyo-gita commented on issue #280:
URL: https://github.com/apache/flink-agents/issues/280#issuecomment-3472227274
Hello, I have some questions about this requirement. Question: How to handle
the capability differences between different models?
Model Tool Calling JSON Mode Structured Output API
模型 | Tool Calling | JSON Mode | Structured Output API
-- | -- | -- | --
OpenAI GPT-4 | ✅ | ✅ | ✅ (response_format)
Anthropic Claude | ✅ | ⚠️ (beta) | ❌
Ollama (Qwen/Llama) | ✅ | ❓ | ❓
Tongyi Qwen | ✅ | ❓ | ❓
Question:
Is it necessary to implement a separate adaptation for each ChatModel?
Capability detection mechanism (runtime vs. configuration time)?
Degradation strategy (JSON mode failure → tool calling → prompt)?
Besides that, there's another problem. Semantic issues of using Tool Calling
for structured output
Question: Is it reasonable to use Tool Calling to implement structured
output? Technically feasible: Define a virtual tool named "formatoutput"
```
{
"name": "format_output",
"description": "Format the final response",
"parameters": OutputData.model_json_schema()
}
```
However, there are problems:
- Semantic ambiguity: The tool should "perform an action," not "format
output"
- User experience: This "virtual tool" will appear in the tools list
- Conflict with real tools: React Agent already has tool invocation
capabilities
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
