mirror of
https://github.com/NousResearch/hermes-agent.git
synced 2026-07-25 17:04:52 +00:00
4ee74fa5df
_build_call_kwargs omitted max_tokens for every provider except anthropic-compat endpoints and NVIDIA NIM. Gemini's native generateContent maps max_tokens -> maxOutputTokens and, when it is omitted, applies a fixed 65,535-token ceiling (not "the model's full budget"), so dropping the value made MoA's reference_max_tokens a silent no-op for gemini advisors — they ran effectively uncapped (observed ~2900 output tokens against a configured cap of 600), inflating per-turn MoA latency. Forward max_tokens for the gemini-native path (provider name or native base_url). Gemini supports maxOutputTokens, so the cap is safe here; providers that reject max_tokens (Copilot, GPT-5 max_completion_tokens, ZAI vision) are unaffected — they still omit it as before.
2 lines
27 B
Text
2 lines
27 B
Text
awain7
|
|
# PR #58261 salvage
|