mirrors/hermes-agent
1
0
Fork 0
mirror of https://github.com/NousResearch/hermes-agent.git synced 2026-04-25 00:51:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: add ctx_size to context length keys for Lemonade server support

Browse source 
- Adds 'ctx_size' field to _CONTEXT_LENGTH_KEYS tuple
- Enables hermes agent to correctly detect context size from custom LLMs
  running on Lemonade server that use this field name instead of the
  standard keys (max_seq_len, n_ctx_train, n_ctx)
This commit is contained in:
Clifford Garwood 2026-04-12 14:13:02 -04:00 • committed by Teknium
parent 12f9f10f0f
commit 27621ef836
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
agent/model_metadata.py
View file

@ -203,6 +203,7 @@ _CONTEXT_LENGTH_KEYS = (
"max_seq_len",
"n_ctx_train",
"n_ctx",
"ctx_size",
)
_MAX_COMPLETION_KEYS = (