Soju06 7b3dcee928 feat(cache): persist the exact bytes sent to the API in an api_content sidecar ... The first LLM call of every gateway turn gets ~0% provider prompt-cache hit rate (in-turn calls: 97-99%) because the bytes sent for a turn's user message are not the bytes replayed next turn: memory-prefetch and pre_llm_call context are injected into the API copy only, the #48677 persist override writes cleaned content to the DB row, and get_messages_as_conversation sanitize/strips user and assistant content on load. Any of these diverges the request prefix at that message and re-prefills everything after it — measured 27.9s for the first call vs 2.4-5.8s cached at a median ~156k-token context. Persist what you send: a nullable messages.api_content column stores the exact content string sent to the API when it differs from the clean stored content, and replay substitutes it verbatim (no sanitize, no strip). The injection composition lives in one helper (turn_context.compose_user_api_content); the turn prologue stamps its output onto the live user message, the api_messages build sends the stamped bytes, and every outgoing copy pops the field so it never reaches a provider. The crash-resilience user-turn persist moves after prefetch/pre_llm_call so the user row is written once with its final sidecar; _ensure_db_session stays before preflight compression (session rotation needs the parent row under PRAGMA foreign_keys=ON). The current-turn index trackers are re-anchored after compaction rebuilds the message list, in-place preflight compaction backfills the stamp onto the already-inserted row, and gateway replay forwards the sidecar only when the replay pipeline did not rewrite the content. Rewrite paths that would leave stale bytes (historical image strip, merge-summary-into- tail, consecutive-user repair merge, stale-confirmation redaction) drop the sidecar; the chat-completions transport and the max-iterations summary path strip it defensively. codex_app_server and MoA turns are excluded from stamping because their wire bytes differ from the composition. A missing or dropped sidecar degrades to today's behavior (one cache-boundary miss), never to wrong content.		2026-07-19 08:25:35 +05:30
..
lsp	refactor(setup): route dependency installs through the canonical uv→pip→ensurepip ladder	2026-07-07 04:09:35 -07:00
pet	fix: remove dead f-string prefixes via ruff F541 (216 sites) (#52336)	2026-07-05 13:42:46 -07:00
secret_sources	feat(secrets): adapt 1Password onto the SecretSource interface	2026-07-06 04:58:07 -07:00
transports	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
__init__.py	fix(agent): preload jiter native parser	2026-05-28 00:20:11 -07:00
account_usage.py	feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)	2026-07-18 14:30:24 +05:30
agent_init.py	fix(streaming): fence superseded streams out of the delta sink (single-writer)	2026-07-17 06:49:23 -07:00
agent_runtime_helpers.py	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
anthropic_adapter.py	fix(auxiliary): apply review fixes to #36043 — guard named-custom routing, drop dead key assignment, tighten Palantir host match	2026-07-16 07:28:07 -07:00
async_utils.py	refactor(gateway): dedupe detached-task consumer + reconnect backoff policy	2026-07-18 20:01:55 +05:30
aux_accounting.py	feat(analytics): record auxiliary model usage per task in session accounting (#65537)	2026-07-16 04:23:12 -07:00
auxiliary_client.py	fix(auxiliary): resolve key_env in _resolve_task_provider_model (#66641)	2026-07-18 19:03:51 -04:00
azure_identity_adapter.py	feat(azure-foundry): add Microsoft Entra ID auth	2026-05-18 10:14:38 -07:00
background_review.py	fix(background_review): gate reasoning_config inheritance on not-routed + dedupe recorder stubs	2026-07-14 17:19:46 +05:30
bedrock_adapter.py	fix(streaming): Bedrock liveness watchdog (into #58962 breaker) + finite local timeout	2026-07-18 19:38:21 +05:30
billing_usage.py	feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)	2026-07-18 14:30:24 +05:30
billing_view.py	feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)	2026-07-18 14:30:24 +05:30
bounded_response.py	fix(agents): bound streaming error-response body reads	2026-07-05 14:00:20 -07:00
browser_provider.py	fix(browser): self-review pass — dead-import, log levels, future-proofing	2026-05-17 04:04:15 -07:00
browser_registry.py	style: restore PEP8 blank-line separation after dead-code removal	2026-05-29 04:22:27 -07:00
chat_completion_helpers.py	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
codex_responses_adapter.py	fix(agent): treat Codex incomplete content filter as refusal	2026-07-15 09:47:37 -07:00
codex_runtime.py	feat(codex): stream live app-server events to TUI/desktop tool cards	2026-07-17 13:44:12 -07:00
coding_context.py	test: deflake CI and dev-machine flaky tests in bulk (11 tests, 10 files) (#61816)	2026-07-09 20:03:11 -07:00
context_breakdown.py	feat(desktop): add context usage breakdown popover	2026-06-29 09:18:10 -04:00
context_compressor.py	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
context_engine.py	fix(context): clamp -1 post-compression sentinel in sibling status paths	2026-07-01 13:36:50 +05:30
context_references.py	fix(security): anchor @file context refs to canonical read deny-list	2026-07-01 02:43:49 -07:00
conversation_compression.py	fix(context): persist fallback compaction breaker	2026-07-14 02:19:40 +05:30
conversation_loop.py	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
copilot_acp_client.py	fix(file-safety): distinguish safe-root write denial from credential blocks	2026-07-14 17:09:40 +05:30
credential_persistence.py	feat(auth): make xAI Grok OAuth device-code-only, drop loopback login	2026-07-02 13:17:41 -07:00
credential_pool.py	perf: fast model picker + dialogs — config-load hot path, model.options off the reader thread, off-screen turns skip rendering	2026-07-17 15:01:54 -04:00
credential_sources.py	feat(auth): make xAI Grok OAuth device-code-only, drop loopback login	2026-07-02 13:17:41 -07:00
credits_tracker.py	feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)	2026-07-18 14:30:24 +05:30
curator.py	fix(runtime): preserve resolved fork metadata	2026-07-10 18:32:32 +05:30
curator_backup.py	fix(cron): widen UTF-8 BOM tolerance to backup/curator jobs.json readers	2026-07-18 02:31:20 -07:00
display.py	feat(gateway): live per-tool status line on Slack	2026-07-18 12:28:59 -07:00
error_classifier.py	fix(error_classifier): stop empty-response advisories from triggering compression	2026-07-18 12:54:58 -07:00
errors.py	fix(moa): surface stale presets without retries	2026-07-17 13:49:12 -07:00
file_safety.py	Inspired by Claude Code: protect session transcripts	2026-07-17 04:54:34 -07:00
gemini_native_adapter.py	feat(gemini): improve request context for support and compatibility	2026-07-13 22:26:19 -07:00
gemini_schema.py	fix(gemini): prune required entries missing from properties in tool schemas	2026-07-17 04:54:06 -07:00
i18n.py	fix(packaging): ship locales/ i18n catalogs in wheel, sdist, and Nix (#38383)	2026-06-03 12:00:27 -07:00
image_gen_provider.py	feat(image-gen): add image-to-image / editing to image_generate (#48705)	2026-06-18 22:13:07 -07:00
image_gen_registry.py	fix(plugins): filter resolution by is_available() in web + image_gen registries	2026-05-13 22:31:28 -07:00
image_routing.py	fix(auxiliary): scope runtime state to each turn	2026-07-17 09:08:30 -07:00
insights.py	fix(insights): include auxiliary usage in overview token totals (#65603)	2026-07-16 05:39:33 -07:00
iteration_budget.py	refactor(run_agent): extract OpenAI proxy, safe stdio, IterationBudget	2026-05-16 17:59:32 -07:00
jiter_preload.py	fix(agent): preload jiter native parser	2026-05-28 00:20:11 -07:00
kanban_stop.py	follow-up: integrate agent nudge + dispatcher retry docs and tests	2026-07-14 16:47:33 +05:30
learn_prompt.py	fix(learn): honor requirements mixed with sources in /learn requests (#55956)	2026-06-30 16:56:01 -07:00
learning_graph.py	fix(learning_graph): guard non-dict metadata so /journey can't crash	2026-07-01 16:25:48 -05:00
learning_graph_render.py	fix: cover remaining GNU-only %-d strftime site in learning graph render	2026-07-05 00:59:35 -07:00
learning_mutations.py	refactor(journey): route memory mutations through MemoryStore atomic I/O	2026-06-30 15:16:21 -05:00
lmstudio_reasoning.py	fix(lmstudio): clamp max/ultra reasoning effort to LM Studio's ceiling	2026-07-16 07:57:51 -07:00
manual_compression_feedback.py	fix(context): harden compression failure feedback	2026-07-16 14:34:03 +05:30
markdown_tables.py	fix(cli): vertical fallback for markdown tables wider than terminal (#23948)	2026-05-11 16:49:13 -07:00
memory_manager.py	fix(memory): drain queued writes on shutdown	2026-07-17 04:55:58 -07:00
memory_provider.py	fix(backup): capture memory-provider state stored outside HERMES_HOME (#50325)	2026-06-21 12:03:46 -07:00
message_content.py	fix(openviking): preserve structured sync attribution	2026-06-19 15:23:41 +08:00
message_sanitization.py	fix(agent): close tool-call sequence on all interrupt aborts, not just finalize_turn	2026-06-25 12:24:34 -05:00
moa_loop.py	feat(portal): ambient conversation context entangles aux/MoA/delegate calls	2026-07-16 01:13:43 -07:00
moa_trace.py	fix(moa): capture streamed aggregator output into full-turn traces (#56312)	2026-07-01 04:07:46 -07:00
model_metadata.py	feat(kimi): discover K3 on coding endpoint	2026-07-16 13:33:02 -07:00
models_dev.py	remove Vercel AI Gateway and Vercel Sandbox (#33067)	2026-05-27 00:43:32 -07:00
moonshot_schema.py	fix(moonshot): handle union type arrays in tool schemas	2026-06-13 05:51:41 -07:00
nous_rate_guard.py	codebase: add encoding='utf-8' to all bare open() calls (PLW1514)	2026-05-08 14:27:40 -07:00
onboarding.py	fix(config): close unreadable-overwrite bug class at a single chokepoint	2026-07-05 23:00:34 +05:30
oneshot.py	feat(agent): one-shot LLM helper + llm.oneshot gateway RPC (#51261)	2026-06-23 08:01:50 +00:00
plugin_llm.py	feat(plugins): run any LLM call from inside a plugin via ctx.llm (#23194)	2026-05-10 07:09:28 -07:00
portal_tags.py	feat(portal): ambient conversation context entangles aux/MoA/delegate calls	2026-07-16 01:13:43 -07:00
process_bootstrap.py	fix(agent): apply pool-level keepalive to the process_bootstrap sibling builder	2026-07-05 03:14:55 -07:00
prompt_builder.py	feat(computer_use): follow cua-driver's verify → escalate ladder (#67123)	2026-07-18 13:59:35 -07:00
prompt_caching.py	refactor(salvage): scope #40632 to the two live copy-on-write sites	2026-07-09 14:35:14 +05:30
rate_limit_tracker.py	refactor: remove dead code — 1,784 lines across 77 files (#9180)	2026-04-13 16:32:04 -07:00
reactions.py	feat(agent): core affection reaction detector + reaction_callback	2026-07-10 05:41:59 -05:00
reasoning_timeouts.py	fix(reasoning): add deepseek-v4-flash and deepseek-v4-pro to reasoning timeout floor	2026-07-09 15:04:14 +05:30
redact.py	fix(redact): skip env-lookup exception for JSON/YAML config field redaction	2026-07-05 13:58:19 -07:00
replay_cleanup.py	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
retry_utils.py	refactor(retry): single-source Z.AI overload short-attempts + drop change-detector assert	2026-07-07 11:57:01 +05:30
runtime_cwd.py	fix(agent): scope install-tree guard to fallback-picked cwds, allow cli/tui in-tree dev	2026-07-16 04:32:23 -07:00
secret_scope.py	feat(gateway): multiplex phase 2 — fail-closed profile credential isolation (Workstream A)	2026-06-19 07:34:15 -07:00
shell_hooks.py	fix(cli): safe mode also skips shell-hook registration	2026-07-07 02:32:32 -07:00
skill_bundles.py	fix(gateway): apply platform-disabled skill gate to bundle invocations (#59156)	2026-07-05 14:48:11 -07:00
skill_commands.py	fix(skills): guard skill slash commands against core-command and slug collisions	2026-07-14 16:41:21 +05:30
skill_preprocessing.py	fix(windows): hide console-window flash on backend git/gh/wmic/bash subprocess spawns	2026-06-28 05:28:45 -07:00
skill_utils.py	fix(skills): strip UTF-8 BOM before parsing SKILL.md frontmatter	2026-07-17 04:52:02 -07:00
ssl_guard.py	fix(ssl): align guard docs and escape hatch	2026-06-13 21:14:32 -07:00
ssl_verify.py	fix(agent): honor custom CA certs on aux client + harden TLS resolution	2026-07-02 04:51:56 +05:30
stream_diag.py	feat(agent): buffer retry/fallback status, surface only on terminal failure (#33816)	2026-05-28 04:53:27 -07:00
stream_single_writer.py	fix(streaming): make the single-writer fence best-effort so a missing guard can't crash a turn (#66448)	2026-07-17 18:31:09 +00:00
subdirectory_hints.py	fix(subdirectory_hints): catch RuntimeError from Path.expanduser()	2026-07-01 04:55:15 -07:00
subscription_view.py	feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)	2026-07-18 14:30:24 +05:30
system_prompt.py	fix: replace hardcoded ~/.hermes with get_hermes_home() in system prompt (#66450)	2026-07-18 19:03:51 -04:00
think_scrubber.py	fix(agent): re-arm think scrubber boundary after stream flush	2026-07-16 01:07:29 +05:30
thinking_timeout_guidance.py	fix(agent): detect thinking-timeout for reasoning models and surface actionable guidance instead of misleading file-write advice	2026-06-25 19:00:48 -07:00
thread_scoped_output.py	fix(bg-review): scope stdout/stderr silencing to the worker thread (#55966)	2026-06-30 17:28:33 -07:00
title_generator.py	fix(title): prevent stale background title generation from reloading unloaded Ollama models	2026-07-16 23:07:13 -07:00
tool_dispatch_helpers.py	fix(agent): canonicalise paths in parallel-batch planner to prevent same-file concurrent mutation	2026-07-16 04:26:32 -07:00
tool_executor.py	fix(agent): canonicalise paths in parallel-batch planner to prevent same-file concurrent mutation	2026-07-16 04:26:32 -07:00
tool_guardrails.py	fix(agent): tolerate lone UTF-16 surrogates in tool-guardrail hashing	2026-07-18 02:08:39 -07:00
tool_result_classification.py	fix(agent): preserve none vs unknown tool effects (#61783)	2026-07-11 05:41:58 -07:00
trace_upload.py	feat(sessions): trace export + HF upload via 'sessions export --format trace' (#60507)	2026-07-07 15:12:49 -07:00
trajectory.py	Refactor Terminal and AIAgent cleanup	2026-02-21 22:31:43 -08:00
transcription_provider.py	feat(stt): add register_transcription_provider() plugin hook	2026-05-25 01:41:19 -07:00
transcription_registry.py	fix(deepinfra): harden multimodal provider routing	2026-07-14 02:59:39 +05:30
tts_provider.py	feat(tts): add register_tts_provider() plugin hook (closes #30398)	2026-05-24 18:04:54 -07:00
tts_registry.py	feat(providers): Support DeepInfra as an LLM provider	2026-07-14 02:59:39 +05:30
turn_context.py	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
turn_finalizer.py	refactor(turn_finalizer): extract _is_pure_tool_call_tail, fix SQLite durability	2026-07-19 07:27:10 +05:30
turn_retry_state.py	feat(vertex): add Google Vertex AI provider for Gemini (OAuth2)	2026-07-01 05:25:33 -07:00
usage_pricing.py	fix(usage): read DeepSeek's native prompt_cache_hit_tokens cache field (#65678)	2026-07-16 07:29:53 -07:00
verification_evidence.py	feat(agent): recognize focused ad-hoc verification scripts	2026-06-24 23:03:45 -05:00
verification_stop.py	fix(approval): allow verifier temp cleanup	2026-07-12 04:32:52 -07:00
verify_hooks.py	feat(agent): add pre_verify hook and verify-on-stop coding guidance	2026-06-30 00:59:29 -05:00
vertex_adapter.py	security(vertex): route credential/project/region resolution through the profile secret scope	2026-07-02 06:07:56 +05:30
video_gen_provider.py	feat(providers): Support DeepInfra as an LLM provider	2026-07-14 02:59:39 +05:30
video_gen_registry.py	fix(deepinfra): harden multimodal provider routing	2026-07-14 02:59:39 +05:30
web_search_provider.py	fix(web): widen config-aware env resolution to exa/parallel/tavily/brave-free providers	2026-07-06 02:42:24 -07:00
web_search_registry.py	fix(web): correct 'disabled plugin' diagnosis for web backends (#59573)	2026-07-06 04:38:17 -07:00