Soju06 7b3dcee928 feat(cache): persist the exact bytes sent to the API in an api_content sidecar ... The first LLM call of every gateway turn gets ~0% provider prompt-cache hit rate (in-turn calls: 97-99%) because the bytes sent for a turn's user message are not the bytes replayed next turn: memory-prefetch and pre_llm_call context are injected into the API copy only, the #48677 persist override writes cleaned content to the DB row, and get_messages_as_conversation sanitize/strips user and assistant content on load. Any of these diverges the request prefix at that message and re-prefills everything after it — measured 27.9s for the first call vs 2.4-5.8s cached at a median ~156k-token context. Persist what you send: a nullable messages.api_content column stores the exact content string sent to the API when it differs from the clean stored content, and replay substitutes it verbatim (no sanitize, no strip). The injection composition lives in one helper (turn_context.compose_user_api_content); the turn prologue stamps its output onto the live user message, the api_messages build sends the stamped bytes, and every outgoing copy pops the field so it never reaches a provider. The crash-resilience user-turn persist moves after prefetch/pre_llm_call so the user row is written once with its final sidecar; _ensure_db_session stays before preflight compression (session rotation needs the parent row under PRAGMA foreign_keys=ON). The current-turn index trackers are re-anchored after compaction rebuilds the message list, in-place preflight compaction backfills the stamp onto the already-inserted row, and gateway replay forwards the sidecar only when the replay pipeline did not rewrite the content. Rewrite paths that would leave stale bytes (historical image strip, merge-summary-into- tail, consecutive-user repair merge, stale-confirmation redaction) drop the sidecar; the chat-completions transport and the max-iterations summary path strip it defensively. codex_app_server and MoA turns are excluded from stamping because their wire bytes differ from the composition. A missing or dropped sidecar degrades to today's behavior (one cache-boundary miss), never to wrong content.		2026-07-19 08:25:35 +05:30
..
acp	fix(titles): use active runtime for gateway sessions	2026-07-16 22:54:09 -07:00
acp_adapter
agent	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
ci	feat(ci): semantic package-lock.json diff as an upserted PR comment (#65206)	2026-07-16 03:18:15 +00:00
cli	test: stub discover_local_cdp_url in CLI connect context-note test	2026-07-18 02:49:28 -07:00
computer_use	fix(computer-use): sanitize env on the 4 remaining cua-driver spawn sites (#59165)	2026-07-05 14:48:20 -07:00
cron	fix(cron): accept UTF-8 BOM when reading jobs.json	2026-07-18 02:31:20 -07:00
dashboard	fix(dashboard): use loopback host for in-container WebSocket client (#58993) [salvage #59682] (#60092)	2026-07-07 18:33:28 +10:00
docker	test(docker): cover tini -g legacy entrypoint boot path	2026-07-18 01:11:03 -07:00
e2e	test(e2e): stub reset-notice session info to deflake test_new_resets_session (#60175)	2026-07-07 04:28:12 -07:00
fakes
fixtures/plugins/example-dashboard/dashboard
gateway	feat(cache): persist the exact bytes sent to the API in an api_content sidecar	2026-07-19 08:25:35 +05:30
hermes_cli	perf(desktop): batch sidebar session slices into one profile-DB pass	2026-07-18 21:45:18 -04:00
hermes_state	fix(state): heal alternation at the ACP / CLI-resume / TUI-resume restore sites too	2026-07-17 06:53:38 -07:00
honcho_plugin	fix(ci): make tests, workflows, and attribution reliable under load (#66373)	2026-07-17 20:55:24 +00:00
integration	fix: remove dead f-string prefixes via ruff F541 (216 sites) (#52336)	2026-07-05 13:42:46 -07:00
manual	docs(cron): scope in_channel to channels; document DM continuation knob	2026-07-01 03:16:13 -07:00
openviking_plugin	feat(openviking): add full recall prefetch policy	2026-06-24 18:53:49 +05:30
plugins	fix(mem0): migrate legacy OSS base URL aliases	2026-07-17 13:49:29 -07:00
providers	init	2026-07-16 01:13:43 -07:00
run_agent	fix(agent): request-local Anthropic clients so the stale/interrupt watchdog never corrupts SQLite (#67142)	2026-07-18 21:20:48 -04:00
scripts	fix(ci): make tests, workflows, and attribution reliable under load (#66373)	2026-07-17 20:55:24 +00:00
secret_sources	feat(secrets): adapt 1Password onto the SecretSource interface	2026-07-06 04:58:07 -07:00
skills	chore(skills/mcp-oauth-remote-gateway): move to optional-skills + modernize	2026-07-16 01:28:32 -07:00
state	fix(state): self-heal FTS corruption on the SessionDB write path (#66296)	2026-07-17 08:51:51 -07:00
stress	fix: remove dead f-string prefixes via ruff F541 (216 sites) (#52336)	2026-07-05 13:42:46 -07:00
tools	test(mcp): e2e integration coverage for #63892 poll-loop OOM spin	2026-07-18 18:49:56 -04:00
tui_gateway	perf(gateway): serve session.resume's model + display history from one SELECT	2026-07-18 21:50:26 -04:00
website
__init__.py
conftest.py	fix(ci): make tests, workflows, and attribution reliable under load (#66373)	2026-07-17 20:55:24 +00:00
run_interrupt_test.py
test_account_usage.py
test_atomic_replace_symlinks.py	fix(config): preserve owner on atomic writes (#56644)	2026-07-03 14:27:34 +10:00
test_background_review_list_shapes.py	fix(background-review): guard summarize against list-shaped tool responses (#59437)	2026-07-06 03:28:30 -07:00
test_background_review_session_isolation.py	test(review): add integration guards for the two isolation wirings (review)	2026-07-01 16:21:39 +05:30
test_base_url_hostname.py
test_batch_runner_checkpoint.py
test_bitwarden_secrets.py	feat(secrets): pluggable SecretSource interface + multi-source orchestrator	2026-07-06 04:58:07 -07:00
test_cli_file_drop.py
test_cli_manual_compress.py
test_cli_skin_integration.py
test_code_skew.py	fix(gateway): refuse model switch on stale checkout to avoid env_float ImportError	2026-06-24 04:16:54 +05:30
test_copilot_initiator.py	fix(copilot): set x-initiator per turn so user prompts bill as premium requests (salvage #4097) (#58544)	2026-07-05 00:44:15 -07:00
test_ctx_halving_fix.py	chore: restore test_ctx_halving_fix.py to main	2026-07-14 03:58:54 +05:30
test_delegate_cascade_49148.py	fix(agent): stop delegate cascade from deleting the parent session	2026-06-21 12:09:16 -07:00
test_dispatch_session_id.py
test_empty_model_fallback.py	feat(models): catalog-labeled silent default — GLM-5.2 marked "default": true in the model catalog	2026-07-15 00:10:31 -07:00
test_empty_session_hygiene.py
test_env_loader_op_bootstrap.py	fix(secrets): make 1Password bootstrap token reliable outside systemd	2026-07-06 04:58:07 -07:00
test_env_loader_secret_sources.py	feat(secrets): adapt 1Password onto the SecretSource interface	2026-07-06 04:58:07 -07:00
test_evidence_store.py
test_fast_safe_load.py	perf(startup): parse config + plugin manifests with libyaml CSafeLoader (#54486)	2026-06-28 15:38:39 -07:00
test_gateway_streaming_nested_config.py
test_get_tool_definitions_cache_isolation.py
test_hermes_bootstrap.py	revert(windows): roll back terminal-popup PRs #53791 #53810 #53829 (#53853)	2026-06-27 15:59:00 -07:00
test_hermes_constants.py	fix(dashboard): keep custom themes visible after embedded chat starts (#60601)	2026-07-18 00:34:54 -04:00
test_hermes_home_profile_warning.py
test_hermes_logging.py	fix(logging): drive rotating file handlers through an async QueueListener	2026-07-05 11:44:53 +05:30
test_hermes_state.py	perf(gateway): serve session.resume's model + display history from one SELECT	2026-07-18 21:50:26 -04:00
test_hermes_state_compression_locks.py	fix(ci): make tests, workflows, and attribution reliable under load (#66373)	2026-07-17 20:55:24 +00:00
test_hermes_state_wal_fallback.py
test_honcho_client_concurrency.py
test_honcho_client_config.py	feat(honcho): make latency-adding paths configurable	2026-07-16 12:48:48 -07:00
test_honcho_session_context.py
test_honcho_startup_fail_open.py	fix(ci): make tests, workflows, and attribution reliable under load (#66373)	2026-07-17 20:55:24 +00:00
test_install_autostash_conflict_recovery.py	test: add happy-path + no-markers coverage for autostash recovery	2026-07-18 19:18:03 +05:30
test_install_diverged_update.py	test(installer): cover diverged managed-clone recovery in install scripts	2026-06-30 20:11:01 +07:00
test_install_lockfile_churn.py	fix(install): discard managed lockfile churn before stashing	2026-06-25 23:49:11 -07:00
test_install_no_initial_commit.py
test_install_ps1_ascii_only.py	fix(install): keep install.ps1 pure ASCII so Windows PowerShell 5.1 doesn't misparse it	2026-07-18 18:40:59 -04:00
test_install_ps1_native_stderr_eap.py	fix(install): fail fast when uv venv genuinely fails under relaxed EAP	2026-06-18 22:11:35 +05:30
test_install_ps1_node_path_for_npm.py	test(installer): guard Ensure-NodeExeOnPath wiring in install.ps1	2026-07-07 21:17:34 +07:00
test_install_ps1_python_fallback_venv.py	test(installer): lock Python-fallback propagation into the venv stage (#50769)	2026-06-23 21:33:08 -07:00
test_install_ps1_uv_powershell_host.py	test(install): lock uv installer to a resolved PowerShell host	2026-06-18 16:26:34 +07:00
test_install_ps1_web_server_syntax_probe.py	fix(install): guard Windows desktop installs against broken web_server	2026-07-05 19:35:30 -07:00
test_install_sh_browser_install.py	test(install): track run_with_timeout extraction after #39219 refactor (#54185)	2026-06-28 03:58:01 -07:00
test_install_sh_install_method_stamp.py	fix(update): scope install-method stamp to the code tree, not $HERMES_HOME (#48188)	2026-06-18 14:14:41 +10:00
test_install_sh_node_global_prefix.py	fix(hermes): heal broken managed Node tree instead of PATH fallback	2026-06-26 20:10:20 +05:30
test_install_sh_pythonpath_sanitization.py
test_install_sh_root_fhs_uv_python_path.py
test_install_sh_setup_wizard_tty_probe.py
test_install_sh_symlink_stomp.py
test_install_sh_termux_network_prereqs.py
test_install_unmerged_index.py	fix(install): discard managed lockfile churn before stashing	2026-06-25 23:49:11 -07:00
test_ipv4_preference.py
test_lazy_session_regressions.py	fix(gateway): surface retry hint instead of silently dropping turn after /stop (#31884)	2026-06-24 23:51:31 +05:30
test_lint_config.py
test_live_system_guard_self_test.py
test_mcp_serve.py	refactor: consolidate gateway session metadata into state.db (#58899)	2026-07-05 14:01:03 -07:00
test_mini_swe_runner.py
test_minimax_model_validation.py
test_minimax_oauth.py
test_minisweagent_path.py
test_model_forces_max_completion_tokens.py
test_model_picker_scroll.py
test_model_tools.py	fix(toolsets): preserve core tools when a posture toolset is in disabled_toolsets (#57315)	2026-07-05 14:51:49 -07:00
test_model_tools_async_bridge.py
test_ollama_num_ctx.py	test(vision): cover Ollama /api/show vision capability routing (#54511)	2026-06-28 22:52:59 -07:00
test_onepassword_secrets.py	feat(secrets): add 1Password (op://) secret source	2026-07-06 04:58:07 -07:00
test_output_cap_parsing.py	fix(context): parse vLLM's token-based output-cap error format	2026-07-01 03:17:48 -07:00
test_packaging_metadata.py	security(deps): enforce aiohttp CVE floor on all lazy messaging paths + coverage guard	2026-07-01 02:51:45 -07:00
test_plugin_skills.py
test_plugin_utils.py
test_process_loop_event_loop_warning.py
test_profile_isolation_runtime.py	test(profile): two-profile regression suite + preserve skills_hub monkeypatch seam	2026-06-30 15:30:06 -07:00
test_project_metadata.py	fix(nemo-relay): align dynamic plugin configuration	2026-07-13 17:01:08 -06:00
test_pty_keepalive_ws.py	fix(dashboard): scope chat attach tokens by session (#60745)	2026-07-16 19:48:47 -04:00
test_pty_session.py	feat(pty): periodic reaper wired into dashboard lifespan	2026-07-07 15:15:37 -07:00
test_retry_utils.py	refactor(retry): single-source Z.AI overload short-attempts + drop change-detector assert	2026-07-07 11:57:01 +05:30
test_run_tests_parallel.py	fix(ci): make tests, workflows, and attribution reliable under load (#66373)	2026-07-17 20:55:24 +00:00
test_sanitize_tool_error.py
test_session_workspace_binding.py	feat(sessions): workspace_key grouping helper + tests	2026-07-12 05:07:52 -04:00
test_setup_temporary_outputs.py	refactor(ci): rewrite docker tests to check built container	2026-06-26 19:15:18 -07:00
test_slash_worker_watchdog.py	test(tui): keep watchdog checks behavior-focused	2026-07-18 04:15:13 -07:00
test_sql_injection.py
test_stale_utils_module_import.py	fix(gateway): refuse model switch on stale checkout to avoid env_float ImportError	2026-06-24 04:16:54 +05:30
test_state_db_malformed_repair.py	fix(state): detect and repair FTS write corruption that silently drops gateway history (#52798)	2026-06-25 21:18:41 -07:00
test_subprocess_home_isolation.py
test_telegram_polling_progress_ptb.py	test(telegram): gate slots premise assert on runtimes without instance __dict__	2026-07-14 21:25:44 -07:00
test_termux_all_extra_compat.py
test_timezone.py
test_tini_shim.py	test(docker): cover tini -g legacy entrypoint boot path	2026-07-18 01:11:03 -07:00
test_toolset_distributions.py
test_toolsets.py	feat(mcp): adopt mcp__server__tool naming convention	2026-07-05 13:40:21 -07:00
test_trajectory_compressor.py
test_trajectory_compressor_async.py
test_transform_llm_output_hook.py
test_transform_tool_result_hook.py
test_tui_gateway_loop_noise.py	fix(tui_gateway): suppress WS peer-hangup teardown error flood (#50005) (#54126)	2026-06-28 02:35:01 -07:00
test_tui_gateway_queue_on_busy.py	fix(tui_gateway): prevent resume stalls during submit and teardown (#66573)	2026-07-18 14:51:06 -04:00
test_tui_gateway_server.py	perf(gateway): serve session.resume's model + display history from one SELECT	2026-07-18 21:50:26 -04:00
test_tui_gateway_ws.py	fix(tui): start MCP discovery for websocket sessions	2026-06-28 04:14:12 -07:00
test_tui_mcp_late_refresh.py	fix(tui): refresh tool snapshot when MCP discovery lands after agent build (#48403)	2026-06-18 05:41:23 -07:00
test_utils_truthy_values.py
test_wal_checkpoint_strategy.py	fix(state): use PASSIVE checkpoint for periodic WAL flush to prevent B-tree corruption	2026-07-15 04:55:46 -07:00
test_web_server.py	fix(dashboard): disable ws keepalive ping on loopback to survive event-loop stalls	2026-07-03 03:33:22 +05:30
test_web_server_sessiondb_eventloop.py	Merge pull request #65893 from NousResearch/bb/salvage-63082-sessiondb-offload	2026-07-16 15:23:32 -04:00
test_wheel_locales_e2e.py
test_windows_subprocess_no_window_flags.py	test: make windows no-window-flag assertions immune to update-check daemon	2026-06-30 01:35:55 -05:00
test_yaml_indent_consistency_31999.py	fix(utils): unify YAML list indent across all config writers (#31999)	2026-06-25 23:27:44 +05:30
test_yuanbao_integration.py
test_yuanbao_markdown.py
test_yuanbao_pipeline.py	perf(yuanbao): bounded-concurrency inbound media resolve	2026-07-08 08:05:45 -07:00
test_yuanbao_proto.py
test_yuanbao_reconnect_set_active.py	fix(yuanbao): restore active singleton after WS reconnect	2026-07-05 00:41:34 -07:00
test_yuanbao_shutdown.py