mirrors/hermes-agent
1
0
Fork 0
mirror of https://github.com/NousResearch/hermes-agent.git synced 2026-07-14 14:12:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
hermes-agent/bench/results
History
alt-glitch de446a26a5 bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 
Chaos (5 scenarios x 2 UIs): every gateway-death/hang scenario fully
recovers on BOTH UIs — Ink respawns immediately (~80ms, no backoff),
OpenTUI after its 1s backoff; transcripts converge byte-identical to
the never-killed digest; zero orphans. PTY EOF: both exit and reap the
gateway in ~100ms (Ink takes 4.1s to die vs OpenTUI 0.2s).

Pipeline (800 msgs @30ev/s inside a dedicated tmux server): UI CPU
82.4s (ink) vs 79.1s (otui); tmux-server leg ~0.4s BOTH — the
'Ink costs more in the emulator' hypothesis is not supported at this
workload. Frame pacing: otui 22.3fps vs ink 15.8fps, interframe p95
103ms vs 209ms. Echo latency: both excellent (p50 1-2ms); submit to
first-token-paint 44ms (ink) vs 107ms (otui).
2026-06-11 09:19:07 +05:30
..
2026-06-10T2043-50e3471-gate-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2043-50e3471-gate-ink-ink-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2043-50e3471-gate-opentui-otui-capped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2043-50e3471-gate-opentui-otui-capped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2058-50e3471-mem3000-opentui-otui-capped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2058-50e3471-mem3000-opentui-otui-uncapped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2059-14ee1a5-mem3000-opentui-otui-uncapped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2059-50e3471-mem3000-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2059-50e3471-mem3000-ink-ink-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2059-197d499-mem3000-opentui-otui-capped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2100-197d499-mem3000-opentui-otui-capped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2100-197d499-mem3000-opentui-otui-uncapped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2101-197d499-mem3000-ink-ink-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2103-197d499-startup-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2103-197d499-startup-ink-ink-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2103-197d499-startup-opentui-otui-capped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2103-197d499-startup-opentui-otui-capped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2104-197d499-startup-ink-ink-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2104-197d499-startup-ink-ink-r3.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2104-197d499-startup-ink-ink-r4.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2104-197d499-startup-opentui-otui-capped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2104-197d499-startup-opentui-otui-capped-r3.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2105-197d499-startup-ink-ink-r5.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2105-197d499-startup-ink-ink-r6.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2105-197d499-startup-opentui-otui-capped-r4.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2105-197d499-startup-opentui-otui-capped-r5.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2105-197d499-startup-opentui-otui-capped-r6.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2106-197d499-startup-ink-ink-r7.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2106-197d499-startup-ink-ink-r8.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2106-197d499-startup-ink-ink-r9.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2106-197d499-startup-opentui-otui-capped-r7.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2106-197d499-startup-opentui-otui-capped-r8.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2106-197d499-startup-opentui-otui-capped-r9.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2107-197d499-cpu800-opentui-otui-uncapped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2108-197d499-cpu800-opentui-otui-capped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2110-197d499-cpu800-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2112-197d499-cpu800-ink-ink-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2114-197d499-cpu800-opentui-otui-uncapped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2116-197d499-cpu800-opentui-otui-capped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2118-197d499-cpu800-opentui-otui-uncapped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2120-197d499-cpu800-opentui-otui-capped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2122-197d499-cpu800-ink-ink-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2124-197d499-scroll2000-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2124-197d499-scroll2000-opentui-otui-capped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2125-197d499-scroll2000-ink-ink-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2125-197d499-scroll2000-opentui-otui-uncapped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2126-197d499-scroll2000-opentui-otui-capped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2126-197d499-scroll2000-opentui-otui-uncapped-r1.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2127-197d499-scroll2000-ink-ink-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2127-197d499-scroll2000-opentui-otui-uncapped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2128-197d499-scroll2000-opentui-otui-capped-r2.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2146-197d499-slope10000-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2146-197d499-slope10000-opentui-otui-uncapped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2147-e3-e3lite-1g-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2147-e3-e3lite-1g-opentui-otui-capped-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2149-197d499-nodes3000-ink-ink-r0.json bench: E1/E3 results + report render 2026-06-11 03:22:27 +05:30
2026-06-10T2236-a939c9a-mem3000-opentui-otui-capped-r0.json bench: post-fix otui results — crash eliminated 2026-06-11 04:09:27 +05:30
2026-06-10T2237-a939c9a-mem3000-ink-ink-r0.json bench: post-fix otui results — crash eliminated 2026-06-11 04:09:27 +05:30
2026-06-10T2237-a939c9a-mem3000-opentui-otui-uncapped-r0.json bench: post-fix otui results — crash eliminated 2026-06-11 04:09:27 +05:30
2026-06-10T2237-a939c9a-slope10000-opentui-otui-uncapped-r0.json bench: post-fix otui results — crash eliminated 2026-06-11 04:09:27 +05:30
2026-06-10T2238-a939c9a-slope10000-ink-ink-r0.json bench: post-fix otui results — crash eliminated 2026-06-11 04:09:27 +05:30
2026-06-11T0237-805e080-gate-ink-ink-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0237-805e080-gate-ink-ink-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0238-805e080-gate-opentui-otui-capped-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0238-805e080-gate-opentui-otui-capped-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0238-805e080-mem100-ink-ink-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0238-805e080-mem100-opentui-otui-capped-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0239-805e080-mem100-ink-ink-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0239-805e080-mem100-opentui-otui-capped-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0239-805e080-mem300-ink-ink-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0239-805e080-mem300-opentui-otui-capped-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0240-805e080-mem300-ink-ink-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0240-805e080-mem300-opentui-otui-capped-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0240-805e080-mem2000-opentui-otui-capped-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0241-448e6ee-mem2000-ink-ink-r0.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0241-448e6ee-mem2000-ink-ink-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0241-448e6ee-mem2000-opentui-otui-capped-r1.json bench: T1 real-workload memory cells — session-DB distribution + mem100/300/2000 2026-06-11 08:13:00 +05:30
2026-06-11T0313-cbe703c-chaos-ink-ink-rgw-kill-tool.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0314-cbe703c-chaos-ink-ink-rresize-storm.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0315-cbe703c-chaos-ink-ink-rpty-eof.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0315-cbe703c-chaos-opentui-otui-capped-rgw-kill-stream.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0316-cbe703c-chaos-opentui-otui-capped-rgw-kill-tool.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0316-cbe703c-chaos-opentui-otui-capped-rgw-stop.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0317-cbe703c-chaos-opentui-otui-capped-rpty-eof.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0317-cbe703c-chaos-opentui-otui-capped-rresize-storm.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0325-cbe703c-chaos-ink-ink-rgw-stop.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0326-cbe703c-pipeline-ink-ink-r0.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0328-cbe703c-pipeline-opentui-otui-capped-r0.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0339-cbe703c-echo-ink-ink-r0.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0339-cbe703c-echo-opentui-otui-capped-r0.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30
2026-06-11T0346-af1e4bb-chaos-ink-ink-rgw-kill-stream.json bench: chaos + pipeline + echo results — both UIs auto-heal gateway death; total-pipeline CPU is parity 2026-06-11 09:19:07 +05:30