mirrors/hermes-agent
1
0
Fork 0
mirror of https://github.com/NousResearch/hermes-agent.git synced 2026-07-31 19:16:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

feat(ci): track time.sleep in docker test profiler

Browse source 
The profiler now monkey-patches time.sleep alongside subprocess.run,
capturing the invisible "gap" time from polling loops (wait_for_container_ready,
poll_container, wait_for_log, etc.) that was previously unaccounted for.

The JSON report now includes per-test total_sleep_s, sleep_count, and
a sleeps[] array with caller location. The summary includes
total_sleep_s and total_wall_s (docker + sleep). The CI merge step
also aggregates sleep totals.

Local profile now shows: 201s docker + 75s sleep = 276s wall (38s
runner wall with 32-way parallelism). The biggest sleep consumer is
test_dashboard_insecure_env_var_no_longer_bypasses at 11.8s of
poll_container sleeps.
This commit is contained in:
ethernet 2026-07-14 16:22:05 -04:00
parent ca6ede33e1
commit 3fc4e413d2
2 changed files with 133 additions and 64 deletions
Download patch file Download diff file Expand all files Collapse all files

12
.github/workflows/docker.yml vendored
View file

@ -168,14 +168,22 @@ jobs:
# Recompute summary aggregates from merged tests.
subcmd_totals = {}
subcmd_counts = {}
total_sleep = 0
total_sleeps = 0
for t in merged['tests']:
for sub, info in t.get('by_subcommand', {}).items():
subcmd_totals[sub] = subcmd_totals.get(sub, 0) + info['total_s']
subcmd_counts[sub] = subcmd_counts.get(sub, 0) + info['count']
total_sleep += t.get('total_sleep_s', 0)
total_sleeps += t.get('sleep_count', 0)
total_docker = sum(subcmd_totals.values())
merged['summary'] = {
'total_tests': len(merged['tests']),
'total_calls': sum(subcmd_counts.values()),
'total_docker_s': round(sum(subcmd_totals.values()), 3),
'total_sleeps': total_sleeps,
'total_docker_s': round(total_docker, 3),
'total_sleep_s': round(total_sleep, 3),
'total_wall_s': round(total_docker + total_sleep, 3),
'by_subcommand': {
sub: {
'count': subcmd_counts[sub],
@ -187,7 +195,7 @@ jobs:
}
with open('docker-test-profile.json', 'w') as fh:
json.dump(merged, fh, indent=2)
print(f'Merged {len(files)} per-PID profiles ({len(merged[\"tests\"])} tests)')
print(f'Merged {len(files)} per-PID profiles ({len(merged[\"tests\"])} tests, {total_docker:.0f}s docker + {total_sleep:.0f}s sleep = {total_docker + total_sleep:.0f}s wall)')
"
- name: Upload docker test profile