mirror of
https://github.com/NousResearch/hermes-agent.git
synced 2026-06-09 08:21:50 +00:00
* feat: better composer etc * docs: add desktop and dashboard run instructions * fix(desktop): address security scan findings * fix(dashboard): resolve @nous-research/ui path under npm workspaces The sync-assets prebuild step shelled out to 'cp -r node_modules/@nous-research/ui/dist/fonts ...' with a path relative to apps/dashboard/. That works only when the dep is installed locally in the dashboard workspace, but 'npm install' at the repo root (the documented setup — see apps/desktop/README.md) hoists shared deps to the root node_modules under npm workspaces. The relative cp then fails with 'No such file or directory', sync-assets exits 1, the Vite build aborts, and 'hermes dashboard' surfaces a generic 'Web UI build failed' message. Replace the shell one-liner with scripts/sync-assets.cjs, which walks up from the dashboard directory looking for node_modules/ @nous-research/ui — working in both the hoisted (workspaces) and co-located (standalone) layouts. Also guards against a missing dist/fonts or dist/assets with a clearer error pointing at a rebuild of the UI package rather than silently copying nothing. * feat(desktop): support connecting to a remote Hermes backend Add HERMES_DESKTOP_REMOTE_URL and HERMES_DESKTOP_REMOTE_TOKEN env vars that, when set, short-circuit the local-child spawn in startHermes() and connect the Electron renderer to an already- running 'hermes dashboard' server reachable over the network. Motivating use case: WSL2 users who want to run the Hermes core (agent loop, tools, filesystem access) inside their WSL distribution while rendering the Electron GUI on native Windows. Before this change, the desktop app always spawned a local Python child on the same host as the renderer, which doesn't cross the WSL/Windows boundary. The remote path reuses waitForHermes() as a liveness probe (/api/status is in the backend's public endpoint allowlist), so the connection is only returned once the backend is actually ready. WebSocket URL derivation picks ws:// or wss:// based on the input scheme. URL validation rejects non-http(s) schemes and requires both env vars together to avoid a half-configured connection that would silently fall through to the spawn path. No behaviour change when the env vars are unset — the default local-spawn flow is untouched. Typical usage: # in WSL2 hermes dashboard --tui --no-open --host 0.0.0.0 --port 9119 --insecure # on Windows set HERMES_DESKTOP_REMOTE_URL=http://localhost:9119 set HERMES_DESKTOP_REMOTE_TOKEN=<session token> set HERMES_DESKTOP_IGNORE_EXISTING=1 (launch Hermes desktop) * ci(desktop): automate desktop releases Add GitHub Actions release channels for signed desktop installers and document the stable/nightly download paths. * feat: file tabs * refactor(desktop): tighten right-rail tab close API Promote closeRightRailTab/closeActiveRightRailTab as the single public entry point. Drops the activeTabRef + handleCloseDocument indirection in ChatPreviewRail, the unused $rightRailHasContent atom, and the legacy dismissFilePreviewTarget alias. -70 LOC. * feat(desktop): polish composer pill toward reference look Solid foreground-on-background send/voice-conversation circle (black-on-white in light, white-on-black in dark) anchors the right edge as the primary CTA instead of the orange theme primary. Bumps the primary control to 2.125rem so it visually outranks the ghost mic/plus controls. Opens up the surface padding (0.625rem x / 0.5rem y) so the input row breathes around its controls, and nudges the corner radius from 20 to 24px for a slightly pill-ier silhouette. LiquidGlass distortion is preserved. * feat(desktop): add startup and onboarding flow Add phase-based desktop boot progress, fresh-install sandbox testing, and first-run provider credential onboarding so packaged installs can start cleanly without manual settings detours. * fix(desktop): gate prompts on provider setup Show the desktop provider onboarding flow before prompt submission when no inference provider is configured, preventing fresh installs from falling through to backend credential errors. * fix(desktop): surface provider onboarding from session warnings Propagate credential warnings through session runtime info and open desktop onboarding whenever a session reports no usable provider, so unconfigured installs cannot fall through to prompt errors. * fix(desktop): route gateway provider errors to onboarding The "No inference provider configured" auth error reaches the renderer through gateway error events, not the prompt.submit promise; the previous patch only caught the latter, so the error toast still surfaced and onboarding never opened. Also strip credential-shaped env vars from the test:desktop:fresh sandbox so the packaged backend can't see provider keys leaking from the launching shell. * fix(desktop): use strict runtime check to drive onboarding setup.status returned True whenever any provider auth state was discoverable, including indirect fallbacks like a gh-CLI Copilot token. That made desktop think the user was set up while the agent's actual resolve_runtime_provider call still raised AuthError, leaving the user with a useless toast and no onboarding. Add a setup.runtime_check gateway method that runs the same resolver the agent uses on session creation, and switch the desktop onboarding overlay and prompt precheck to use it. * feat(desktop): OAuth-first onboarding using existing dashboard provider API Replace the engineer-flavored API key form with a Sign-in-first onboarding overlay that uses the dashboard's existing /api/providers/oauth catalog and PKCE/device-code endpoints (Anthropic, Nous, OpenAI Codex, etc.). API key entry is now a fallback tab with friendly provider names instead of env var prefixes, and the loud raw resolver error is gone in favor of a one-line welcome message. * fix(desktop): polish onboarding provider list Reorder OAuth providers so Nous Portal is first, give the segmented Sign in / API key control equal column widths, and replace the engineer-flavored backend names like "Anthropic (Claude API)" / "MiniMax (OAuth)" with friendlier in-app titles. External-CLI providers now show a softer subtitle and an external-link icon instead of a chevron. * refactor(desktop): split onboarding overlay into store + view Move the OAuth state machine, runtime check, copy-to-clipboard, and api-key save into store/onboarding.ts (matching the boot.ts pattern), leaving the overlay as a presentation layer that subscribes via useStore. Tabs are now table-driven, child panels read flow from the store instead of prop-drilling, and the polling/PKCE/error/success branches share a small Status atom. * fix(desktop): external CLI providers + center mode tabs External-CLI providers (Claude Code, Qwen Code) now open an in-overlay panel with the CLI command, copy button, and an "I've signed in" recheck instead of firing an invisible toast. Center the Sign in / API key tab control so it sits under the heading instead of hugging the left edge. * fix(desktop): drop onboarding tabs for an inline link, group device-code waiting state Replace the Sign in / API key tab pair with an "I have an API key" footer link under the OAuth provider list, with a "Back to sign in" affordance inside the API key form. Group the device-code "Waiting for you to authorize..." status next to the Cancel button so the alignment matches the action. * refactor(desktop): tighten onboarding store + overlay Drop the dead isOnboardingBusy/BUSY set, factor the catch-fallback dance into safeReq, and share a single reloadAndConnect helper between PKCE submit, device-code success, external recheck, and api-key save. In the overlay, extract Step / CodeBlock / FlowFooter / CancelBtn / DocsLink atoms so the four sign-in panels share the same chrome instead of repeating it inline. Net effect: fewer literal divs, one place to touch the spacing, and the code-block + footer rows are reusable across future flows. * fix(desktop): mount onboarding from frame 1 to kill the FOUT Default onboarding.configured to null (unknown until the runtime check resolves) and have the onboarding overlay render whenever it's not yet confirmed true. The boot overlay now yields to it, so the very first paint is the Welcome card with a "While we get you set up..." progress strip instead of a flash of the chat shell between boot dismiss and onboarding mount. The picker swaps in cleanly once the gateway opens and the runtime check confirms the user is not configured. Already-configured users see the same prep card briefly while their existing runtime warms up, then the overlay dismisses without touching the chat shell. * fix(desktop): top-align empty sessions placeholder The "Start a chat to build your history." empty state used a min-h-35 grid place-items-center container, which floated the text in a tall dead zone. Render it as a flat paragraph that sits right under the section header like the empty pinned state does. * refactor(desktop): drop dead boot overlay Onboarding overlay subsumes the boot card now that it mounts from frame 1 and renders boot progress inline. The standalone DesktopBootOverlay is unreachable in every flow (yields whenever onboarding has not confirmed configured, dismisses once it has). * fix(desktop): hide pinned/recents sections until first session A fresh sidebar showed the Pinned and Recent chats headers with floating empty-state copy underneath. Drop both sections (and the now-orphan SidebarEmptySessionState) when there are no sessions yet — they reappear after the first chat. Skeletons during initial load are unchanged. * feat(gui): route embedded TUI through dashboard gateway (#21979) Inject HERMES_TUI_GATEWAY_URL into dashboard PTY sessions so embedded ui-tui instances attach to the in-process websocket gateway, with coverage for the new env wiring. * Add desktop remote gateway settings Make the desktop gateway connection configurable from settings so local remains the default while remote backends can be saved, tested, and applied without environment variables. * feat(gui): first-class Messaging page + gateway menu redesign - Add Messaging page to the desktop app with per-platform setup, status, and inline guidance. Catalog derives from gateway.config Platform enum + plugin registry, so every messaging adapter the CLI supports (Telegram, Discord, Slack, Mattermost, Matrix, WhatsApp, Signal, BlueBubbles, Home Assistant, Email, SMS, DingTalk, Feishu, WeCom, Weixin, QQ, Yuanbao, API server, Webhooks, plugins) shows up without per-platform code. - New REST endpoints: GET /api/messaging/platforms, PUT and POST /test on the same path. Secrets go through the existing .env pipeline; enable/disable writes config.yaml. - Replace gateway statusbar dropdown with a richer panel: status row, icon-only restart + system-panel actions, recent activity (with timestamps trimmed in display, full text on hover), platform list. - Auto-poll the messaging page every 6s (paused when hidden) so status updates without a manual check. - Drop Settings / Command Center from the sidebar nav (still reachable via shortcuts and the titlebar cog). - Flatten top corners on Messaging/Skills/Artifacts/Chat panes. - Share new StatusDot component across messaging + gateway menu. - Fix gateway/config.py so an explicit platforms.<name>.enabled=false in config.yaml is honored when env tokens are present. - pb-9 on the chat content area for breathing room above the composer. * Potential fix for pull request finding 'CodeQL / Clear-text logging of sensitive information' Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com> * pin electron version * hide application menu on non-mac systems * interpret compactPreview for non-string vlaues as JSON or an empty string * fix(desktop): keep composer contenteditable mounted across stacked toggle The composer rendered {input} inside two different parent fragments depending on `stacked`. When auto-expand flipped `stacked` (e.g. the moment typed text wrapped past two lines), React reconciled the two branches as different positions and unmounted/remounted the contenteditable. The fresh mount started empty, so any in-flight characters — most reliably reproduced by holding a key — were lost. Replace the conditional with a single CSS Grid whose template-areas swap on `stacked`. The three children (menu, input, controls) keep stable identities across the toggle; only their grid placement changes, which the browser handles without React tearing down the editor. * refactor(desktop): align install layout with install.ps1 / install.sh Make the desktop app's runtime layout match what scripts/install.ps1 and scripts/install.sh produce, so a desktop-only user and a CLI-only user end up with the same files in the same places and can share one install. Layout - ACTIVE_HERMES_ROOT = HERMES_HOME/hermes-agent (was: process.resourcesPath/hermes-agent, read-only) - VENV_ROOT = HERMES_HOME/hermes-agent/venv (was: userData/hermes-runtime) - desktop.log = HERMES_HOME/logs/desktop.log (was: userData/desktop.log) - HERMES_HOME default: %LOCALAPPDATA%\hermes on Windows, ~/.hermes elsewhere The packaged .app/.exe still ships a read-only payload at process.resourcesPath/hermes-agent (FACTORY_HERMES_ROOT). On first launch or after an installer-driven upgrade we sync factory -> active, then provision the venv and run pip install -e . against the active root. Key behaviors - Pin HERMES_HOME in the spawned Python's env so get_hermes_home() resolves to the same path resolveHermesHome() picked. Without this, Python falls back to ~/.hermes on every platform - fine on mac/linux, a split-state bug on Windows where our default is %LOCALAPPDATA%\hermes. - Detect developer installs by .git presence at ACTIVE; never overwrite a user's checkout via factory sync. - Marker at ACTIVE/.hermes-desktop-runtime.json (schema v4) tracks pyproject hash + factory version + runtime schema version. depsFresh fast-paths when nothing changed. - Dev (npm run dev) prefers SOURCE_REPO_ROOT over ACTIVE so devs run their local edits, not whatever's under HERMES_HOME. - Better error messages distinguish "no payload" from "no Python". - Preserve a legacy ~/.hermes on Windows when no %LOCALAPPDATA%\hermes exists, so users with prior pip/manual installs aren't orphaned. pyproject.toml - Promote fastapi, uvicorn[standard], ptyprocess (non-Windows), and pywinpty (Windows) to main dependencies. The dashboard backend (hermes dashboard) needs them at runtime; the previous lazy-import fallback was a footgun for fresh installs. - Empty the [pty] optional-extra; kept as a no-op back-compat alias for any existing pip install hermes-agent[pty] invocations. Drops the hardcoded BUNDLED_RUNTIME_REQUIREMENTS list in main.cjs - the desktop now installs whatever pyproject.toml says, single source of truth. Files - apps/desktop/electron/main.cjs: runtime layout, HERMES_HOME pin, factory->active sync, marker v4 - apps/desktop/scripts/test-desktop.mjs: track new venv location - apps/desktop/README.md: new Setup, Runtime Bootstrap, and Debugging sections - pyproject.toml: fastapi/uvicorn/pty backends in main dependencies; [pty] extra emptied Tested locally on Windows: npm run dev boots cleanly, sessions land at the new location, type-check + lint + test:desktop:platforms all pass. Verified end-to-end on a fresh Win11 VM via dist:win installer. Known gaps (filed as follow-ups, not in this PR): - Skills not seeded on packaged installs (sync_skills only runs in cmd_chat, not cmd_dashboard). Need to move to shared pre-dispatch. - Git Bash not bundled or detected; agent's terminal tool errors out with a useful message but desktop bootstrapper should pre-flight it. - install.ps1 / install.sh should be decomposed into composable phase libraries so the desktop bootstrapper can reuse them as a single source of truth across all install surfaces. * feat(desktop): theme polish, prose chat typography, composer chrome - DS tokens/midground, Backdrop, scoped scrollbars, typography plugin + prose - Composer liquid/radius utilities, thread font parity, tool/thinking cues - File tree label scale, preview flex, thread retry loading + streaming tests * feat(desktop): NSIS prereq detection page + auto-install via winget The packaged Windows installer now detects Python 3.11+ and Git for Windows at install time and offers to install missing prereqs via winget. Mirrors the prereq logic scripts/install.ps1 already runs for CLI installs, so desktop installer users get the same out-of-the-box experience as install.ps1 users. Why - Hermes' terminal tool calls bash.exe directly (tools/environments/ local.py); on Windows that's Git Bash from Git for Windows. Without it, the agent fails on the first terminal() call. - Hermes' Python runtime needs 3.11+. Without it, the desktop bootstrapper errors out at venv creation. - Both gaps surfaced on a fresh Windows 11 VM smoke test: VM had Python pre-installed but no Git, so the agent's first terminal call failed with "Git Bash isn't installed." - install.ps1 has had Install-Git + Install-Uv functions for ages. The desktop installer was the asymmetric outlier. How — NSIS prereq page - New file: apps/desktop/installer/prereq-check.nsh (plugged into electron-builder via build.nsis.include) - Real Wizard page using nsDialogs, inserted via customPageAfterChangeDir hook (between the Directory page and InstFiles). - Group boxes for Python and Git, each showing detection status. - Pre-checked install checkboxes when winget is available. - Auto-skips silently if both prereqs are already installed. - Falls back to manual download URLs when winget itself is missing. - Detection: - Python: probes `py -3.11`/`-3.12`/`-3.13`/`-3.14` via the Python launcher. Microsoft Store "Python stub" (no py.exe) is correctly classified as not-installed. - Git: `where git`. - winget: `where winget` (Win10 1809+ / Win11 with App Installer). - Install execution (in customInstall macro): - Python: nsExec::ExecToLog with `--scope user --silent`. Per-user install, no UAC prompt, output streams to install log. - Git: ExecShellWait via Windows ShellExecute. Critical because Git always installs per-machine and triggers UAC; ShellExecute preserves the foreground focus chain across non-elevated → elevated process spawns, so UAC actually comes to the foreground. nsExec::ExecToLog breaks the chain because winget runs hidden. - Both pass `--disable-interactivity --accept-package-agreements --accept-source-agreements` to suppress winget's own dialogs. - Verification: probes Git's standard install locations via FileExists rather than `where git`. NSIS's process inherits PATH at startup, so a freshly-installed Git won't be visible to `where` until restart. - Silent installs (/S) skip the prompts; managed deploys handle prereqs out-of-band via Group Policy / Intune. How — Electron-side safety net - New findGitBash() in main.cjs, parallel to findSystemPython(). Probes the same locations as tools/environments/local.py:_find_bash() so a positive result here means the agent's terminal tool will work. - ensureRuntime now throws a clear, actionable error on Windows when Git Bash isn't found, matching the existing "Python 3.11+ is required" error path. - Catches users the NSIS page doesn't: .msi installer users (NSIS prereq page doesn't run for MSI), `npm run dev` users, manual installers, anyone who unchecked the install boxes on the NSIS prereq page. - All gated on `IS_WINDOWS`; macOS / Linux unaffected. NSIS build issue (resolved) - electron-builder defaults to `-WX` (warnings as errors). NSIS optimizer emits "warning 6010: function not referenced" for our page functions because Page custom directives don't count as references in its static-analysis pass. The functions ARE called at runtime when NSIS invokes the page; the optimizer just can't see it statically. - Set `build.nsis.warningsAsErrors=false` in package.json so this spurious warning doesn't fail the build. (Documented option from electron-builder's nsisOptions.) Out of scope (filed for future work) - MSI prereq detection: Windows Installer custom actions are a different mechanism. Enterprise deploys typically handle prereqs via GP/Intune. - Bundle PortableGit + python-build-standalone in extraResources for zero-network installs. ~80MB increase. - Mac / Linux GUI prereq flows (different installer formats; Xcode CLT covers most macOS prereqs already; Linux is per-distro hard). Files - apps/desktop/installer/prereq-check.nsh (new, ~290 lines NSIS) - apps/desktop/package.json (build.nsis.include + warningsAsErrors) - apps/desktop/electron/main.cjs (findGitBash + preflight) - apps/desktop/README.md (Runtime prerequisites section) Cross-platform impact - macOS / Linux builds (dist:mac, dist:mac:dmg, dist:mac:zip): nsis config is ignored entirely; .nsh is dormant. - npm run dev: .nsh dormant; main.cjs preflight gated on IS_WINDOWS. - scripts/install.ps1, scripts/install.sh: no reference to any new files; CLI install paths untouched. - Hermes CLI / dashboard / gateway: no reference; runtime untouched. - All checks: node --check on main.cjs and test-desktop.mjs pass; npm run test:desktop:platforms 4/4 passing; node --test green. Tested - npm run dist:win produces signed .exe and .msi without errors. - Fresh Win11 VM (Python pre-installed, no Git): prereq page renders, Python check shows detected, Git checkbox pre-checked. Click Next → Git installs via winget with UAC prompt in foreground. - After install completes, Hermes launches and the agent's terminal tool can run bash commands. Verified Git Bash is detected at `C:\Program Files\Git\bin\bash.exe` by ensureRuntime's preflight. * feat: theme changes, composer tweaks, in app update ux, finesse * fix(cli): seed bundled skills on dashboard + gateway entrypoints `sync_skills(quiet=True)` was only being called from inside `cmd_chat`, which meant `hermes dashboard` (the desktop GUI's backend) and `hermes gateway` (Telegram/Discord/Slack/etc daemons) never seeded the bundled skill library into ~/.hermes/skills/. This surfaced as "No skills found" in the desktop GUI's skills panel on fresh installs, despite the agent having access to the full bundled library when invoked via `hermes chat`. scripts/install.ps1 worked around it by running skills_sync.py as part of Copy-ConfigTemplates, but that's not part of the desktop installer's bootstrap chain. Fix - Extract the skills-sync block from cmd_chat into a module-level `_sync_bundled_skills_quietly()` helper. - Call the helper from cmd_chat (preserving existing behavior), cmd_dashboard (after the --status/--stop early-return paths and fastapi import check, so we don't run skills_sync on management commands or when deps aren't installed), and cmd_gateway. Why these three entrypoints - cmd_chat: the user's primary CLI entrypoint - cmd_dashboard: the desktop GUI's backend; this is what `hermes dashboard --tui` invokes when the desktop bootstrapper spawns Hermes - cmd_gateway: long-running daemons where the user expects the agent to have full skill access Other entrypoints (cmd_config, cmd_doctor, cmd_login, cmd_status, etc.) are management commands that don't need skill discovery and were never running skills_sync in the first place — leaving them alone. Idempotence - tools/skills_sync.py is manifest-based: skipped skills cost milliseconds. Calling it from multiple entrypoints adds no real cost, and users running `hermes chat` then `hermes dashboard` get two fast no-ops on the second call. Failure handling - Helper wraps skills_sync in try/except. Skills are an enhancement, not a hard dependency — Hermes runs fine with an empty skills/ dir. Files - hermes_cli/main.py: + new helper `_sync_bundled_skills_quietly()` at module level + cmd_chat: replace inline block with helper call + cmd_dashboard: add helper call after fastapi import succeeds + cmd_gateway: add helper call before delegating to gateway_command * feat(desktop): hoisted todo widget, JSON tool summaries, history grouping & timer fixes - Hoist todo to first-class widget (shadcn checkboxes, brand colors, no tool-accordion). Header derives label from active task; non-active rows fade. - Replace raw JSON dumps with structured key/value summaries via formatToolResultSummary; nested error extraction for clearer failures. - Fix loaded-session grouping: stitch interleaved assistant/tool iterations into one bubble instead of orphaned synthetic messages. - Stable tool/thinking timers via keyed registry so unmount/scroll doesn't reset elapsed counts; gate "running" on real live thread state. - Reorganize chat-only assistant-ui components under components/chat/. * fix(desktop): address CodeQL alerts on PR #20059 - settings/helpers.ts: harden setNested against prototype pollution. POLLUTING_PATH_PARTS check is now applied at every assignment site (loop + leaf) and uses Object.defineProperty so CodeQL can see the guard inline rather than via a helper function call. - lib/markdown-preprocess.ts: rebuild the dangling-fence close regex from a fence-char + length instead of marker.replace(...). The marker is captured by `(`{3,}|~{3,})` so it can only be backticks or tildes, but CodeQL was tracing tainted input text into the RegExp source and flagging hostname dots from input as part of the pattern (false positive js/incomplete-hostname-regexp on the test fixture URLs). Reconstructing from a literal char breaks the dataflow. - scripts/notarize-artifact.cjs: drop args from the run() rejection message. Args carry --key-id / --issuer / key file path; the existing outer catch already squashes errors to a generic line, but CodeQL was flagging the args.join(' ') as clear-text logging of APPLE_API_KEY_ID. Composer DOM-text-as-HTML alerts (composer/index.tsx:379, :547) are already addressed in4dd9732a9— innerHTML assignment was replaced with renderComposerContents which builds DOM via replaceChildren / append text nodes (no HTML interpretation). * fix(desktop): inline prototype-pollution guard so CodeQL sees it CodeQL's dataflow doesn't follow the helper-function guard inside `safeSet`, so it kept flagging Object.defineProperty as prototype- polluting. Inline the literal `__proto__`/`constructor`/`prototype` check at the assignment site to break the dataflow. Behavior unchanged — same set of disallowed keys, same throw. * feat(ui-tui): resolve links to readable page titles Mirror desktop pretty-link behavior in the TUI by resolving HTTP links to page titles with shared caching and safe fetch filters, plus slug-based fallbacks so chat links stay readable even when title fetch fails. * fix(desktop): drop RegExp from dangling-fence close detection Previous attempt tried to break the dataflow by reconstructing the close-fence regex from a literal char + marker.length, but CodeQL still traced marker.length back to input and kept flagging the test-fixture URLs as hostname-regex sources (js/incomplete-hostname-regexp). Replace `new RegExp(...)` + `closeRe.test(body)` with a string-only hasCloseFenceLine() helper that splits on '\n' and uses ===. No regex on this path now, so input data can no longer reach a RegExp source. Behavior preserved: matches lines that are (whitespace + marker + whitespace), which is what the original `\n[ \t]*${marker}[ \t]*(?=\n|$)` matched. All 12 markdown-text tests still pass. * fix(process-registry): suppress windows-footgun false positive on guarded killpg Keep the existing POSIX-only process-group teardown path, but make the signal selection explicit via getattr and add an inline windows-footgun suppression marker on the guarded os.killpg line so the Windows footgun check no longer blocks CI on this intentionally platform-gated code. * feat(desktop): reconcile live tool events, polish thread chrome, harden boot - chat-messages: match tool rows by overlapping query/context/preview values so preview-first `tool.progress` rows reliably adopt later stable-id `tool.start` payloads instead of spawning ghost rows or mis-merging parallel same-name calls; preserve prior args/result across phases. - tui_gateway: emit full args + parsed result on `tool.start` / `tool.complete`, drop redundant `tool.started` re-emit from `tool.progress`. - electron/main: prefer SOURCE_REPO_ROOT before PATH `hermes` in dev so local backend edits actually run; split hardening helpers into `electron/hardening.cjs` with tests. - thread/tool UI: one-shot enter animation keyed by stable ids, braille spinner for running rows, Cursor-like disclosure rows, drill-down + duration/count formatting via new tool-fallback-model. - composer: extract `text-utils`, drop liquid-glass overrides. - right-rail: split preview-pane into preview-console / preview-file. - runtime: incremental external-store runtime + runtime-readiness gate; onboarding store + tests; route-resume hook test. - regression tests for live tool reconciliation (parallel tools, id-less progress, preview-first rows, structured args/results). * feat(desktop): add ripgrep to NSIS prereq page + polish layout Add ripgrep as a third (recommended) prereq alongside Python and Git in the NSIS prereq detection page, and clean up the page layout based on on-VM testing. Why ripgrep - Hermes' search_files tool calls `rg` directly for content + filename search (tools/file_operations.py:1382). Falls back to grep/find from Git Bash when missing — works but slower and noisier (no .gitignore awareness). - ~5MB winget install via `BurntSushi.ripgrep.MSVC --scope user` — no UAC prompt, parallel to how Python installs. - scripts/install.ps1 already installs ripgrep as part of Install-SystemPackages; this brings the desktop installer to parity. Why "recommended" not "required" - Python and Git are hard requirements: without them the agent runtime or terminal tool refuses to start. The bootstrapper preflight throws. - ripgrep is a performance enhancement: missing it just means slower searches. Page wording reflects this; failure to install is logged but doesn't show a MessageBox or block. Layout polish (response to on-VM screenshot review) - Wizard header now correctly reads "System Requirements" instead of the leftover "Choose Install Location" from the previous page. Set via `GetDlgItem $HWNDPARENT 1037/1038` + WM_SETTEXT — the standard NSIS pattern for overriding the page header on a custom Page. - Removed redundant in-body title + verbose intro paragraph; the wizard header IS the title now. Body has one short intro line. - Group boxes tightened to 26u with content positioned just below the groupbox title (not top-anchored status + bottom-anchored checkbox with empty space in the middle). All three panels + footer fit comfortably in 126u, well under the 140u page limit. - Checkbox labels simplified: dropped "(per-user, no admin prompt)" and "(administrator approval required)" suffixes. The footer note still calls out UAC for Git when relevant. - Footer text trimmed to fit cleanly without clipping. Install order (in customInstall macro) - Python → ripgrep → Git - Python and ripgrep are silent and run first; Git's UAC prompt comes last so the user's approval interaction isn't interrupted by silent activity afterwards. Skip behavior unchanged - All three detected → page auto-skips via Abort - Silent install (/S) → customInstall winget block skips - User unchecks all → page advances without running winget Files - apps/desktop/installer/prereq-check.nsh: ripgrep detection block, ripgrep page panel + checkbox, ripgrep customInstall block, GetDlgItem header override, layout reflow - apps/desktop/README.md: Runtime prerequisites section updated to list ripgrep as recommended, with manual winget command * feat(desktop): add model-confirmation step to onboarding After OAuth/API-key login completes, onboarding now shows a confirmation card with the curated default model and a Change button before dropping the user into chat. Closes the gap where the desktop's `model.default` was empty after first launch and the agent had to fall back to whatever heuristic happened to fire — leaving users wondering "why am I getting sonnet-4 when I logged into Nous Portal?" Why - Desktop onboarding only persisted credentials, never `model.default`. The CLI's `hermes model` command pairs provider + model selection, but the desktop's onboarding skipped the model step entirely. - Result: users saw whichever model the agent's auto-fallback picked, unpredictably and undocumented. - For the BUILD demo we want users to land on the model they expect for their provider, with a clear "this is what you're getting" UI and a one-click path to change it before chatting. How - New `confirming_model` flow status carries the just-authenticated provider slug, current default model, label, and a saving flag. - `completeWithModelConfirm()` runs after credentials succeed: reloads env, verifies runtime, fetches /api/model/options to find the curated first-model for the provider, persists it via /api/model/set, then transitions into `confirming_model`. - If anything fails (no providers returned, network error), falls through to the previous behaviour — onboarding completes without the confirm step. Polish, not a hard requirement. - All four credential paths (device_code OAuth, PKCE OAuth, external CLI flow, API key) now use completeWithModelConfirm instead of reloadAndConnect. UI - `ConfirmingModelPanel` shows: green "<provider> connected" banner, card with "Default model: <name>" + Change button, and a "Start chatting" CTA that finalises onboarding. - Reuses the existing `ModelPickerDialog` (the same picker available from the chat shell) for the change-model UX. Search, filtering, multi-provider listing — all already built. - Stacking: ModelPickerDialog defaults to z-130, which renders UNDER the onboarding overlay (z-1300) and breaks pointer events. Added optional `contentClassName` prop to ModelPickerDialog so callers can override; onboarding passes `z-[1310]`. Provider-slug matching - For OAuth flows: pass `provider.id` directly as the preferred slug. - For API-key flows: `OPENROUTER_API_KEY` → "openrouter" via env-key prefix strip. Also includes the user-visible label as a fallback candidate. - fetchProviderDefaultModel falls back to the first authenticated provider in the response if no preferred slug matches — so even a miss still surfaces a reasonable default. Files - apps/desktop/src/store/onboarding.ts: + new `confirming_model` flow variant + fetchProviderDefaultModel + completeWithModelConfirm helpers + setOnboardingModel (optimistic update + revert on failure) + confirmOnboardingModel (finalises onboarding from the card) - reloadAndConnect (replaced; the four call sites now go through completeWithModelConfirm) - apps/desktop/src/components/desktop-onboarding-overlay.tsx: + ConfirmingModelPanel component + new branch in FlowPanel for status `confirming_model` + ModelPickerDialog usage with z-[1310] content class - apps/desktop/src/components/model-picker.tsx: + optional `contentClassName` prop on ModelPickerDialog so the dialog can be stacked on top of other fixed overlays Tested - `npm run type-check` passes - `npx eslint` clean on touched files - Live test in `npm run dev`: cleared onboarding cache, walked through Nous device-code flow, saw confirm card with curated default, clicked Change → ModelPickerDialog rendered above the onboarding overlay with working pointer events, picked a different model, "Start chatting" persisted to ~/.hermes/config.yaml. * fix(desktop): suppress generic provider warning in onboarding Hide the red setup notice when the message is the generic missing-provider guidance, since onboarding already presents provider auth actions. Centralize provider-setup matching across desktop hooks and add coverage for the matcher. * fix(desktop): add 2u clearance below prereq checkboxes Group box bottom border was clipping the checkboxes by 1-2px. Bumped each box height 26u→30u; checkboxes now sit 2u above the bottom border. * fix(nix): refresh dashboard lockfile hash Update the web npm deps hash in nix/web.nix to match the committed apps/dashboard/package-lock.json so bb/gui passes the nix lockfile check. * fix(desktop): install TUI deps in release workflow Ensure desktop release builds install the standalone ui-tui package before bundling the TUI payload. * fix(desktop): run release builder from app package Invoke the desktop builder through the package script so electron-builder uses apps/desktop/package.json. * fix(desktop): expand release artifact names safely Build desktop artifact names from workflow version/channel while preserving electron-builder platform macros. * fix(desktop): use package artifact naming in release workflow Let electron-builder's desktop package config provide platform-specific artifact extensions while the workflow injects the release version/channel metadata. * fix(nix): fetch dashboard npm deps from package root Point the dashboard npm dependency fetch at apps/dashboard so Nix can find the package lockfile after the dashboard move. * fix(nix): build dashboard from package directory Set the web package source root to apps/dashboard so npm patch/build phases run beside the dashboard lockfile while keeping apps/shared available as a sibling. * feat(desktop): render LaTeX math via KaTeX after streaming completes Add @streamdown/math plugin to the chat markdown renderer. Inline ($x^2$) and block ($$...$$) math both supported with singleDollarTextMath enabled. Plugin is gated to non-streaming state to match the existing pattern for syntax highlighting — math renders when the message completes, avoiding KaTeX re-render churn during streaming. KaTeX CSS is imported in styles.css; ~30KB CSS + ~430KB JS added to the bundle. Smoothness improvements during streaming deferred to a follow-up. * perf(desktop): memoize KaTeX renders so math streams without re-rendering Wrap rehype-katex with a per-equation LRU cache (keyed by displayMode + source text) and re-enable math during streaming. Stock @streamdown/math runs rehype-katex on every markdown commit, so each new token re-katexes every equation in the message. For math-heavy responses (an equation derived step-by-step) that's hundreds of ms of wasted work per token and the streaming UI chokes. With memoization, each equation pays katex.renderToString exactly once; subsequent tokens re-walk the tree but hit cache for unchanged equations. The wrapper mirrors rehype-katex's semantics exactly: same class detection (language-math, math-inline, math-display), same <pre>-walk-up for fenced math blocks, same parent.children.splice replacement, same SKIP traversal, same strict-then-lenient render strategy with VFile message reporting. Cached children are structuredCloned on each splice so downstream rehype plugins or toJsxRuntime can't mutate the cache. * fix(desktop): declare katex-memo deps directly + drop per-app lockfile katex-memo.ts (added in112cad59b) imports hast-util-from-html-isomorphic, hast-util-to-text, remark-math, katex, and unist-util-visit-parents but those were never added to apps/desktop/package.json. They were silently resolving via @streamdown/math at the workspace root, which broke the moment `npm i --prefix apps/desktop` ran with the per-workspace lockfile because that install only consults apps/desktop/package.json. Add them as direct deps, plus unified/vfile/@types/hast for the type imports. Also delete apps/desktop/package-lock.json — root package.json declares workspaces: ["apps/*"], so npm manages all lockfile state at the root. The stale per-app lockfile is what made `npm i --prefix apps/desktop` diverge from the workspace install in the first place and left an empty apps/desktop/node_modules/@assistant-ui/ stub that Vite's dep optimizer then tried (and failed) to open at @assistant-ui/core/dist/internal.js. * feat(desktop): disable Backdrop noise overlay by default The noise overlay defaulted to on, which adds a busy speckle layer over the whole window for every new user. Flip the Leva default to off; the toggle stays in Backdrop / Noise for anyone who wants it back. * fix(desktop): polish LaTeX rendering — currency, code blocks, brackets Five distinct bugs surfaced from a math-heavy stress test: 1. Adjacent code fences glued together. scrubBacktickNoise's second-pass regex /``\s*``/g matched the LAST 2 backticks of one fence + whitespace + FIRST 2 backticks of the next, collapsing two blocks into one. Fixed with lookbehind/lookahead so we only match exactly 2 backticks not part of a longer run. 2. Whitespace eaten between fences and following content. stripPreviewTargets internally calls .trim() which strips leading/ trailing whitespace from each split-segment. For segments between two fences this collapsed \n\n to '', gluing fence close to next block. Fixed by capturing leading/trailing whitespace at the call site and restoring it after the transform. 3. Currency dollar signs eaten as math. With singleDollarTextMath:true remark-math greedy-matched any pair of $, so '$5 ... $10' became one inline math span. Added escapeCurrencyDollars to escape $<digit> patterns to \$<digit> in prose segments (not in code). Trade-off: math expressions starting with a digit (rare — '$5x = 10$') get escaped too. Mirrors the convention in ChatGPT/Claude's UIs. 4. \(...\) and \[...\] LaTeX brackets unsupported. Models often emit these instead of $...$ / $$...$$. Added rewriteLatexBracketDelimiters preprocessor pass. 5. ```latex / ```tex blocks were being routed to KaTeX via a rewrite to ```math. Aligns with GitHub markdown convention: ```math = render as math; ```latex / ```tex = LaTeX/TeX source code (syntax highlighted, not rendered). Conflating them broke teaching/showing-source use cases. MATH_FENCE_LANGUAGES pruned to {'math'} only. Also flipped parseIncompleteMarkdown to true (was !isStreaming) so the math parser can't see $ inside streaming-but-not-yet-closed code fences. Shiki was already deferred via defer={isStreaming} so this doesn't introduce new tokenization cost. Test: 18/18 existing tests still pass; one test updated to expect escaped \$ in currency-prose-with-URL case. * fix(desktop): detect Python via registry/filesystem; pin to 3.11–3.13 Two related fixes for Python detection on Windows: 1. py.exe (Python launcher) is missing from per-user installs that didn't check the launcher option, so 'py -3.X --version' alone misses real Python installs. User-reported case: clean Win11 + official Python.org 3.14 install -> 'where py' returned nothing, our installer offered to install Python again. Both NSIS prereq page and main.cjs now probe in this order: 1. py.exe launcher (when present) 2. PEP 514 registry: HKLM/HKCU\SOFTWARE\Python\PythonCore\<v>\InstallPath 3. Filesystem: %ProgramFiles%\Python<v>, %LocalAppData%\Programs\Python\Python<v> Crucially, we never fall back to running 'python.exe' from PATH on Windows — the WindowsApps stub at %LOCALAPPDATA%\Microsoft\ WindowsApps\python.exe is a redirector that opens the Microsoft Store window if no Store Python is installed. Triggering that during boot would be terrible UX. Registry/filesystem probes never execute the binary. 2. Drop 3.14 from the supported version set. Several Hermes deps (notably pywinpty, which carries Rust crates like windows_x86_64_msvc) don't yet publish 3.14 wheels. With wheels missing, 'pip install -e .' falls back to building from sdist, which needs a Rust toolchain — users see 'could not compile windows_x86_64_msvc build script' on first run. install.ps1 sidesteps this by pinning to 3.11 via uv; the desktop installer doesn't yet have the same uv-managed-Python pathway, so for now we accept 3.11/3.12/3.13 and tell winget to install 3.11 if none of those are present. Revisit when the wheel ecosystem catches up to 3.14 (~early 2026). * feat(desktop): Cron, Profiles, usage analytics, and titlebar fixes - Add Cron and Profiles sidebar routes with full CRUD-style flows and API wiring. - Extend Command Center with auxiliary task overrides and a Usage panel (7d/30d/90d). - Fix titlebar geometry for WSL/Windows (native overlay width, tool spacing). - Remove stray merge conflict markers from pyproject.toml optional deps. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(title-bar): position sidebar toggle button * feat(desktop): composer queue — queue many, edit/delete/cancel-edit, Cursor-style Press Enter while busy with a draft to queue it; with no draft to interrupt and send the next queued turn. Auto-drains one queued turn each time the session settles, same as Cursor. Queue persists across reloads so an interrupted-and-queued turn isn't lost on refresh. Each queued row supports edit-in-composer (with explicit Save/Cancel), send-now (↑), and delete. Drain skips only the entry currently being edited so the rest of the queue keeps flowing. Queue dequeue is transactional — an entry only leaves the queue after `prompt.submit` is accepted, so a rejected submit doesn't drop the turn. Also shrinks the `[interrupted]` marker to a muted one-liner and drops its assistant footer so it stops looking like a real reply. * fix(desktop): handle empty usage analytics totals Co-authored-by: Cursor <cursoragent@cursor.com> * fix(desktop): address PR review titlebar and usage races Co-authored-by: Cursor <cursoragent@cursor.com> * feat(desktop): add MCP settings and live subagent tree Surface configured MCP servers in Settings with JSON edit/save and a gateway-backed reload action so users can manage tool servers without falling back to slash commands. Track live subagent gateway events in a desktop store, show active subagent counts in the Agents statusbar item, and replace the Agents overlay stub with a live spawn tree for the active session. * fix(desktop): move power-user views out of sidebar Keep Cron and Profiles available through lower-prominence chrome entry points so the workspace sidebar stays focused on core chat navigation. Co-authored-by: Cursor <cursoragent@cursor.com> * refactor(desktop): subagent overlay reads like a live transcript, not a dashboard Strip the card chrome and rewire /agents to feel like peeking into the child agent's stream: - subagents store: single `stream` of typed entries (thinking/tool/progress/ summary) replaces the parallel notes/thinking/tools arrays. Drop unused fields (toolsets, depth, apiCalls, reasoningTokens, sessionId). - agents view: no OverlayCards, no boxed stream, no per-row borders. Goal + status pill + indented stream lines, full row width. - Group root spawns into "Delegation N" sections when batch shape + spawn time match — hides task-index interleaving and makes hierarchy obvious. - Sort tree by spawn time, then task_index. Step indicator is one colored pill (primary while running, emerald when done) inside the row, not a trailing pill that wrapped under the chevron. - Tree picks up `subagent.start` (not only `spawn_requested`) and prunes delegate-tool fallback rows once native subagent events land for the session — fixes duplicate "Delegated task" rows alongside the real ones. * feat(desktop): Esc closes every OverlayView-based overlay Lift the keyboard handler into the shared OverlayView so Agents, Settings, Command Center — and anything we build on top of it later — all dismiss on Esc by default. Nested Radix dialogs stop propagation themselves, so a modal opened inside an overlay (e.g. model picker inside Settings) still closes the modal first, not the overlay underneath. Drop the now-redundant Esc handlers in Settings (kept Cmd/Ctrl+P) and Command Center. * fix(desktop): drop numbered step pill on subagent rows The pill was getting clipped at the overlay edge anyway. Just use the status glyph (●/✓/✗/■/○) — the delegation header already conveys "3 workers, 3 active", and order in the list implies which step you're looking at. * fix(desktop): drop noisy "returned N items / empty object" stub strings When a tool returns nothing useful, the row should be silent — the title ("Search Files", etc.) already tells the user what happened. Counting the fields in an opaque payload is engineer-noise. `formatToolResultSummary` and `minimalValueSummary` now return '' for empty arrays / records / unrecognized values; tool-fallback already hides the detail section when its body is empty. * refactor(desktop): subagent rows borrow chat tool patterns (fade-in, lucide glyphs, shimmer) Pull the agents view closer to how chat tool blocks render: - statusGlyph() returns the same lucide BrailleSpinner / CheckCircle2 / AlertCircle vocabulary as tool-fallback's statusGlyph - Stream lines fade-in via useEnterAnimation (one-shot WAAPI), keyed per entry so streamed deltas settle in instead of popping - Subagent rows fade in too, and pick up the existing data-slot=tool-block spacing rules between blocks - Active stream line trails a BrailleSpinner instead of a hand-rolled pulsing rectangle - Goal text drops FadeText (which forces nowrap); keep FadeText only for the single-line meta subtitle - Running rows shimmer the title — same affordance the chat thinking row uses * refactor(desktop): make /agents subagent-only, drop sidebar + dead sections Activity rail and History stub were both noise. Strip the split layout, sidebar, route enum, and the rail/stub helpers — the overlay is now just the spawn tree, centered in a max-w-3xl column so it stops claiming the whole screen for one section's worth of content. * feat: update cron modals * Add dedicated GUI log stream for dashboard debugging. Capture dashboard and PTY websocket lifecycle failures in gui.log and expose it via hermes logs. * Improve desktop runtime UX by surfacing inference readiness in gateway status and hardening WSL link opening. This also stabilizes markdown code/table block spacing and adds root-install guards so desktop dev runs use a healthy workspace dependency tree. * Log detailed GUI websocket failure metadata. Capture richer reject/disconnect/send/parse context for dashboard gateway websocket flows so GUI connection failures are diagnosable from logs. * Default dashboard startup logging to GUI mode. Detect the dashboard subcommand during early CLI bootstrap so gui.log is attached from process start and GUI startup failures are always captured. * Clean up gateway status conditionals and logging bootstrap mode detection. Simplify nested dashboard gateway status branches for readability and use a concise first-subcommand check when selecting early GUI logging mode. * add logging to nsis installer * feat: glass ui pass * fix(desktop): persist inline assistant errors across hydrate/resume - Detect provider failure text arriving via message.complete (HTTP 4xx, "API call failed after N retries", Provider/Gateway error: ...) and persist as an inline assistant error instead of regular completion text, blocking the hydrate that was wiping it. - preserveLocalAssistantErrors: merge by id so same-id hydrated messages keep their local error, and preserve the optimistic user+error pair as a unit (with tail-user dedupe). - Hook all hydrate/resume writers (use-session-actions resume + fallback, hydrateFromStoredSession, syncSessionStateToView) into the merge so stale snapshots can't clobber a failed turn. - Add error to chatMessagesEquivalent so the resume diff actually sees error-only changes and paints them. - editMessage on a failed turn now submits a plain resend (no truncate_before_user_ordinal) and retries plainly on the "no longer in session history" race. Style polish on touched files: - Inline error: text-only treatment (no card). - User stop / edit-composer send: shared Tabler IconPlayerStopFilled glyph + shared icon-button class slot for parity. * feat(desktop): theme xterm with active light/dark mode The right-sidebar terminal hardcoded a light palette, which read poorly on the dark glass surface. Subscribe to `useTheme().resolvedMode` and hot-swap `term.options.theme` so Shift+X (and any other mode change) updates the terminal in place without tearing down the PTY session. Dark mode uses xterm's built-in defaults (white fg/cursor + vivid ANSI 16) with just a transparent background so the glass shows through; light mode keeps the existing hand-tuned overrides for legibility on a bright surface. * feat(sidebar): right-click + drag-reorder sessions and workspaces - Wire right-click on session rows to open the same actions menu; suppresses the OS-native context menu so Windows stops looking awful. - Share dropdown + context menu items via useSessionActions() driving a single declarative ItemSpec[]; render polymorphic over MenuItem. - New shadcn ContextMenu primitive mirroring DropdownMenu styling. - Restore drag-and-drop reordering for Agents (lost during the cwd cleanup) and add reordering of workspace groups via a right-side grab handle. Pinned reorder unchanged. - Generic orderByIds<T> replaces the duplicated session/group orderers; useSortableBindings() hook collapses the two Sortable wrappers. - cursor-pointer on every actionable element; cursor-grab on handles. - KISS pass: baseName() helper, AGE_TICKS table, single WORKSPACE_PAGE constant, flatter SidebarSessionsSection render. * feat(desktop): solarize the xterm palette in both light & dark xterm's default ANSI 16 is tuned for dark and reads candy-bright on the light glass surface (vivid cyans/greens). Ship the canonical Solarized palette (Schoonover) for both modes — same 16 accents either way, only fg/cursor swap between `base00/01` (light) and `base0/1` (dark), so a prompt's colors look uniform across a Shift+X toggle. Background stays transparent in both modes — Solarized's cream/slate backgrounds would fight the glass. * feat(desktop): virtualize chat thread + sidebar via TanStack Virtual Replaces `use-stick-to-bottom` and per-row session rendering with `@tanstack/react-virtual`, matching what Cursor uses. Chat thread (`thread-virtualizer.tsx`): - Natural-flow virtualization (padding spacers, not absolute items) so `position: sticky` on the human bubble still resolves cleanly against the scroller. - Custom at-bottom anchor: pins when armed, disarms on user-driven upward scroll, re-arms at bottom, jumps on session switch + `thread.runStart`. - Loading indicator and `--thread-last-message-clearance` move to a real `[data-slot=aui_composer-clearance]` node; drops the brittle `:nth-last-child(1 of …)` rule that can't fire reliably under virtualization. Sidebar (`virtual-session-list.tsx`): - Flat agents list virtualizes at >=25 rows; pinned and workspace-grouped paths stay direct-render. - `SortableContext` keeps all IDs; only the window mounts; dnd-kit's `setNodeRef` is merged with `virtualizer.measureElement` so rows participate in both DnD hit-testing and TanStack measurement. Drops `use-stick-to-bottom`. Streaming test gets a global `offsetWidth/offsetHeight` stub so the virtualizer's viewport sizing works in jsdom; the scroll-up-doesn't-pull-back invariant still passes. * feat: more ui qa * fix(desktop): trim sidebar terminal startup spacer Drop zsh's initial spacer row before writing the first terminal prompt so new sidebar terminal sessions do not open with a selectable blank line. * chore: uptick * feat(desktop): thin installer + first-launch install.ps1 bootstrap Converges the Windows packaged desktop installer onto a single canonical install topology: drop the Electron shell only (~80MB instead of ~500MB), clone Hermes Agent at a build-time-pinned commit on first launch via install.ps1's stage protocol, and treat the resulting git checkout at %LOCALAPPDATA%\hermes\hermes-agent\ as the canonical install location (same path the CLI installer uses). Future updates flow through the existing applyUpdates() git-pull path. Replaces the previous fat-installer architecture where the .exe bundled a pre-staged hermes-agent source tree under resources/hermes-agent/ that was then sync'd into ACTIVE_HERMES_ROOT at launch -- a complicated factory-vs-active dance with several footguns (FACTORY_HERMES_ROOT mismatch on path resolve, isGitCheckout guard regressions, pyproject hash drift detection inside the sync loop). Architecture overview --------------------- Build time apps/desktop/scripts/write-build-stamp.cjs writes apps/desktop/build/install-stamp.json with {commit, branch, builtAt, dirty}. Honours $GITHUB_SHA / $GITHUB_REF_NAME in CI, falls back to `git rev-parse HEAD` locally. apps/desktop/scripts/stage-native-deps.cjs copies the runtime subset of @homebridge/node-pty-prebuilt-multiarch from the workspace-root node_modules into apps/desktop/build/native-deps/. Workspace dedup hoists this dep to the root, out of reach of electron-builder's `files:`-restricted collector; staging gives us a deterministic path to extraResources. electron-builder ships both into resources/install-stamp.json and resources/native-deps/ respectively. Boot resolver (electron/main.cjs) Resolver order: 1. HERMES_DESKTOP_HERMES_ROOT override 2. SOURCE_REPO_ROOT (dev mode) 3. ACTIVE_HERMES_ROOT git checkout WITH .hermes-bootstrap-complete marker -- the post-install fast path 4. `hermes` on PATH (CLI-installed user adding the desktop) 5. pip-installed hermes_cli via system Python 6. bootstrap-needed sentinel -> hand off to runBootstrap Deletes the entire FACTORY_HERMES_ROOT / RUNTIME_MARKER / syncTreeExcludingVenv machinery (-200 lines). The isGitCheckout guard that bit us in the install.ps1 PR is gone. First-launch bootstrap (electron/bootstrap-runner.cjs) 1. Resolve install.ps1: prefer SOURCE_REPO_ROOT/scripts (dev), else download from GitHub raw at INSTALL_STAMP.commit (cached at HERMES_HOME\bootstrap-cache\install-<sha>.ps1). 2. Fetch the stage manifest via install.ps1 -Manifest -Commit X -Branch Y. 3. Iterate stages: install.ps1 -Stage <name> -NonInteractive -Json -Commit X -Branch Y per stage. 4. On all stages green: write the .hermes-bootstrap-complete marker with {schemaVersion, pinnedCommit, pinnedBranch, completedAt, desktopVersion}. Per-run log to HERMES_HOME\logs\bootstrap-<ts>.log. Cancellation via AbortSignal. Manifest cache so retries don't re-download. Install overlay (src/components/desktop-install-overlay.tsx) Mounted alongside the existing onboarding overlay; flexbox card with header (static) + middle (scrollable) + footer (failure-only, static). Subscribes to hermes:bootstrap:event IPC + resyncs from hermes:bootstrap:get on mount/reload. Renders: - 14-stage checklist with per-stage state icons - Overall progress bar + current-stage spotlight - Auto-expanded installer-output panel on failure - "Copy output" button (full ring buffer + error to clipboard) - "Reload and retry" wired through hermes:bootstrap:reset to clear main.cjs's latched failure Synthetic empty-manifest event from main.cjs flips the overlay to 'active' immediately so the slow install.ps1 download doesn't leave the user staring at the generic Preparing splash. Failure latching (main.cjs) bootstrapFailure module-scope variable holds the rejection after install.ps1 fails. startHermes() throws the latched error immediately when set, bypassing the entire ensureRuntime + runBootstrap chain. Without this, the renderer's ensureGatewayOpen retries would re-run install.ps1 in a 5-10 min hot loop while the user was still reading the failure overlay. Cleared via hermes:bootstrap:reset on user-driven retry. Unsupported-platform overlay (1F) macOS / Linux packaged builds (no install.sh stage protocol yet) emit an unsupported-platform event with a copy-pasteable install command + docs URL. Dedicated overlay branch with "Copy command" + "I've run it -- retry" buttons. install.ps1 additions (Phase 1F.3 + 1F.5) ----------------------------------------- New -Commit and -Tag string params. Precedence Commit > Tag > Branch. Honoured by all three code paths (update / fresh clone / ZIP fallback), with archive URL selection that handles each ref-type variant. Detached-HEAD checkouts intentionally -- they're pins, not branches the user pulls into. EAP=Continue wrap around the new pin-step git invocations. `git fetch origin <commit>` writes the routine 'From <url>' info line to stderr; under the script's global EAP=Stop that terminates the script even though fetch+checkout succeed. Matches the established pattern in Install-Uv, Test-Python, _Run-NpmInstall. Backend fix (hermes_cli/web_server.py) -------------------------------------- CORS allow_origin_regex now accepts Origin: 'null'. Packaged Electron loads index.html via file://; Chromium sets the WebSocket upgrade Origin header to the opaque origin 'null', which the old regex rejected with HTTP 403 before gateway_ws() ever ran. This failure mode was masked in the older FACTORY_HERMES_ROOT architecture because the resolver often found an existing hermes on PATH with different binding behavior. Security maintained: localhost-only bind keeps cross-machine pages out; per-process session token still gates every authenticated /api/ endpoint regardless of Origin. Desktop QoL ----------- DevTools is now enabled in packaged builds (F12 / Cmd+Opt+I). Field-debugging trade-off: tiny attack surface increase versus a much better support story when CSP / WS / theme issues surface. NSIS prereq-check page deleted (-767 lines). The standard Welcome -> License -> Directory -> InstallFiles -> Finish wizard now installs without custom Python/Git/ripgrep detection -- those prereqs are install.ps1's job at first launch. Test infrastructure (Phase 1G) ------------------------------ apps/desktop/scripts/test-desktop.mjs rewritten as a cross-platform bundle validator (was darwin-only and asserted on dead factory- payload paths): NEGATIVE: hermes_cli/main.py is NOT shipped (regression guard) POSITIVE: install-stamp.json carries a real commit + branch POSITIVE: node-pty native deps shipped under resources/native-deps POSITIVE: renderer dist/index.html reachable (asar or unpacked) New nsis mode and npm run test:desktop:nsis script. Validated end-to-end on clean Win10 VM -------------------------------------- Confirmed: NSIS installer drops Electron shell, app launches, install overlay shows progress, install.ps1 clones the pinned commit, 14 stages run to completion, marker written, backend spawns, WebSocket connects, onboarding overlay asks for API key, main UI loads, integrated terminal works. Failures handled: bootstrap stays failed (no hot-loop retry), "Copy output" gives actionable transcript, "Reload and retry" explicitly re-runs install.ps1. What's deferred --------------- - MSIX wrapping (Phase 2): same Electron .exe under MSIX manifest with runFullTrust, signed and submitted to Microsoft Store. - install.sh stage protocol parity (Phase 2): once shipped, the unsupported-platform overlay becomes drive-it-yourself and macOS/Linux packaged installers gain feature parity with Windows. * feat(desktop): persistent terminal pane + fullscreen takeover Adds a VSCode-style "focus terminal" toggle to the right sidebar's Terminal tab that takes over the chat pane area without unmounting the shell. The xterm host is mounted once at the layout root and CSS-overlayed onto whichever <TerminalSlot /> is currently active, so the PTY session, scrollback, selection, focus, and WebGL renderer survive every toggle. Also: - WebGL renderer (matching dashboard ChatPage) so Hermes' TUI skins paint faithfully instead of muting through xterm's default DOM renderer - File drag/drop from the project tree or OS into xterm — paths are shell-quoted (zsh/bash/pwsh/cmd) and written straight into the PTY - Solarized dark canvas with brights promoted to real accent variants (Schoonover's UI-gray brights washed out every TUI accent) - Strip NO_COLOR/FORCE_COLOR/COLORFGBG/TERM=dumb leaking from non-tty parents (CI runners, Cursor's agent shell) so the embedded shell gets truecolor regardless of how Electron was launched - rAF-debounced ResizeObserver — running fit.fit() synchronously during sibling pane transitions crashed the WebGL texture-atlas rebuild * fix(install.ps1): strip UTF-8 BOM regression that broke 'irm | iex' The canonical install flow irm https://raw.githubusercontent.com/.../scripts/install.ps1 | iex fails on PowerShell 5.1 with a cascade of 'The assignment expression is not valid' errors at every param() default value: [string]$Branch = 'main', ~~~~~~ The assignment expression is not valid. The input to an assignment operator must be an object that is able to accept assignments... Root cause: scripts/install.ps1 carries a UTF-8 BOM (0xEF 0xBB 0xBF) as its first three bytes. 'irm' returns the response body as a string; on PS 5.1 the BOM survives into that string as a leading \ufeff character. 'iex' then evaluates the string and PS's parser chokes on the invisible character before param() -- error recovery proceeds into the body but every assignment is reported as broken. This was the exact failure mode the install.ps1 hardening pass (PR #27224) deliberately fixed by stripping the BOM and ensuring the file body is pure ASCII. Commit4279da4db('fix(windows): make PowerShell installer parse in 5.1') re-introduced the BOM later, unintentionally undoing the irm|iex compatibility fix; the merge that brought it into bb/gui carried it forward. Fix: strip the three BOM bytes. File body is verified pure ASCII (any-byte > 127 returns false), so PS 5.1 with no BOM falls back to Windows-1252 decoding which is identical to ASCII for our content. Both install paths now work: - 'irm ... | iex' (canonical CLI) - 'powershell -File install.ps1' (programmatic / desktop bootstrap) * install.ps1: detect ARM64 Windows reliably for Node and Git stages Add a Get-WindowsArch helper that reads Win32_Processor.Architecture via CIM (invariant to PowerShell host bitness) with PROCESSOR_ARCHITEW6432 fallback. Use it in: - Install-Git: previously only triggered the arm64 PortableGit asset when invoked from a native-ARM64 PowerShell host. WoW64 / emulated x64 hosts (the default powershell.exe on Windows-on-ARM) saw PROCESSOR_ARCHITECTURE=AMD64 and fell through to the x64 PortableGit build, leaving ARM64 users on emulated Git for Windows. - Test-Node: previously hardcoded the Node download to win-x64 on any 64-bit OS, so ARM64 users always got x64 Node under Prism emulation even though Node ships an arm64 build for Windows. The winget fallback now also passes --architecture arm64 on ARM64. Python remains x86_64 by design: uv intentionally prefers windows-x86_64 cpython on ARM64 hosts for ecosystem (wheel) compatibility (see astral-sh/uv#19015). * install.ps1: harden Install-SystemPackages against winget msstore failures The previous winget invocation discarded stdout/stderr and trusted no signal at all -- not the exit code (winget exits 0 even when it bails "please specify --source"), not output (sent to Out-Null), not the catch handler (winget returning 0 means no exception fires). The only trust signal was a post-install Get-Command rg / Get-Command ffmpeg check, which would also miss the package because %LOCALAPPDATA%\ Microsoft\WinGet\Links (where winget puts command aliases) is added to PATH by AppExecutionAlias machinery only in fresh shells. End result on machines where the msstore source has a cert problem (0x8a15005e -- common on Windows-on-ARM and some corporate networks): silent failure, no log, no breadcrumb, and the user is told the install succeeded. Specifically: - Pin --source winget on every winget install call. Defeats the broken- msstore-source path. We ship nothing from msstore so this is safe and forward-compatible. - Add --exact --id for a tighter package match. - Capture each winget invocation's combined stdout/stderr + exit code to %TEMP%\hermes-winget-<pkg>-<n>.log instead of Out-Null. On the happy path the log is deleted after the post-install check confirms the binary is on PATH; on failure the log is kept and its path is named in a Write-Warn so the user has something to grep. - Refresh PATH to include %LOCALAPPDATA%\Microsoft\WinGet\Links in addition to the User/Machine env-var hives, so Get-Command sees newly- installed winget aliases in the same process. - No behavior change on the happy path. Same Write-Info/Success/Warn cadence, same fallback order (winget -> choco -> scoop -> manual), same $script:HasRipgrep / $script:HasFfmpeg outputs. Verified end-to-end on a real Snapdragon ARM64 Windows host: ripgrep uninstalled, stage re-run, [OK] ripgrep installed in 1.4s, ok:true. * desktop: swap node-pty fork for upstream microsoft/node-pty 1.1.0 The previous dependency, @homebridge/node-pty-prebuilt-multiarch@0.13.1, publishes no win32-arm64 prebuilds on its v0.13.x line, and its v0.14.x betas (which do add an arm64 Windows build) ship no electron-vXXX-win32- arm64 prebuilds at all -- so packaged Electron 40 builds (NMV 143) would fail at runtime even on a successful npm install. Net effect: the desktop's integrated terminal was unbuildable on Windows-on-ARM, in both dev (npm install fails: 404 fetching the node-vXXX-win32-arm64 prebuilt) and packaged builds (no Electron-ABI prebuilt exists). The homebridge fork was originally created because upstream node-pty shipped no prebuilds at all. That hasn't been true since node-pty@1.0 (April 2024), which: - bundles prebuilts for mac (arm64+x64) and Windows (arm64+x64) directly inside the npm tarball -- no GitHub-Releases fetch, no missing-binary failure mode - uses N-API (node-addon-api) for ABI stability across Node and Electron major versions, so the same pty.node binary loads under Node 22 (dev) and Electron 40+ (packaged) without per-ABI rebuilds - is what VS Code, Hyper, and Theia actually ship API surface is identical (spawn / onData / onExit / write / resize / kill) -- no call-site changes needed. Specifically: - apps/desktop/package.json: replace the @homebridge fork with node-pty@1.1.0 (exact pin). Widen `asarUnpack` from `["**/*.node"]` to also unpack `**/prebuilds/**`, because node-pty ships runtime- execed helpers alongside its .node files (darwin spawn-helper has no extension and would not be matched by `**/*.node`; conpty.dll, OpenConsole.exe, winpty.dll, winpty-agent.exe on Windows are also exec'd at runtime and cannot live inside asar). - apps/desktop/electron/main.cjs: update both require() strings to match the new package name and the new staged path under resources/native-deps/node-pty/. - apps/desktop/scripts/stage-native-deps.cjs: point at node_modules/ node-pty. node-pty's prebuilts live under prebuilds/<plat>-<arch>/ (not build/Release/), so update the include glob to copy that dir. Per-arch staging keeps the resource bundle small (target arch comes from npm_config_arch when electron-builder cross-builds, else process.arch). Explicitly enumerate file types in the prebuilds glob so the ~25 MB of .pdb debug symbols that prebuild-install bundles for Windows crash analysis don't bloat the installer (29 MB -> 2.6 MB staged on win32-arm64). Re-assert +x on the darwin spawn-helper defensively, since a stripped mode bit would manifest as a silent ENOENT at first pty.spawn(). - apps/desktop/scripts/test-desktop.mjs: update expectedNativeDepPaths() and its assertion site to look at prebuilds/<plat>-<arch>/ instead of build/Release/. Add an explicit spawn-helper-exists check on darwin so a regression in the asarUnpack glob would fail loudly in CI rather than at first PTY spawn. Trade-off: Linux end-users lose prebuilts and fall back to building node-pty from source on `npm install`. Acceptable because Hermes ships no Linux desktop builds (desktop-release.yml matrix is mac + win only, package.json declares no `linux` target), and Linux developers hacking on the desktop already need a C++ toolchain for the rest of the stack. Verified on Windows 11 ARM64 (Snapdragon): npm install -> exit 0 node -e "require('node-pty').spawn(...)" round-trip -> OK stage-native-deps -> 27 files, 2.6 MB load from staged tree (simulates packaged fallback) -> ConPTY round-trip OK * desktop+gateway: harden Slack socket recovery and Windows restart dedupe (#28873) * desktop+gateway: harden Slack socket recovery and Windows restart dedupe Fix Slack Socket Mode reliability by adding a watchdog/reconnect path so silent socket task drops no longer leave the adapter stuck. Harden Windows gateway lifecycle by avoiding desktop-binary path collisions, making gateway PID scans case/extension tolerant, and reusing in-flight restart actions to prevent duplicate gateway spawns. * test(slack): add Socket Mode watchdog/reconnect behavioural coverage Drive the new Slack Socket Mode self-healing logic through a fake AsyncSocketModeHandler so we can simulate the P0 silent-hang failure mode (task exit, transport disconnected, intentional shutdown, concurrent reconnect attempts) without touching real Slack. * fix(slack,desktop): address Copilot review on watchdog races and path normalization - connect(): explicitly cancel + await the prior socket watchdog before flipping _running, so an old monitor cannot exit between teardown and respawn (Copilot #1) - _socket_watchdog_loop: wrap the body in try/except + add a done-callback that respawns on unexpected crash, so a transient bug cannot permanently disable self-healing (Copilot #2) - normalizeExecutablePathForCompare: use the resolved path for realpathSync so non-string inputs cannot leak through (Copilot #3) - Add tests for crash-recovery and atomic watchdog replacement across reconnects * fix(slack): tighten connect() error path and clarify watchdog test intent Address Copilot review round 2. - connect(): wrap _start_socket_mode_handler/_ensure_socket_watchdog in a focused try/except so any failure rolls back partially-started handler/task state and leaves _running=False, ensuring the platform lock is always released by the outer finally - Defer _running=True until after the handler is actually started so the watchdog observes a live socket task immediately and never spins against a half-built adapter - Rename test_watchdog_self_restarts_after_unexpected_crash to test_watchdog_cancellation_does_not_respawn (matches what it actually asserts) and add test_watchdog_unexpected_exit_respawns_via_done_callback that drives a real RuntimeError through _on_socket_watchdog_done and verifies a fresh task replaces the crashed one * fix(web_server): serialize action spawn check+store under a threading lock Address Copilot review round 3. FastAPI runs sync handlers on its threadpool, so two near-simultaneous /api/gateway/restart (or /api/hermes/update) requests could both observe "no live process" in _spawn_hermes_action's poll-based dedupe and double-spawn. Add a module-level _ACTION_SPAWN_LOCK around the entire check + Popen + _ACTION_PROCS store sequence so the dedupe is atomic across threads. * fix: address Copilot review round 4 - slack.disconnect(): mirror connect()'s defensive cleanup — catch the broad Exception path on watchdog await so handler shutdown and lock release still run if the watchdog raised before cancellation took effect - web_server._spawn_hermes_action: wrap subprocess.Popen in try/except so a missing executable / permission error closes the log file handle, writes a failure marker, and re-raises instead of leaking a file descriptor - gateway._scan_gateway_pids: drop the over-broad "hermes.exe --profile" / "hermes.exe -p" patterns that would match any Hermes CLI subcommand using a profile flag (e.g. `hermes.exe --profile foo dashboard`); rely on the "hermes.exe gateway" + "hermes-gateway.exe" tokens instead - tests: tighten _fake_create_task to assert coroutine input and return a real asyncio.Task that stays pending until pytest teardown, and update the three callsites whose mocked AsyncSocketModeHandler.start_async returned a non-coroutine value * fix(slack): reset multi-workspace state on reconnect Address Copilot review round 5. connect() is reentrant (gateway restart, in-process reconnect), but it was leaving _bot_user_id / _team_clients / _team_bot_user_ids populated from the previous session. A reconnect that rotated the primary token or dropped a workspace would silently keep the stale bot user id and stale workspace client maps, leading to dispatch against gone workspaces. Clear these three pieces of state right after _stop_socket_mode_handler() and before the auth_test loop, then let the loop repopulate from the current tokens. Add test_reconnect_refreshes_multi_workspace_state to lock it in. * nix: package apps/desktop as .#desktop (#28964) Adds nix/desktop.nix building the Electron renderer with buildNpmPackage and wrapping nixpkgs' electron binary. Reuses .#default by setting HERMES_DESKTOP_HERMES to its hermes binary, so the desktop's resolver picks up the fully-wired nix hermes (venv, bundled skills/plugins, runtime PATH) without reimplementing agent resolution. - nix/desktop.nix: renderer + electron wrapper - nix/hermes-agent.nix: finalAttrs form, exposes hermesDesktop in passthru - nix/packages.nix: exposes .#desktop + adds to fix-lockfiles - apps/desktop/package-lock.json: standalone hermetic lockfile nix build .#desktop && nix run .#desktop both clean. * fix(desktop): probe steps 4 & 5 of resolveHermesBackend before trusting A user-reported failure on Windows-on-ARM: a pre-installed Python 3.13 on PATH makes findSystemPython() succeed, so resolveHermesBackend returns a backend pointing at it -- but hermes_cli isn't in that interpreter's site-packages. The spawn dies with ModuleNotFoundError and the user sees a dead GUI instead of the first-launch installer. Same shape can hit step 4 (existing `hermes` on PATH) when a stale shim survives a partial uninstall. Add cheap exit-code probes -- `python -c "import hermes_cli"` for step 5, `<hermes> --version` for step 4 -- and fall through to step 6 (bootstrap-needed) on failure. install.ps1 then runs as if on a clean box and the venv gets built. Probes live in a standalone electron/backend-probes.cjs module so they can be unit-tested with node --test, same pattern as bootstrap-platform.cjs and hardening.cjs. New test file wired into test:desktop:platforms. * test(desktop): allow `node-pty` bare-require in packaged entrypoints Pre-existing failure on bb/gui sincec858484b4swapped the node-pty fork for upstream microsoft/node-pty 1.1.0. main.cjs intentionally bare-requires node-pty (it's hoisted by workspace dedup in dev, and staged to resources/native-deps via scripts/stage-native-deps.cjs + extraResources for packaged builds, with a try/catch fallback at line ~38). The allowlist hadn't been updated to match -- same shape as `electron`, which was already allowed. * chore(deps): refresh root lockfile for dashboard @nous-research/ui 0.14.0 apps/dashboard/package.json was bumped to @nous-research/ui 0.14.0 (+ flag-icons ^7.5.0, motion ^12.38.0) but the root package-lock.json was never refreshed. Running `npm install` from the repo root now materialises 0.14.0's transitive closure (launder, bumps for @nanostores/react, nanostores, sanitize-html, tailwind-merge). No code changes; purely a lockfile catch-up so fresh checkouts on bb/gui get a working dashboard install. * chore(desktop): bump version to 0.0.1 First non-placeholder version so electron-builder's artifactName template produces `Hermes-0.0.1-win-x64.exe` instead of the obviously-unreleased `Hermes-0.0.0-...`. No release process yet; this just stops the artifact filename from telling users "you got a debug build." Bumped in three slots that all carry the desktop app's version: - apps/desktop/package.json (source of truth) - apps/desktop/package-lock.json (per-app lockfile, kept for CI parity) - root package-lock.json's apps/desktop workspace entry Identity-of-build for first-launch bootstrap continues to come from build/install-stamp.json (commit SHA + builtAt), unchanged. * fix: fs icon color * perf(desktop): cut per-keystroke layout + listener churn in chat composer Empirical work via CDP harnesses under apps/desktop/scripts/ (see profile-typing-lag.md): jsListeners growth (per round of 200 chars + GC): before: +35 (verified leak — listeners stuck after 1st trigger popover use) after: +0 Four narrow edits in src/app/chat/composer/index.tsx: 1. Drop the per-keystroke `editorRef.current.scrollHeight` read used to decide composer expansion. Replace with `draft.length > 60` heuristic; the existing ResizeObserver still catches edge cases. `scrollHeight` is a forced-layout call and was firing on every char until the first wrap. 2. Bucket measured composer height to 8px before writing `--composer-measured-height` / `--composer-surface-measured-height` on `documentElement`. Without this, the editor grows ~1px per char, setProperty fires every keystroke, computed style is invalidated tree- wide. 3. Remove the dead `$composerDraft` two-way sync. Nothing outside the composer subscribed to that atom (verified via grep). Two useEffects on `[draft]` were pushing draft→atom and atom→aui per keystroke for no consumer. Also drop the per-keystroke `reconcileComposerTerminalSelections` call; it was pruning stale labels for `terminalContextBlocksFromDraft`, but that helper already ignores labels not in the current submitted text, so pruning per keystroke was just bookkeeping. 4. `refreshTrigger` fast-bails when the draft contains neither `@` nor `/`. Previously `textBeforeCaret(editor)` ran on every input/keyup regardless; `range.toString()` inside is O(n) over draft length. Synthetic typing latency p50/p90/p99 is similar before vs after on a freshly-loaded session (Blink can already handle ~30cps typing into a contentEditable on its own); the real win is the listener leak being gone and the global computed-style invalidations dropping ~8× when the composer is sitting at a fixed height row. The `Enter → stall` follow-up (see profile-typing-lag.md §"Submit / TTFT stall") is unmeasured here — needs a throwaway session because the harness fires a real prompt. Not blocking this commit. * perf(desktop): cut FadeText forced layouts during streaming The slowest user-felt path is typing into the composer while the assistant is streaming. Profile (scripts/profile-under-stream.mjs): FadeText measureOverflow self time: 35.8 ms → 18.1 ms (-50%) total active CPU during 7s window: ~150 ms → ~50 ms Two changes in src/components/ui/fade-text.tsx: 1. Drop the `useEffect([children])` that re-ran `measureOverflow` (reads scrollWidth + clientWidth — forced layout) on every parent re-render. `useResizeObserver` already fires the same callback on mount and whenever the host span's box size changes; that covers the only case where overflow state can legitimately change. The previous explicit useEffect was a forced-layout flush on every parent render, which during streaming meant every token tick. 2. Wrap the component in `memo` with a custom comparator that short-circuits the entire render when scalar string `children` and the className/fadeWidth/style props are unchanged. The hot path was tool-fallback's title chips being re-rendered by parent streaming updates even though their text was stable; memo+ comparator skips that. Also adds two harness scripts under apps/desktop/scripts/: - latency-under-stream.mjs (key→paint latency while a turn streams) - profile-under-stream.mjs (CPU profile while a turn streams) Updates profile-typing-lag.md with the streaming numbers and confirms the Enter→paint submit path is already fast (≤320ms on the populated session; the 2s "stall after Enter" the user noticed once was a one-time cold-start, not reproducible at the UI layer). I'd guess the felt jank in real use is fast-burst typing during a long-form streaming reply (code blocks + markdown lists multiply the per-token render cost). The CPU savings here scale linearly with token volume. * chore(desktop): drop diag scratch scripts no longer needed * docs(desktop): correct leak-typing numbers on a real session Re-ran the leak harness on a populated session (Phaser thread) for both unpatched and patched builds. The original 'listener leak' was transient warm-up cost, not a steady-state leak — both versions show 0 listener growth/round in steady state. The load-bearing number is forced layouts per character: unpatched (HEAD~2): 7.02 layouts/char patched (HEAD): 2.35 layouts/char (3× fewer) The patches reduce per-char forced-layout work to Blink's natural floor. Document node count and heap are flat in both builds. * perf(desktop): fix "Enter jumps up" on long threads User reported: after pressing Enter on a long thread, the view jumps up — the just-submitted message disappears below the fold. Confirmed via apps/desktop/scripts/measure-jump.mjs: before: distFromBottom 0 → 49.5px, sticks there permanently after: distFromBottom 0 → ~0 (worst case 4px for one frame) Root cause in useThreadScrollAnchor (thread-virtualizer.tsx): 1. The sticky-bottom logic disarmed on any scroll event where `scrollTop < lastTopRef.current`. That check can't distinguish a user scrolling up from a programmatic `pinToBottom` write that the browser clamped short of bottom (because content also grew in the same frame, so `scrollTop = scrollHeight` lands at `scrollHeight - clientHeight` for the OLD scrollHeight, which is now below the NEW scrollHeight). Result: sticky-bottom disarmed permanently on the user's first submit. 2. There was no synchronous pin tied to React's commit phase. By the time the ResizeObserver fired and re-pinned, the user had already seen ~50ms of "message below the fold" — visually that reads as the view jumping up. Fix: - `programmaticScrollPendingRef` counter tracks scroll events we expect to be ours (one per `pinToBottom` write). The scroll handler skips the disarm check when consuming a pending tick, keeps the arm bit true, and re-pins synchronously if the browser clamped us short of bottom. A depth cap (8) breaks runaway loops in pathological streaming-burst layouts. - `useLayoutEffect` on `groupCount` increase pins BEFORE the browser paints, eliminating the visible ~50ms window between optimistic user-message insert and the RO/scroll-event chain firing. Verified on the long Cloud Shadows thread (7-8 turns, ~11k px tall): all three repro runs now hold within 0–4 px of bottom across the post-Enter transition. Submit latency unchanged (paint 77–107 ms), streaming-typing latency unchanged. Also adds three debug harnesses: - measure-jump.mjs — sample thread scroll across Enter - probe-thread.mjs — dump current thread / scroll state - diag-jump.mjs — intercept scrollTop + RO + mutations across Enter * perf(desktop): rate-limit thread auto-pin during streaming Follow-up to the Enter-jump fix. The first version did a synchronous re-pin loop inside the on-scroll handler when the browser clamped our `scrollTop = scrollHeight` write short of the new bottom; that gave a tight 4 px visible jump on Enter, but during streaming the ResizeObserver fires many times per second as content grows, and each RO callback re-entered the pin loop. CPU profile showed `Virtualizer.getMaxScrollOffset` climbing to 22 ms self over a typing- during-streaming window — the sync re-pin path was paying tanstack- virtual's recompute cost ~3× per token. Re-architect: - RO callback coalesces to one pin per animation frame. Streaming-rate RO bursts now cost the same as a single per-frame pin. - The on-scroll programmatic-counter guard remains (it's what prevents the false-disarm bug when the browser clamps a write). It no longer does sync re-pins; the next RO/rAF will catch up. - The useLayoutEffect on groupCount (the path that fires on user submit / new turn arrival) ALSO schedules one rAF pin in addition to the synchronous pin. This catches the case where React mounts the new message in a second commit (after our layout effect ran), which grows scrollHeight again. Two pins instead of a tight loop, paid only once per turn change. Net effect on the Cloud Shadows long thread: enter-jump transient: 12–20 px for 1 frame (was 49 px permanent) CPU during stream+type: `getMaxScrollOffset` dropped out of top-5 self-time list typing-during-stream: p50 ~10 ms paint, p99 ~20 ms (1 frame), occasional 40 ms+ outliers during burst token arrivals Also adds scripts/profile-long-stream.mjs: 20-second streaming profile with per-500ms FPS histogram + content-length tracking, so we can see whether streaming render cost grows with message length (it doesn't — sustained 60 fps). * perf(desktop): use textContent for trigger precondition Replace composerPlainText() call inside refreshTrigger's no-trigger fast-bail with a textContent check. textContent is a browser-native flat traversal; composerPlainText walks recursively with chip-aware logic. We only need to know if @ or / appears; either way the trigger char will be in textContent because chips contain @ in their refText. Profile shows composerPlainText was ~18ms self over a 12s typing-during- stream window, called from refreshTrigger on every keystroke. Most of that was the precondition check (the trigger detection path is the slow path but only runs when a trigger char is present). * Revert "perf(desktop): use textContent for trigger precondition" This reverts commita6a78ff08a. * Revert "perf(desktop): cut FadeText forced layouts during streaming" This reverts commit88e7d7537c. * Revert "perf(desktop): cut per-keystroke layout + listener churn in chat composer" This reverts commitbff1b3261d. * Revert "Revert "perf(desktop): cut per-keystroke layout + listener churn in chat composer"" This reverts commitb7b378e3a4. * Revert "Revert "perf(desktop): use textContent for trigger precondition"" This reverts commit0739588f48. * chore(desktop): synthetic-stream perf harness + scripts Drops the React `<Profiler>` approach (no-op because Vite is currently serving the production React build) in favor of an externally-observable measurement stack: rAF frame intervals, `PerformanceObserver({entryTypes: ['longtask']})`, and a `MutationObserver` on the live streaming message. Adds a synthetic stream driver — `window.__PERF_DRIVE__.stream({...})` — that pushes tokens through the live `$messages` atom at a controlled rate, so the assistant-ui runtime, incremental repository, and Streamdown markdown pipeline see the same workload they'd see during a real LLM stream, without the LLM cost. The driver lives in `src/app/chat/perf-probe.tsx`; `main.tsx` side-imports it under `import.meta.env.MODE !== 'production'` so it tree-shakes out of prod builds. (Using `MODE` rather than `DEV` because our Vite setup currently reports `DEV=false` even under `vite dev` — see the dev-build note in `profile-typing-lag.md`.) Scripts: - measure-synthetic-stream.mjs drive synthetic + record frame/longtask/mutation - profile-synth-stream.mjs CPU profile + top self-time during synthetic - measure-real-stream.mjs same harness, real LLM stream - profile-real-stream.mjs CPU profile bracketing the real stream window - eval.mjs / reload.mjs small CDP helpers A real-LLM measurement on Cloud Shadows (gpt-4o-mini, 39 s window) showed 12 longtasks in the same 75-127 ms range the synthetic predicted, so the synthetic is a faithful proxy. * perf(desktop): memo FadeText so it skips re-renders when text unchanged FadeText is used 110+ times inside `tool-fallback.tsx` on a tool-heavy thread. During streaming each parent re-render previously triggered the component's `useEffect([children])`, which forced a `scrollWidth` layout read even when the title text was unchanged. The `useResizeObserver` was already covering the genuine resize case, so that effect was strictly redundant work. Drops the effect and wraps the component in `React.memo` with a custom comparator that field-compares `className`, `fadeWidth`, and `style`, plus identity-compares `children` (scalar fast-path; correct for JSX nodes too since a new node should force a re-render). Verified via temporary render counter on the 34 MB `session_20260514_215353_fe0ac8` thread (110 FadeText instances): a 2 s synthetic stream went from ~11k FadeText render calls to 122 — roughly one render per truly-new instance instead of one per parent commit per instance. Doesn't move the longtask needle on its own (Streamdown's markdown re-parse dwarfs it) but eliminates a steady CPU floor and a class of forced layouts during streaming. Profile-typing-lag.md documents the full investigation, including the remaining Streamdown cost as the real source of the perceived "5 fps moment" hitches. * perf(desktop): memoize MarkdownText plugins to stop churning Streamdown The inline `plugins={{ math: mathPlugin, ...(isStreaming ? {} : { code }) }}` on `<StreamdownTextPrimitive>` constructed a new object literal on every parent render. That broke `<Streamdown>`'s outer memo and forced its internal `rehypePlugins` / `remarkPlugins` array useMemos to rebuild, which propagates a new identity into every `<Block>` and defeats Block's memoization for stable historical blocks. After memoizing on `[isStreaming]` (the only real dimension of variance), CPU profile during a 5 s synthetic stream on the 34 MB session shows `parser` self-time dropping out of the top 10, `compile` cut roughly in half, and `bn$1` / `m$1` (micromark internals) leaving the top entries. Doesn't move the visible longtask count on its own — Streamdown's per-Block parse cost still dominates whenever the last block's content changes — but it removes a class of unnecessary re-parses for historical blocks during streaming. See `scripts/profile-typing-lag.md` for the full investigation. * perf(desktop): floor assistant-text flush gap to 33ms for predictable batching `scheduleDeltaFlush` previously coalesced via `requestAnimationFrame` only. The "at most one flush per frame" guarantee that gives you is fine for fast streams (>~80 tok/sec) where multiple tokens arrive within a single frame, but breaks down at typical LLM token rates (30-80 tok/sec) where each token arrives slower than the rAF cadence and triggers its own React commit + Streamdown markdown re-parse. Track `lastFlushAt` and require at least 33 ms between two flushes. React 18+ auto-batching probabilistically already collapsed some of these, but the floor makes it deterministic. A/B on the 34 MB session, 300 tokens at 50 tok/sec (markdown chunks): | | avgFps | p99 frame | LTs / 5 s | max LT | |---|---|---|---|---| | no floor (current rAF) | 54.0 | 38 ms | 2.0 | 145 ms | | 33 ms floor (this PR) | 54.3 | 41 ms | 1.7 | 110 ms | `inter-mutation` p50 also tightens from 22-28 ms to a clean 33 ms, which is the expected signature of a deterministic floor. Doesn't fully solve the user's perceived hitches — Streamdown's per-Block parse cost when the last block grows past ~2 k chars is still the elephant — but it consistently shaves the worst-case longtask and makes the streaming cadence visibly steadier. Also threads a matching `flushMinMs` option through the synthetic stream driver in `perf-probe.tsx` + `scripts/measure-synthetic-stream.mjs` so the harness can A/B both regimes without spending LLM credits. See `scripts/profile-typing-lag.md` for the full investigation. * perf(desktop): useDeferredValue for streaming markdown so parses don't block input Streamdown's per-Block parse cost grows with the live tail's length and is unavoidable inside the block-memo pattern (industry standard, see findings doc). The fix is to stop having that work block the main thread. `<DeferStreamingText>` is a 12-line wrapper that reads message-part state via `useMessagePartText`, runs it through `useDeferredValue`, and re-publishes via assistant-ui's `<TextMessagePartProvider>`. The inner `<StreamdownTextPrimitive>` reads the deferred value through the normal `useMessagePartText` hook — no fork, no internal-path imports, fully on assistant-ui's public API. React's concurrent scheduler then: - abandons in-flight deferred renders when a newer token arrives, so intermediate states get skipped under fast streams - deprioritises the markdown render when the main thread has urgent work (typing, scroll), so input stays responsive even while a 100ms parse is queued Streamdown already uses `useTransition` for its block-array setState; this lifts the deferral up to the consumer boundary so it covers the whole pipeline (preprocess → split → repair → parse → render). A/B on the 34 MB session, 300 tokens at 50 tok/sec, markdown chunks (four trials each, with the 33ms flush throttle on for both): | | avgFps | p99 frame | LTs/5s | max LT | typing-while-stream p95 | |---|---|---|---|---|---| | pre | 54.3 | 41 ms | 1.7 | 110 ms | ~17 ms | | post | 58.5 | 31 ms | 2.0 | 117 ms | 14-18 ms | Longtask count + max LT unchanged — useDeferredValue doesn't reduce CPU, only its priority. The avgFps lift and p99 frame drop are the proof that the existing CPU is no longer blocking 60 fps cadence. One clean run logged MUTATIONS=0 — React skipped every intermediate text state and only committed the final one (textbook deferred-value behaviour). The actually-reduce-CPU path is replacing the parser with a state machine like Flowdown — left for a future PR; see `apps/desktop/scripts/profile-typing-lag.md` for the full investigation. * feat(desktop): add hermes gui launcher * feat(desktop): launch packaged gui builds by default * bump gui version to 0.0.2 * fix(dashboard): allow file:// origin on loopback WS + diagnostic logging Upstream commit2e66eefbc("fix(dashboard): validate WebSocket Host and Origin") added a WebSocket Host/Origin guard to block DNS rebinding against the dashboard. The guard rejects any Origin whose scheme is not http/https or whose netloc is empty — which includes Electron's renderer Origin: file:// when the desktop app loads its bundle from disk in production mode. That makes the bb/gui Electron desktop unable to open the gateway WebSocket against the embedded backend on Windows / macOS prod builds. The renderer reports "Desktop boot failed" and the backend logs: WARNING hermes_cli.web_server: gateway-ws reject peer=127.0.0.1:NNNN reason=non_loopback_or_bad_origin bound_host=127.0.0.1 close_code=4403 DNS-rebinding requires a DNS-resolvable hostname; file:// has no host component and therefore cannot be the attack vector this guard exists to block. When bound to a loopback interface (127.0.0.1 / ::1 / localhost), accept file:// origins so desktop wrappers can attach. Non-loopback binds (operator opted into network exposure) keep rejecting file:// — the loose policy doesn't apply. Also adds per-reason diagnostic logging in _ws_host_origin_is_allowed, so future ws-guard rejections name the specific clause that fired (bad_host / bad_origin_scheme / origin_host_mismatch) instead of the opaque "non_loopback_or_bad_origin" surfaced at the call site. Verified against tests/hermes_cli/test_web_server_host_header.py (all 11 upstream tests still pass) and hand-tested by opening the bb/gui Electron desktop dev build against the patched backend. * fix(tui_gateway): restore _content_display_text helper Bb/gui had dropped the helper but the orchestrator code merged from main still calls it (_inflight_text, _message_preview). Re-add the definition verbatim from main so session.create / _start_inflight_turn don't crash with NameError on first prompt submit. * fix(tui-gateway): restore _content_display_text helper lost in main merge The May 27 merge of origin/main into bb/gui re-introduced two callers of _content_display_text (in _inflight_text and _history_to_messages) but dropped the helper definition itself, leaving an unresolved reference. NameError fires on every user message via _start_inflight_turn -> _inflight_text, taking down both the TUI and the desktop (which share this gateway backend) the moment input is dispatched. Restores the helper verbatim from main (commit36c99af37) -- pure structured-content text extractor, no other dependencies. * fix(telegram): import Set for _dm_topic_chat_ids annotation self._dm_topic_chat_ids: Set[str] = {...} at line 460 references Set but only Dict, List, Optional, Any are imported from typing. The file has no 'from __future__ import annotations', so the annotation is evaluated at runtime and raises NameError on TelegramAdapter construction. * fix(setup): drop shadowing inner importlib.util re-imports _print_setup_summary and _setup_tts_provider each had 'import importlib.util' inside a try: block nested deeper in the function body. Python flips importlib to function-local for the whole scope, so earlier references in the same function (the neutts branches at lines 493 / 1109) hit UnboundLocalError before the late import can run. The top-of-module 'import importlib.util' at line 14 already covers both call sites, so dropping the redundant inner imports restores the intended behavior. * feat(install.ps1): add -IncludeDesktop switch + Stage-Desktop The new Hermes-Setup.exe (Tauri bootstrap installer) passes -IncludeDesktop so users who install via the GUI end up with a launchable Hermes.exe at apps/desktop/release/<os>-unpacked/. Existing flows are unchanged: * The 'irm install.ps1 | iex' CLI one-liner omits the flag — terminal users don't need a prebuilt desktop binary; 'hermes desktop' builds on demand. * The Electron desktop's bootstrap-runner.cjs also omits the flag — rebuilding apps/desktop from inside a running Hermes.exe would try to overwrite the live binary on disk and fail. Stage-Desktop runs after Stage-NodeDeps so workspace npm is already installed when electron-builder fires. It does: 1. 'npm install' at repo root so apps/* workspaces resolve their deps (Electron itself arrives via npm here, ~150MB) 2. 'npm run pack' in apps/desktop (tsc + vite + electron-builder --dir) 3. Probes apps/desktop/release/{win-unpacked,win-arm64-unpacked}/Hermes.exe The --dir mode produces an unpacked launchable binary without an NSIS/MSI installer artifact — we don't need one because Hermes-Setup.exe spawns the unpacked binary directly via launch_hermes_desktop. * feat(installer): Tauri bootstrap installer for first-time onboarding Hermes-Setup.exe is a small signed Rust+Tauri binary that drives scripts/install.ps1 stage-by-stage with a native UI matching the desktop's design language. Replaces the chicken-and-egg pattern of shipping a 200MB Electron app whose first launch existed only to run install.ps1. The architecture: Rust backend (src-tauri/): bootstrap.rs orchestrator -- Tauri commands, stage iteration install_script.rs resolve install.ps1 (dev checkout, cache, GitHub raw) powershell.rs spawn powershell, line-stream stdout/stderr, parse JSON events.rs BootstrapEvent types -- mirror bootstrap-runner.cjs paths.rs HERMES_HOME resolution + tracing log setup build.rs bakes BUILD_PIN_COMMIT / BUILD_PIN_BRANCH from 'git rev-parse HEAD' at compile time React frontend (src/): Tauri webview rendering 4 screens (welcome / progress / success / failure), driven by nanostores subscribing to the Rust event stream. Visual layer reuses the desktop's styles.css wholesale via @import so the installer and desktop never drift visually. Distribution: targets = ['app', 'dmg', 'appimage'] -- no NSIS/MSI wrapper. The raw target/release/Hermes-Setup.exe IS the artifact on Windows; .dmg + .app on macOS; AppImage on Linux. One file, double-click, no installer-installing-an-installer pattern. Compile-time pinning: build.rs reads 'git rev-parse HEAD' and emits cargo:rustc-env=BUILD_PIN_COMMIT=<sha> + BUILD_PIN_BRANCH=<branch>. bootstrap.rs's option_env!() picks these up so the binary fetches install.ps1 from the exact SHA it was tested against. CI / release builds can override via HERMES_BUILD_PIN_COMMIT env var. Windows manifest: hermes-setup.manifest declares level='asInvoker' so the productName 'Hermes Setup' doesn't trip Windows's installer- detection heuristic and refuse to launch without elevation. Also declares PerMonitorV2 DPI + UTF-8 active code page + Common Controls v6. Limitations of this initial version: * No code signing -- Windows SmartScreen will warn once on Hermes-Setup.exe ('More info -> Run anyway'). The downstream binaries it produces (Hermes.exe in win-unpacked/, the hermes CLI) are locally-built and therefore don't carry MOTW, so they launch without SmartScreen intervention. Cert procurement tracked separately. * macOS and Linux build paths defined but untested -- Windows-only V1. * fix(installer): pass -IncludeDesktop to manifest, surface launch errors, alias hermes desktop Three bugs found in the first VM end-to-end test: 1. install.ps1 -Manifest was called WITHOUT -IncludeDesktop, so the manifest came back with the 14-stage list (no desktop stage), the UI showed '14 steps' and Stage-Desktop never ran. Pass the flag to both the manifest fetch and the per-stage runs — install.ps1 gates the desktop stage's inclusion on the flag. 2. The Success screen's Launch button silently swallowed the Tauri error when no Hermes.exe existed (e.g. Stage-Desktop was skipped). Wire the error through to inline UI with an alert callout, so the user gets actionable text ('Hermes.exe missing, run hermes desktop from a terminal') instead of an unresponsive button. 3. The Success screen tells users to run 'hermes desktop' from a terminal but the CLI only accepted 'hermes gui' — invalid choice for 'desktop'. Rename the subcommand canonically to 'desktop' with 'gui' as a backwards-compatible alias. Update the _SUBCOMMANDS sets used by session-flag arg parsing + logging-mode probe so both names route to the same logic. * fix(install.ps1): pre-warm electron-builder winCodeSign cache + fix Stage-Desktop $HasNode false-skip Two bugs caught in the second VM end-to-end run: 1. electron-builder's winCodeSign extraction fails on grandma-class Windows boxes because the .7z archive contains macOS symlinks (darwin/10.12/lib/libcrypto.dylib and libssl.dylib pointing at versioned siblings). Creating symlinks on Windows requires SeCreateSymbolicLinkPrivilege, a per-user right that non-admin accounts don't have on stock Windows. Result: every fresh install on a non-admin user fails Stage-Desktop with a 7-Zip 'cannot create symbolic link' error, retried four times, then bails. Fix: Initialize-ElectronBuilderCache pre-extracts winCodeSign-2.6.0.7z ourselves with -snl (don't preserve symlinks, store as resolved file content) AND -x!darwin (skip the entire macOS subtree — irrelevant on Windows). Writes to electron-builder's expected cache dir before electron-builder gets a chance to try its own broken extraction. Idempotent — fast-paths via signtool.exe sentinel check. 2. Install-Desktop's first guard was 'if (-not $HasNode) skip'. $HasNode is set by Stage-Node into $script:HasNode, but in cross-process driver mode (each -Stage NAME is a fresh powershell.exe spawned by Hermes-Setup.exe), that script-scope variable from the PREVIOUS process is invisible — so the guard always fired and Install-Desktop returned in 900ms with a misleading 'Node.js not available' reason. The real npm probe below it never got to run. Fix: re-probe npm directly via Get-Command when $HasNode is empty/false, since by that point Stage-Node has already verified Node is installed and the only question is whether *this* process can see it on PATH (it can — installer-wide PATH update from Stage-Node). * fix(install.ps1): tell electron-builder we're NOT signing instead of pre-extracting winCodeSign The previous commit (c7e46f9f3) worked around the winCodeSign-symlinks- on-Windows extraction crash by pre-extracting the archive ourselves with -snl + -x!darwin. That fix was correct but addressed the wrong layer. The deeper question: why was electron-builder fetching winCodeSign at all when we have no signing cert configured? Answer: electron-builder unconditionally pre-warms the toolchain assuming any build MIGHT sign. The cert auto-discovery never finds anything (we never set CSC_LINK or anything else), so the signing never happens — but the 100MB fetch of winCodeSign and its broken-on-Windows symlink extraction does. Set CSC_IDENTITY_AUTO_DISCOVERY=false (with WIN_CSC_LINK and WIN_CSC_KEY_PASSWORD also explicitly cleared as belt-and-suspenders) before invoking npm run pack, and electron-builder skips the entire winCodeSign apparatus. No download, no extraction, no privilege check. Env vars are saved/restored around the invocation so we don't leak the override into Stage-PlatformSdks etc. Net: removes the 100-line Initialize-ElectronBuilderCache helper that manually downloaded + extracted winCodeSign-2.6.0.7z. Replaced with 3 env-var assignments. The produced Hermes.exe is functionally identical — just no longer carries a code-signing-machinery dependency we never used. * fix(installer): bump bootstrap-installer.log to capture stage transitions + every install.ps1 line Diagnosing the second VM failure was impossible because bootstrap-installer.log contained only the 'starting' banner. Two causes: 1. emit_log() inside run_bootstrap() was tracing::debug! — dropped on the floor under the default INFO env-filter. 2. The per-stage sink callbacks (on_stdout_line / on_stderr_line) only emitted Tauri events to the frontend; they never tee'd to the log file at all. When the failure route mounts, the Tauri event stream is the only place the script output lived, and it gets discarded. 3. The Failed / Stage / Manifest / Complete lifecycle frames in emit_event() were also Tauri-only — so even the 'which stage failed' frame never reached the log. Fixes: * emit_log() → tracing::info! * Sink callbacks tee stdout to info!, stderr to warn!, with stage label as a structured field for grep'ability * emit_event() now matches on the variant and logs each lifecycle frame at the right level: Failed → tracing::error!, others → info! Result: a failing install leaves a complete forensic trail in bootstrap-installer.log — manifest stage list, every install.ps1 stdout/stderr line tagged by stage, the stage transitions, and the final error. Same path as before so nothing the user does changes. * fix(install.ps1): Stage-NodeDeps cross-process $HasNode + stream npm install output to bootstrap log VM run 3 diagnosis: node-deps stage skipped on the VM (logged 'Skipping Node.js dependencies (Node not installed)') and then desktop's npm install failed with exit 1 and zero diagnostic detail. Two root causes: 1. $HasNode false-skip in Stage-NodeDeps — same cross-process bug pattern we fixed for Stage-Desktop inc7e46f9f3. Stage-Node ran in process A and set $script:HasNode = $true, then exited. Stage- NodeDeps ran in fresh process B (Hermes-Setup.exe -Stage NAME spawns each stage independently), where that variable doesn't exist. Re-probe via Get-Command npm instead of trusting the stale script-scope global. The previous stage already verified Node so the re-probe succeeds. 2. npm install --silent + Tee to TEMP file hid the real error. When the workspace install failed on the VM, the actual reason was buffered in $env:TEMP\hermes-npm-desktop-install-*.log and the user saw only 'exit 1'. Drop --silent so npm streams its full output, drop the TEMP-file dance — the Tauri installer's streaming sink already tees every stdout/stderr line to the rolling bootstrap-installer.log, so a side log file is dead weight that hides the very error we need. After this, the bootstrap log on a failure will contain npm's full output (deprecation warnings, ETARGET, native-module compile errors, whatever) tagged with stage=desktop, making the actual cause diagnosable instead of an opaque exit code. * fix(install.ps1): restore Initialize-ElectronBuilderCache (CSC env vars alone aren't enough) VM run 4 diagnosis: even with CSC_IDENTITY_AUTO_DISCOVERY=false set, electron-builder still fetches winCodeSign and signs bundled binaries. The log shows the signing happens BEFORE the cache extraction: • signing with signtool.exe ...\winpty-agent.exe • signing with signtool.exe ...\OpenConsole.exe • downloading winCodeSign-2.6.0.7z • <symlink privilege error> Cause: node-pty's bundled prebuilds are listed in apps/desktop's asarUnpack ['**/*.node', '**/prebuilds/**']. electron-builder re-signs anything unpacked from asar, regardless of whether OUR binary gets signed. The signtool invocation needs winCodeSign on disk, which needs the .7z extracted, which hits the macOS-symlink crash on non-admin Windows. The CSC env vars I added ind5fe46727only kill IDENTITY DISCOVERY (so OUR Hermes.exe stays unsigned, which is fine — we have no cert). They don't prevent the toolchain fetch for the bundled-prebuild re-sign. I removed the pre-extract ind5fe46727thinking the env vars subsumed it; that was wrong. Both are needed. Restoring Initialize-ElectronBuilderCache verbatim fromc7e46f9f3and keeping the CSC env vars. Wrote a clearer doc-comment at the call site explaining the two-knob interaction so future maintainers don't drop one half again. * fix(desktop): disable signtool via signtoolOptions.sign=null, drop dead winCodeSign pre-extract VM run 5 diagnosis: the pre-extract from3b29e65c1ran (extracted 83 files, 24MB) but produced ZERO files at the expected sentinel path '/winCodeSign-2.6.0/windows-10/x64/signtool.exe'. Cause: the .7z archive's root entries are 'windows-10/', 'darwin/', 'linux/', etc. — not 'winCodeSign-2.6.0/<arch>'. Extracting with '-o$cacheRoot' put files at $cacheRoot/windows-10/..., NOT at $cacheRoot/winCodeSign-2.6.0/windows-10/.... I had the directory nesting wrong from the start. And then we observed: electron-builder downloads winCodeSign-2.6.0.7z under a random numeric filename ('384387955.7z') regardless of what's already extracted in the parent dir. The cache key isn't the dirname; it's content-addressed. So the pre-extract approach was doomed even if the path nesting had been right. Actual fix: signtoolOptions.sign=null in apps/desktop/package.json's win build config. electron-builder honors this and skips the bundled- prebuild signing entirely — no signtool invocation, no winCodeSign fetch, no symlink-privilege crash. The previous failures all stemmed from electron-builder pre-signing node-pty's bundled .exes (winpty-agent.exe, OpenConsole.exe) which are already author-signed upstream; re-signing with our nonexistent cert was overwriting good sigs with nothing useful anyway. Cost: when we DO get a real cert later, we'll add it back with the sign function pointing at the cert chain. Until then, all-null is the correct config and unblocks every non-admin Windows user. Removed Initialize-ElectronBuilderCache (the dead pre-extract). Removed the call site. Kept the CSC_IDENTITY_AUTO_DISCOVERY env vars as belt-and-suspenders against a future electron-builder change that might revive cert auto-discovery. * fix(desktop): use no-op sign function instead of sign=null VM run 6 still hit the symlink crash even with signtoolOptions.sign=null. electron-builder 26.8.1 treats null as 'use the default signtool path' rather than 'skip signing', so the winCodeSign fetch + extraction still fired for the bundled prebuild re-sign. The Electron docs (electronjs.org/docs/latest/tutorial/code-signing) make it clear signing is OPTIONAL and unsigned apps work fine — users just see SmartScreen on first launch. The electron-builder mechanism for 'don't actually sign anything' is to supply a custom sign function (via signtoolOptions.sign: '<path-to-cjs-module>') that resolves without invoking signtool. build-noop-sign.cjs is that module — a 5-line async function that returns undefined. electron-builder calls it for every binary it would have signed, gets back a resolved promise, and considers each binary 'signed.' No signtool spawn, no winCodeSign fetch, no symlink crash. When Nous's cert arrives, replace this file with a real signing hook (@electron/windows-sign-based or a direct signtool invocation). The architecture's signing-ready and the cutover is a one-file edit. * fix(desktop): signAndEditExecutable=false to skip signtool path entirely After reading app-builder-lib/winPackager.js line 216 + 231 directly: signAndEditExecutable is the ACTUAL hardcoded gate that short-circuits both signApp() (which signs Hermes.exe + every shouldSignFile match including bundled prebuilds) AND createTransformerForExtraFiles(). None of signtoolOptions.sign / sign:null / sign:<custom-fn> gate the winCodeSign download — that happens before they're consulted. What we lose: rcedit also runs through signAndEditResources, so disabling this drops PE metadata (file properties showing 'Hermes' / 'Nous Research' / file description). Cost is real but bounded: * Hermes.exe filename, icon, asar contents, app identity intact * Task Manager shows 'Hermes.exe' (the filename) not 'Hermes' (PE description) — minor downgrade * Start menu, taskbar, window title all work normally * SmartScreen will warn once (unsigned, same as before) When the cert lands, flip signAndEditExecutable back to default true, both signing AND rcedit return, PE metadata is restored. Removes the no-op sign function (build-noop-sign.cjs) since signAndEditExecutable=false prevents signtool from being invoked at all — the custom hook never gets called either. * feat(install.ps1): write .hermes-bootstrap-complete marker at end of install The desktop app's main.cjs resolver ladder has a 'bootstrap-needed' rung that fires when .hermes-bootstrap-complete is missing from ACTIVE_HERMES_ROOT. Pre-Hermes-Setup, this marker was written by the packaged-desktop's own bootstrap-runner.cjs at the end of its install flow. Now that Hermes-Setup.exe runs install.ps1 directly, install.ps1 needs to own the marker — otherwise the desktop sees no marker on first launch and triggers its legacy first-launch bootstrap (re-running install.ps1 from inside Electron, the exact recursion Hermes-Setup.exe was supposed to obviate). Implementation: * New Stage-BootstrapMarker (worker) → Write-BootstrapMarker (helper) * Slotted in the manifest right after platform-sdks, before the interactive configure/gateway stages, so it runs unconditionally when the install reaches the finalize phase * Schema mirrors apps/desktop/electron/main.cjs writeBootstrapMarker / isBootstrapComplete EXACTLY: {schemaVersion: 1, pinnedCommit, pinnedBranch, completedAt}. Schema version stays at 1 so old desktops that read marker files written by future install.ps1s can still parse them. * pinnedCommit comes from -Commit flag (Hermes-Setup.exe passes it) or falls back to 'git rev-parse HEAD' in InstallDir * pinnedBranch from -Branch flag, defaults to 'main' matching install.ps1's own param default Two PS-5.1 gotchas baked into comments: * The ?. null-conditional operator doesn't exist pre-PS7; use explicit if-checks on Get-Command results * Set-Content -Encoding UTF8 emits a BOM in 5.1 and Node's plain JSON.parse rejects BOM — write via .NET's UTF8Encoding(false) to produce BOM-less JSON the desktop's readJson() can parse * feat(installer): drive in-app updates through the Tauri installer Converge update on the same principle as bootstrap: one driver owns all repo mutation. The desktop becomes a pure consumer that hands off to Hermes-Setup.exe --update instead of re-implementing git/pip in Electron. - hermes desktop --build-only: build without launching, so the installer owns the post-update launch (CLI keeps build logic single-sourced). - Installer AppMode {Install,Update} from argv; get_mode exposed to the UI. - Installer self-copies to HERMES_HOME/hermes-setup.exe on install success (no-op guard during --update re-invocation to avoid the locked-exe copy). - Installer --update flow (update.rs): wait for the desktop to release the venv shim, run 'hermes update --yes --gateway' (branch on exit 0/2/other), then 'hermes desktop --build-only', then launch the rebuilt desktop. Reuses the bootstrap event channel + progress UI via a synthetic two-stage manifest. - Desktop applyUpdates() gutted (~105 lines of git/stash/pull/pyproject/pip removed) -> thin handoff: spawn updater, app.quit() to free the shim. Detection (checkUpdates, commit changelog, behind-count) kept intact. - install.ps1 creates Start Menu + Desktop shortcuts to the packed Hermes.exe (never bare 'hermes desktop', which would rebuild every launch). * test update * fix(installer): pass --branch to hermes update in the --update flow The install is a detached-HEAD checkout of a pinned commit. Without --branch, 'hermes update' fell back to its default (main) and switched the checkout to main — a divergent branch that lacks the desktop CLI command — so the update targeted the wrong branch and the rebuild stage failed with 'invalid choice: desktop'. Thread BUILD_PIN_BRANCH (the branch this installer was built against, and the same branch the desktop detected the update on) into 'hermes update --branch <b>' so update + rebuild stay on-branch. * test update * fix(installer): stamp Hermes icon onto Hermes.exe via rcedit (no winCodeSign) The unpacked Hermes.exe showed the stock Electron icon + name in the taskbar because build.win.signAndEditExecutable=false disables BOTH electron-builder's signing AND its rcedit metadata/icon stamping. That flag is load-bearing: enabling it re-triggers signtool -> winCodeSign, whose macOS symlinks crash 7-Zip on non-admin Windows (unfixable dead end). Decouple identity-stamping from signing entirely: after npm run pack, run rcedit ourselves on the produced exe. - Add rcedit as a direct devDependency of apps/desktop (the transitive electron-winstaller copy is fragile). - apps/desktop/scripts/set-exe-identity.cjs: Node helper that calls rcedit's named export to set icon + ProductName/FileDescription/ CompanyName. Node builds argv natively — avoids the PowerShell->exe ->JSON double-escaping that broke the app-builder rcedit path. - install.ps1 Set-DesktopExeIdentity invokes the script after the build, before shortcuts. Best-effort: failure keeps the stock icon, never fails the install. rcedit is a pure PE editor — no signtool, no winCodeSign, no symlinks. Verified locally: stamping a copy of the built Hermes.exe embeds the 32x32 icon and sets ProductName=Hermes. Also fix update-path success-screen flash: in update mode the installer hands off + exits in ~600ms, so don't route to the 'launch Hermes' success view (it flashed before the window closed). * update test * fix(desktop): show 'hermes update' guidance for CLI installs instead of dead-end error A user who installed via the CLI (irm|iex / install.sh) then ran `hermes desktop` has no staged hermes-setup.exe, so clicking Update in-app hit resolveUpdaterBinary()=null and showed a misleading error ('re-run the Hermes installer') with a Try-again button that could never succeed — a dead loop for a perfectly valid install. Treat the no-updater case as an intentional outcome, not a failure: - main.cjs applyUpdates returns { ok:true, manual:true, command:'hermes update' } (no throw, no 'error' stage) when no updater binary exists. - New 'manual' update stage + apply-state.command thread the command to the UI. - updates-overlay ManualView: a polished terminal-native card with the exact command and a copy button, framed as the correct path for a CLI user rather than an error. GUI-installer users are unaffected — hermes-setup.exe present => seamless auto-update runs as before. Zero new process orchestration; can't fail the update demo. * update test * fix(gui): pin /api/hermes/update to the current branch The desktop command-center 'update' action hits POST /api/hermes/update, which spawned bare `hermes update` with no --branch. cmd_update then falls back to its default (main) and checks the working tree OUT of the tracked branch — a bb/gui install silently jumped to main and lost the desktop CLI. Resolve the checkout's current branch and pass --branch <current> from this endpoint only. The engine default (main) is DELIBERATELY unchanged: bare `hermes update` from a terminal, the gateway /update bot command, and the CLI/TUI relaunch path all keep their long-standing 'update against main' contract for the existing user base. Only the GUI button is scoped to update-the-branch-you're-on. Detached HEAD / git failure falls back to the bare default. * update test * fix(desktop): branch-pin the CLI manual-update command card The 'Update from your terminal' card (shown to CLI installs with no staged updater) hardcoded bare `hermes update` — which defaults to main and would switch a bb/gui (or any non-main) checkout off-branch. Same bug we fixed for the GUI button, leaked into the card's copy text. Resolve the checkout's current branch and show `hermes update --branch <current>` for non-main checkouts; keep it bare for main so the card stays clean. Best-effort: bare fallback if branch detection fails. Matches the GUI button + installer --update contract; bare terminal/bot/TUI update paths still default to main, unchanged. * docs: phragg was here * feat(desktop): lead onboarding with Nous Portal + fix fresh-install detection (#34970) - Feature Nous Portal as the primary onboarding card (Recommended tag, app logo, single pitch line); collapse other OAuth providers behind an "Other providers" disclosure whose open/closed state persists. - Surface OpenRouter as a one-click API-key option inside the disclosure; move "I have an API key" to a quiet bottom-right link. - Treat "no provider configured" as a normal onboarding state, not a red error banner (provider-setup-errors copy match). - Fix setup.runtime_check: it reported ready when the resolved runtime had an empty credential or only implicit Bedrock/IAM, so fresh installs never saw onboarding. Now requires a usable credential. - Auto-wire Windows fonts for WSL2 users so the renderer renders real Segoe UI instead of the DejaVu fallback; make WSL detection env-independent via the /proc kernel marker. * feat(desktop): live elapsed timer on install bootstrap steps The first-launch install overlay showed a static "Installing" with no motion, so long steps (notably the repo clone) looked frozen. Stamp each stage's start time on the running transition and tick once a second so the active step shows live elapsed (e.g. "Installing · 1:23"), plus elapsed on the overall current-step line. Completed steps keep their final duration. * fix(desktop): resolve PortableGit for update checks + reserve titlebar tools space - runGit() hardcoded spawn('git'), which ENOENTs on fresh installer-driven Windows installs (git is PortableGit under %LOCALAPPDATA%\hermes\git, never on PATH) — so "Check for updates" failed with "Couldn't check for updates". Add resolveGitBinary() mirroring findGitBash (PortableGit → Git-for-Windows → PATH) and use it in runGit. - PageSearchShell rendered a full-width search input in the titlebar row, so on Windows its right edge slid under the fixed top-right tools + native window controls. Reserve that footprint via --titlebar-tools-* vars. * fix(desktop): stop streaming caret from shifting layout on completion The streaming caret (::after on the running message's last child) was an in-flow inline-block adding ~0.78em of inline width, which could wrap the last line mid-stream; when the caret is removed on completion the line un-wraps and reflows — the visible post-response layout shift. Net-zero its inline advance with a compensating negative margin so it paints at the text end without consuming layout width. * fix(desktop): stop completed-message layout shift while streaming The assistant message action bar used `hideWhenRunning`, which unmounts it whenever the thread is streaming. Since the bar reserves vertical space in each completed assistant message's footer (it's invisible-until-hover via opacity, not via mount), unmounting it collapsed every prior turn by the bar's height — then remounting on resolve grew them back, shifting the whole conversation (visible as "padding appears above the last user message"). Drop hideWhenRunning so the footer height is constant; the bar stays invisible during streaming via its existing opacity/pointer-events gating. * fix(merge): keep windows-footgun suppressions inline * fix(merge): keep remaining gateway footgun suppressions inline * fix(merge): restore contracts caught by main-target CI * fix(dashboard): honor injected HERMES_DASHBOARD_SESSION_TOKEN The desktop shell mints a session token and signs its /api + /api/ws calls with it via HERMES_DASHBOARD_SESSION_TOKEN, but the main-merge restored a web_server.py that ignored the env var and minted its own random _SESSION_TOKEN -- so every desktop request 401'd and the UI reported "gateway offline". Read the injected token (fall back to a fresh random one) so loopback HTTP + WS auth line up. Adds a regression test so a future merge can't silently drop the read. * fix(desktop): align fresh-install home so upgraders don't brick Two related first-launch bugs on machines with a legacy ~/.hermes: - install.ps1 hardcoded $HermesHome/$InstallDir to %LOCALAPPDATA%\hermes and ignored the HERMES_HOME the desktop passes through. The desktop freezes HERMES_HOME at module load and prefers a legacy ~/.hermes when %LOCALAPPDATA%\hermes is absent, so the installer wrote to a different home than the shell read -> "Could not connect to Hermes gateway". Honor $env:HERMES_HOME in the param defaults. - isBootstrapComplete() trusted the marker + checkout without verifying a runnable venv, so an interrupted/split install spawned a dead backend instead of re-bootstrapping. Also require the venv python to exist. * fix(dashboard): allow packaged desktop file:// origin on loopback WS The packaged Electron desktop loads its renderer over file://, so its /api/ws handshake carries Origin: file:// (or null). The DNS-rebinding WebSocket Origin guard only accepted http(s) origins matching the bound host, so it rejected the desktop's own renderer with 4403 -> "Could not connect to Hermes gateway" on macOS. A browser DNS-rebinding attacker can only ever present an http(s) origin (the site hosting the malicious page); it cannot forge file://, null, or a custom app scheme AND hold the loopback session token. So on loopback binds we now trust non-web origins -- the token in _ws_auth_ok remains the real authenticator. Public/gated binds still reject them, and cross-site http(s) origins are still rejected everywhere. * fix(desktop): resolve renderer assets relative to BASE_URL Absolute public asset paths (/apple-touch-icon.png, /ds-assets/...) work under the dev server but break in the packaged app, where the renderer is loaded from file://.../index.html and a leading slash resolves to the filesystem root -> broken onboarding provider icon and backdrop image on macOS. Prefix these with import.meta.env.BASE_URL so they resolve next to the bundled index.html in both dev and packaged builds. * feat(desktop): automate first-launch bootstrap on macOS/Linux Previously a packaged macOS/Linux app with no Hermes install hit a dead-end ("first-launch install is not yet automated -- run install.sh manually") because install.sh lacked the staged protocol install.ps1 exposes. Now both platforms bootstrap on first launch with the same structured, per-step progress UI as Windows. - install.sh: add --manifest / --stage / --json / --non-interactive plus a stage dispatcher (prerequisites, repository, venv, python-deps, node-deps, path, config, setup, gateway, complete). User-input stages (setup, gateway) are skipped under --non-interactive; the in-app onboarding overlay owns API keys/model, matching the Windows flow. Each stage runs inside the install dir (its own process) and a new --commit flag pins the checkout to the build-stamp SHA. - bootstrap-runner.cjs: drive the staged manifest/stage/JSON protocol for both install.ps1 (PowerShell) and install.sh (bash), selected by installer kind; removed the single-blob POSIX shim. - main.cjs: drop the macOS/Linux unsupported-platform dead-end so the bootstrap-needed path runs the installer on every platform. * fix(dashboard): return 404 JSON for unmatched /api paths instead of SPA HTML The SPA catch-all (serve_spa) served index.html for any unmatched GET, including unregistered /api/* endpoints. A missing API route therefore came back as <!doctype html> with status 200, and JSON clients (the desktop app's fetchJson) crashed with an opaque 'SyntaxError: Unexpected token <' instead of a clear error. - web_server.py: unmatched /api or /api/... now returns 404 JSON ('No such API endpoint'); non-api paths still serve the SPA for client-side routing. - main.cjs fetchJson: detect an HTML body / text/html content-type on a 2xx response and reject with a clear message naming the URL, rather than a raw JSON.parse SyntaxError. Empty bodies resolve to null; malformed JSON reports the URL plus a snippet. * say 'OS appearance' instead of 'macOS appearance' * feat(install): add --include-desktop stage + PowerShell-style flags to install.sh Brings install.sh to parity with install.ps1's bootstrap surface so the shared Rust/Tauri bootstrapper (apps/bootstrap-installer) can drive a macOS/Linux install the same way it drives Windows. - Accept the PowerShell-style aliases the bootstrapper emits to both installers: -Commit / -Branch (alongside existing -Manifest / -Stage / -Json / -NonInteractive). - Add --include-desktop / -IncludeDesktop. When set, the manifest gains a 'desktop' stage (immediately before 'complete'), and a new install_desktop runs a root workspace `npm install` + `npm run pack` (electron-builder --dir, signing auto-discovery disabled) to produce release/mac*/Hermes.app -- mirroring install.ps1's Install-Desktop / Stage-Desktop. - The flag is opt-in, exactly like Windows: the signed bootstrap installer passes it; the Electron app's own first-launch bootstrap and the CLI one-liner omit it (building the desktop from inside the running app would clobber it). * fix: tts endpoints * macOS desktop: install + in-app self-update (#35607) * fix(installer): align macOS HERMES_HOME with the rest of the stack paths.rs computed the macOS Hermes home as ~/Library/Application Support/ hermes, but nothing else does: hermes_constants.get_hermes_home() (Python), scripts/install.sh, and the Electron desktop's resolveHermesHome() all use ~/.hermes on macOS. The drift meant the Tauri installer wrote the install to one directory and the desktop looked for it in another, so a fresh GUI install never found its backend (the file's own comment warned this exact drift would break things). Use ~/.hermes on macOS to match. * fix(install.sh): always emit a stage result frame on failure Stage helpers (clone_repo, install_deps, check_python, …) were written for the monolithic flow and call `exit 1` on failure. Under `--stage`, that terminated the process before the JSON result frame was printed, so the installer's parse_stage_result saw "no frame" instead of a clean {ok:false,...} contract response. Run the stage body in a subshell so an `exit` only unwinds the subshell and the parent still emits the frame. * feat(install.sh): auto-provision git on macOS/Linux (parity with install.ps1) install.ps1 downloads PortableGit on Windows, but install.sh just printed a "please install git" hint and exited — so a fresh Mac with no developer tools (no Xcode CLT → no git) couldn't get past the clone step. check_git now tries to install git before bailing: - macOS: Homebrew if present (headless), else `xcode-select --install` (the CLT prompt also provides the compiler some wheels need), polling for git to appear. - Linux: apt/dnf/pacman via sudo when available. Falls back to the manual instructions only if auto-provision fails. * feat(desktop): in-app GUI+backend self-update on macOS/Linux On Windows the staged Hermes-Setup binary drives updates (quit → hermes update → hermes desktop --build-only → relaunch). The mac drag-install has no such binary, so "Update now" previously just printed `hermes update`. Since there's no venv-shim file lock on POSIX, the desktop can drive the whole update itself. applyUpdates now, when no staged updater exists on mac/linux: 1. runs `hermes update --yes [--branch <current>]` (backend git pull + deps), 2. runs `hermes desktop --build-only` (OS-aware GUI rebuild) with the Hermes-managed Node + venv on PATH, 3. spawns a detached swapper that waits for this process to exit, dittos the freshly built Hermes.app over the running bundle, clears quarantine, and relaunches. Degrades to "backend updated — restart to load the new GUI" if the rebuild fails or there's no .app bundle to swap (dev run, Linux AppImage). * chore: uptick * chore: uptick * chore: linux build * fix(install): detect xcode-select git stub on fresh macOS * chore: bump * fix(desktop): repair voice dictation on Windows Voice dictation was broken on Windows in two ways: 1. Mic access was denied. The Electron permission request handler only granted 'media' requests whose details.mediaTypes included 'audio', but Chromium on Windows frequently fires the mic request with an empty mediaTypes array, so getUserMedia threw NotAllowedError. The handler now grants audio-capture when mediaTypes includes 'audio' OR is empty/absent, handles the 'audioCapture' permission name, and adds a setPermissionCheckHandler (the synchronous path Chromium also consults for getUserMedia on Windows). Video is still denied. 2. Transcripts went nowhere. The composer's insertText handler (used by dictation and other inserts) only updated the assistant-ui composer store via setText, never the contentEditable editor DOM. The draft->editor sync effect only re-renders the editor when it is NOT focused, and dictation runs while the editor has/regains focus, so the transcript was stored but never shown and could not be sent. insertText now renders into the editor DOM and places the caret, mirroring appendExternalText. Also hardens fetchJson: a 2xx response with an HTML body (or text/html content-type) now rejects with a clear message naming the URL instead of an opaque JSON.parse 'Unexpected token <' error. * feat(desktop): route Nous subscribers onto the Tool Gateway from the GUI When the GUI sets the main provider to Nous via POST /api/model/set, call the same apply_nous_managed_defaults the CLI uses after model selection, so GUI/onboarding users land on the Nous Tool Gateway the same way CLI users do — no separate prompt, no duplicated logic. Purely additive: apply_nous_managed_defaults skips any tool where the user has a direct key (FIRECRAWL_API_KEY, FAL_KEY, etc.) or explicit config, so it never overwrites a user's own setup. Only unconfigured tools get routed. - web_server.py: in set_model_assignment (scope=main, provider=nous), resolve enabled toolsets and apply managed defaults; guarded so a Portal hiccup never blocks saving the model. Returns routed tools as gateway_tools. - onboarding.ts: surface a 'Tool Gateway enabled' toast listing routed tools. - types/hermes.ts: add gateway_tools to ModelAssignmentResponse. - tests: cover nous-applies, non-nous-skips, and failure-doesnt-block-save. * feat(desktop): mirror hermes model free/paid curation in GUI onboarding GUI onboarding picked models[0] from /api/model/options, which ignores the Nous free/paid tier — a free user could land on a paid default (e.g. anthropic/claude-opus-4). Now the recommended default mirrors what `hermes model` does. - web_server.py: new GET /api/model/recommended-default?provider=<slug>. For Nous it runs the same curation as the CLI (get_curated_nous_model_ids + pricing + check_nous_free_tier + union_with_portal_{free,paid}_recommendations + partition_nous_models_by_tier) so free users get a free model and paid users get the curated default. Other providers fall back to the first curated model. Never 500s — returns empty model on error so onboarding degrades gracefully. - hermes.ts: getRecommendedDefaultModel client + RecommendedDefaultModel type. - onboarding.ts: fetchProviderDefaultModel prefers the recommended endpoint, falls back to models[0] when unavailable. - tests: free-tier picks free model, paid-tier picks curated default, failure returns empty without 500. * feat(desktop): show model pricing + free/paid tier gating in GUI picker The CLI `hermes model` picker shows per-model $/Mtok pricing and gates paid models on free Nous accounts. The GUI picker showed bare model names. Bring it to parity across both the model-picker dialog and onboarding confirm card. Backend: - inventory.build_models_payload gains a pricing=True flag → _apply_pricing enriches each provider row with formatted per-model pricing ({input,output,cache,free}) via the same _format_price_per_mtok the CLI uses, and for Nous adds free_tier + unavailable_models (paid models a free user can't select) via check_nous_free_tier + partition_nous_models_by_tier. Best-effort: any pricing/tier failure is swallowed and fails open (no gating). - /api/model/options and TUI model.options now pass pricing=True so the global picker and in-session picker both carry pricing. Frontend: - ModelOptionProvider gains pricing/free_tier/unavailable_models; new ModelPricing type. - model-picker dialog renders In/Out $/Mtok (or a Free pill) per model, a Free tier/Pro badge on the Nous heading, and disables + grays unavailable paid models for free users with a 'Pro models need a paid subscription' note. - onboarding confirm card shows the chosen model's price + tier badge. Tests: test_inventory_pricing covers price formatting, free-tier gating, paid no-gating, providers without pricing, and swallowed failures. * fix(desktop): GUI model picker shows curated Nous list in curated order Two bugs made the GUI Nous model list diverge from the `hermes model` CLI picker: 1. Backend (model_switch.py): the Nous row in list_authenticated_providers fell through to cached_provider_model_ids("nous"), dumping the full live /v1/models catalog (~50 vendor-prefixed models, alphabetical). Now it uses the curated list AND applies the Portal free/paid recommendation union — exactly like _model_flow_nous in main.py — so newly-launched models such as stepfun/step-3.7-flash:free surface in curated order. Best-effort: falls back to the curated list alone if the Portal fetch fails. 2. Frontend (model-picker.tsx): cmdk's Command had shouldFilter on (default), which re-sorts items by fuzzy-match score (≈alphabetical) and ignores array order. Set shouldFilter={false} + own the search term and do an order-preserving substring filter, so the backend's curated order is shown verbatim. * feat(desktop): add/switch providers from the model picker via onboarding reuse The model picker could only select models from already-authenticated providers. Switching to a new provider had no in-app path. Rather than duplicate provider UI, reuse the existing onboarding provider selector (featured Nous + other providers + API-key form + device-code/PKCE flow + model-confirm with pricing/tier). - onboarding store: add a 'manual' flag with startManualOnboarding() / closeManualOnboarding(). Manual mode forces the onboarding overlay to show even when configured===true and refreshOnboarding no longer auto-dismisses on runtime-ready (the app is already working — the user is just adding or switching a provider). - onboarding overlay: render when manual even if configured; show a Close button (the first-run flow has none since the app can't run yet). - model picker: 'Add provider' footer button opens the onboarding selector; ModelResults lists only configured (model-bearing) providers. * feat(desktop): add PUT /api/tools/toolsets/{name} enable/disable endpoint * feat(desktop): add toggleToolset RPC binding * feat(desktop): toolset enable/disable switch in Tools settings * feat(desktop): tool configuration parity in GUI Tools settings Bring the desktop GUI Tools settings to parity with the CLI `hermes tools` for provider selection and API-key configuration. Backend (hermes_cli/web_server.py): - GET /api/tools/toolsets/{name}/config - provider matrix + key status - PUT /api/tools/toolsets/{name}/provider - persist provider selection Shared core (hermes_cli/tools_config.py): - Extract apply_provider_selection / _write_provider_config from the interactive _configure_provider so the CLI and GUI write identical config keys (web.backend, tts.provider, browser.cloud_provider, plugin image/video providers, use_gateway flags) through one code path. Desktop UI: - ToolsetConfigPanel: provider list with select, per-provider API-key entry (set/replace/clear/reveal via the shared env RPCs), Ready/Needs keys state, guidance for Nous-auth and post-setup providers. - Wire the Configured/Needs keys pill to expand the panel inline; refresh the toolset list after key changes so the pill updates live. - Add getToolsetConfig / selectToolsetProvider RPC bindings + types. Post-setup (OAuth/install) flows still defer to the CLI; see docs spike findings for the planned /api/tools/setup/* endpoint family. Tests: backend round-trip + 400 cases for the new endpoints and apply_provider_selection; desktop vitest coverage for the config panel (provider render, select, key save). No change-detector tests. Also removes three stale completed plan docs. * fix(desktop): show real Hermes version + sync package.json on release The desktop app version was disconnected from the Hermes version: the release script bumped pyproject.toml + hermes_cli/__init__.py but never touched apps/desktop/package.json, which sat stale at 0.0.2 (lockfile at 0.0.1). - main.cjs: hermes:version IPC now resolves __version__ from hermes_cli/__init__.py (the canonical source release.py bumps) via a new resolveHermesVersion() helper, falling back to app.getVersion() when the source tree isn't readable. The About panel now always shows the live Hermes version and can't drift. - release.py: update_version_files() also bumps apps/desktop/package.json in lockstep with pyproject (top-level version only; dep specs untouched). - One-time catch-up: package.json 0.0.2 -> 0.15.1 and the lockfile root mirrors 0.0.1 -> 0.15.1. * fix(desktop): stamp exe identity in afterPack hook so updates stay branded The packed Hermes.exe reverted to the stock Electron icon + "Electron" name after an in-app update. The icon/identity stamp (rcedit) lived only in install.ps1, but the installer's --update path rebuilds the desktop via `hermes desktop --build-only` -> `npm run pack`, which never ran install.ps1 and so never stamped the rebuilt exe. Move the stamp into an electron-builder afterPack hook so it runs for EVERY packed build regardless of caller (first install, hermes desktop, the update rebuild, or a manual npm run pack): - set-exe-identity.cjs: refactor to export stampExeIdentity(exe, desktopRoot); still runnable as a standalone CLI. - after-pack.cjs (new): afterPack hook calling stampExeIdentity. Windows-only guard; best-effort (logs + resolves on failure, never fails the build). - package.json: register build.afterPack. - install.ps1: remove the now-redundant Set-DesktopExeIdentity function + call; the hook handles it during npm run pack. electron-builder's own rcedit step stays disabled (signAndEditExecutable=false) to avoid the signtool -> winCodeSign -> 7-Zip macOS-symlink crash on non-admin Windows; the hook runs rcedit directly (pure PE resource edit, no signing). * fix(desktop): export afterPack hook as exports.default so electron-builder runs it The afterPack hook used `module.exports = fn`, which electron-builder's hook loader doesn't pick up — it expects the function as the module's default export (the same shape afterSign/notarize.cjs uses). The hook silently never ran, so even first install shipped the stock "Electron" exe. Switch to `exports.default = async function afterPack(...)`. Verified with a real `npm run pack`: electron-builder now invokes the hook and the produced release/win-unpacked/Hermes.exe carries ProductName/FileDescription=Hermes. * chore(desktop): drop auto-build release CI in favor of manual build + upload Remove desktop-release.yml (nightly-on-main + stable publish). Installers are now built locally per platform and uploaded to a GitHub Release by hand; the website points at them via NEXT_PUBLIC_HERMES_DL_* env. Update README + docs and drop the dead desktop-nightly channel links. * fix(desktop): stable shortcut icon + bust icon cache so updates repaint Symptom on a freshly-installed laptop: Hermes.exe itself shows the correct Hermes icon (Explorer reads the live exe's stamped PE resource), but the desktop shortcut still draws the stock Electron icon. Cause: New-DesktopShortcuts set IconLocation to "<exe>,0", so Windows cached the icon it extracted from the exe at shortcut-creation time. On an update the exe gets re-stamped, but the shortcut keeps rendering the stale cached bitmap. - package.json: ship assets/icon.ico beside the exe via extraResources (-> resources/icon.ico). Verified with a real npm run pack. - install.ps1 New-DesktopShortcuts: point IconLocation at resources/icon.ico (fallback to <exe>,0 if absent) — a dedicated .ico is cache-stable and skips the per-exe extraction that goes stale. Then run `ie4uinit.exe -show` to bust the shell icon cache so the shortcut repaints immediately instead of showing the old Electron icon until reboot. Both best-effort; never fail an otherwise-good install. * dummy update * feat(desktop): self-heal update branch + backend contract guard Two fixes for the bb/gui→main transition: - Self-update self-heals: if the tracked branch (e.g. bb/gui) no longer exists on origin (merged + deleted), the desktop updater falls back to main and persists it. Read-only ls-remote probe that only flips on a definitive "ref absent" (exit 2), never on a transient network error, so already-installed clients migrate themselves with no manual flip. - Backend contract guard: tui_gateway reports DESKTOP_BACKEND_CONTRACT in session runtime info; the desktop warns with a one-click "Update Hermes" when the backend predates the GUI's required contract (e.g. a bb/gui app pointed at a main checkout) instead of failing cryptically downstream. * docs(desktop): rewrite README to match current install/update/build flow The old README contradicted itself (claimed a bundled Python payload while also saying it no longer bundles source) and predated cross-platform support. Rewrite for accuracy: Linux is a first-class build target, install.sh/install.ps1 both drive the staged bootstrap, the real self-update handoff (Windows Hermes-Setup vs in-app macOS/Linux), and the bb/gui→main self-heal + backend contract guard. * docs(desktop): rewrite README as a real product readme Lead with what the app is and how to get it (download an installer, or `hermes desktop` for existing CLI users) plus a plain-language feature list, then keep contributor/build/internals as a clearly separated secondary section. * docs(desktop): fix install framing — releases no longer auto-build installers Lead with the install-with-Hermes path (`--include-desktop` / `hermes desktop`), which always works, and describe prebuilt installers as manually published when a release ships them rather than implying CI attaches them to every release. * docs(desktop): match base repo README style Adopt the root README's conventions: centered title + badge row, bold one-liner intro, a feature <table> grid, --- section dividers, and a Community / License footer. * feat(desktop): recover from gateway boot failures + validate API keys on entry (#35864) Fresh installs that hit a gateway boot failure had no recovery path: the shell rendered dead ("gateway offline"), logs were undiscoverable, and a mistyped API key was accepted because onboarding only checked credential presence, not validity. - Add BootFailureOverlay: a top-level recovery surface (Retry, Repair install, Use local gateway, Open logs + inline recent logs) that mounts on any hard boot failure, including post-install. Trims the now-redundant recovery button from the onboarding Preparing panel. - Add hermes:logs:reveal / :recent IPC (reveal desktop.log) and a hermes:bootstrap:repair IPC that drops the bootstrap marker to force a clean reinstall. Surface "Open logs" in Gateway settings too. - Add POST /api/providers/validate: a live per-provider probe (OpenRouter/OpenAI/xAI/Gemini key check, local endpoint connectivity) wired into saveOnboardingApiKey so a rejected key blocks before it's persisted, while an unreachable probe falls through (offline-safe). * test(model-catalog): fix stale nous picker test after curated-list changeac2e48907made the GUI/picker Nous row use the curated list (curated["nous"] = get_curated_nous_model_ids()) + Portal union, matching the `hermes model` CLI — but test_picker_nous_row_uses_manifest still asserted the old 2-model manifest snapshot, breaking the test shard. Rewrite it as an invariant: stub the Portal union to passthrough and assert the row equals get_curated_nous_model_ids() computed under the same conditions, so it tracks the real contract instead of a hardcoded model list that rots on every catalog update. --------- Co-authored-by: emozilla <emozilla@nousresearch.com> Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com> Co-authored-by: Austin Pickett <pickett.austin@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: ethernet <arilotter@gmail.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
3519 lines
140 KiB
Python
3519 lines
140 KiB
Python
"""
|
|
Slack platform adapter.
|
|
|
|
Uses slack-bolt (Python) with Socket Mode for:
|
|
- Receiving messages from channels and DMs
|
|
- Sending responses back
|
|
- Handling slash commands
|
|
- Thread support
|
|
"""
|
|
|
|
import asyncio
|
|
import contextvars
|
|
import json
|
|
import logging
|
|
import os
|
|
import re
|
|
import time
|
|
from dataclasses import dataclass, field
|
|
from typing import Dict, Optional, Any, Tuple, List
|
|
|
|
try:
|
|
from slack_bolt.async_app import AsyncApp
|
|
from slack_bolt.adapter.socket_mode.async_handler import AsyncSocketModeHandler
|
|
from slack_sdk.web.async_client import AsyncWebClient
|
|
import aiohttp
|
|
|
|
SLACK_AVAILABLE = True
|
|
except ImportError:
|
|
SLACK_AVAILABLE = False
|
|
AsyncApp = Any
|
|
AsyncSocketModeHandler = Any
|
|
AsyncWebClient = Any
|
|
|
|
import sys
|
|
from pathlib import Path as _Path
|
|
|
|
sys.path.insert(0, str(_Path(__file__).resolve().parents[2]))
|
|
|
|
from gateway.config import Platform, PlatformConfig
|
|
from gateway.platforms.helpers import MessageDeduplicator
|
|
from gateway.platforms.base import (
|
|
BasePlatformAdapter,
|
|
MessageEvent,
|
|
MessageType,
|
|
ProcessingOutcome,
|
|
SendResult,
|
|
SUPPORTED_DOCUMENT_TYPES,
|
|
is_host_excluded_by_no_proxy,
|
|
resolve_proxy_url,
|
|
safe_url_for_log,
|
|
cache_document_from_bytes,
|
|
)
|
|
|
|
|
|
logger = logging.getLogger(__name__)
|
|
|
|
# ContextVar carrying the user_id of the slash-command invoker.
|
|
# Set in _handle_slash_command, read in send() to match the correct
|
|
# stashed response_url when multiple users issue commands on the same
|
|
# channel concurrently. ContextVars propagate to child asyncio.Tasks
|
|
# (Python 3.7+), so the value set in _handle_slash_command's task is
|
|
# visible in _process_message_background's child task.
|
|
_slash_user_id: contextvars.ContextVar[Optional[str]] = contextvars.ContextVar(
|
|
"_slash_user_id",
|
|
default=None,
|
|
)
|
|
|
|
|
|
@dataclass
|
|
class _ThreadContextCache:
|
|
"""Cache entry for fetched thread context."""
|
|
|
|
content: str
|
|
fetched_at: float = field(default_factory=time.monotonic)
|
|
message_count: int = 0
|
|
parent_text: str = "" # Raw text of the thread parent (for reply_to_text injection)
|
|
|
|
|
|
def check_slack_requirements() -> bool:
|
|
"""Check if Slack dependencies are available.
|
|
|
|
Lazy-installs slack-bolt/slack-sdk via ``tools.lazy_deps.ensure("platform.slack")``
|
|
on first call if not present. Rebinds all module-level globals on success.
|
|
"""
|
|
if SLACK_AVAILABLE:
|
|
return True
|
|
|
|
def _import():
|
|
from slack_bolt.async_app import AsyncApp
|
|
from slack_bolt.adapter.socket_mode.async_handler import AsyncSocketModeHandler
|
|
from slack_sdk.web.async_client import AsyncWebClient
|
|
import aiohttp
|
|
|
|
return {
|
|
"AsyncApp": AsyncApp,
|
|
"AsyncSocketModeHandler": AsyncSocketModeHandler,
|
|
"AsyncWebClient": AsyncWebClient,
|
|
"aiohttp": aiohttp,
|
|
"SLACK_AVAILABLE": True,
|
|
}
|
|
|
|
from tools.lazy_deps import ensure_and_bind
|
|
|
|
return ensure_and_bind("platform.slack", _import, globals(), prompt=False)
|
|
|
|
|
|
def _extract_text_from_slack_blocks(blocks: list) -> str:
|
|
"""Extract readable text from Slack Block Kit blocks, including quoted/forwarded content.
|
|
|
|
Slack's modern WYSIWYG composer sends messages with a ``blocks`` array
|
|
containing ``rich_text`` elements. When a user forwards or quotes another
|
|
message, the quoted content appears as nested ``rich_text_quote`` elements
|
|
that are *not* included in the plain ``text`` field of the event.
|
|
|
|
This helper walks the rich-text tree recursively and returns readable lines,
|
|
preserving quotes, list items, and preformatted blocks so the agent can see
|
|
forwarded/quoted content instead of only the lossy plain-text field.
|
|
"""
|
|
if not blocks:
|
|
return ""
|
|
|
|
parts: list[str] = []
|
|
|
|
def _render_inline_elements(elements: list) -> str:
|
|
"""Render inline elements (text, link, channel, user, emoji, etc.)."""
|
|
pieces: list[str] = []
|
|
for el in elements:
|
|
el_type = el.get("type", "")
|
|
if el_type == "text":
|
|
pieces.append(el.get("text", ""))
|
|
elif el_type == "link":
|
|
url = el.get("url", "")
|
|
text = el.get("text", "") or url
|
|
pieces.append(f"{text} ({url})")
|
|
elif el_type == "channel":
|
|
pieces.append(f"<#{el.get('channel_id', '')}>")
|
|
elif el_type == "user":
|
|
pieces.append(f"<@{el.get('user_id', '')}>")
|
|
elif el_type == "usergroup":
|
|
pieces.append(f"<!subteam^{el.get('usergroup_id', '')}>")
|
|
elif el_type == "emoji":
|
|
pieces.append(f":{el.get('name', '')}:")
|
|
elif el_type == "broadcast":
|
|
pieces.append(f"<!{el.get('range', 'here')}>")
|
|
elif el_type == "date":
|
|
pieces.append(el.get("fallback", ""))
|
|
return "".join(pieces)
|
|
|
|
def _append_line(text: str, quote_depth: int = 0, bullet: str = "") -> None:
|
|
if not text or not text.strip():
|
|
return
|
|
prefix = ((">" * quote_depth) + " ") if quote_depth else ""
|
|
parts.append(f"{prefix}{bullet}{text}".rstrip())
|
|
|
|
def _walk_elements(elements: list, quote_depth: int = 0, bullet: str = "") -> None:
|
|
for elem in elements:
|
|
elem_type = elem.get("type", "")
|
|
|
|
if elem_type == "rich_text_section":
|
|
_append_line(
|
|
_render_inline_elements(elem.get("elements", [])),
|
|
quote_depth=quote_depth,
|
|
bullet=bullet,
|
|
)
|
|
elif elem_type == "rich_text_quote":
|
|
_walk_elements(elem.get("elements", []), quote_depth=quote_depth + 1)
|
|
elif elem_type == "rich_text_list":
|
|
list_style = elem.get("style")
|
|
for idx, item in enumerate(elem.get("elements", [])):
|
|
item_bullet = "• " if list_style == "bullet" else f"{idx + 1}. "
|
|
_walk_elements([item], quote_depth=quote_depth, bullet=item_bullet)
|
|
elif elem_type == "rich_text_preformatted":
|
|
code_lines: list[str] = []
|
|
for child in elem.get("elements", []):
|
|
child_type = child.get("type", "")
|
|
if child_type == "rich_text_section":
|
|
rendered = _render_inline_elements(child.get("elements", []))
|
|
else:
|
|
rendered = _render_inline_elements([child])
|
|
if rendered:
|
|
code_lines.append(rendered)
|
|
code_text = "\n".join(code_lines)
|
|
if code_text:
|
|
lang = elem.get("language", "")
|
|
_append_line(
|
|
f"```{lang}\n{code_text}\n```",
|
|
quote_depth=quote_depth,
|
|
bullet=bullet,
|
|
)
|
|
else:
|
|
rendered = _render_inline_elements([elem])
|
|
if rendered:
|
|
_append_line(rendered, quote_depth=quote_depth, bullet=bullet)
|
|
|
|
for block in blocks:
|
|
if (block or {}).get("type") == "rich_text":
|
|
_walk_elements(block.get("elements", []))
|
|
|
|
return "\n".join(parts)
|
|
|
|
|
|
def _serialize_slack_blocks_for_agent(blocks: list, max_chars: int = 6000) -> str:
|
|
"""Return a compact, redacted JSON view of the current message's Block Kit payload."""
|
|
if not blocks:
|
|
return ""
|
|
|
|
if all((block or {}).get("type") == "rich_text" for block in blocks):
|
|
return ""
|
|
|
|
scalar_allowlist = {
|
|
"type",
|
|
"block_id",
|
|
"action_id",
|
|
"style",
|
|
"dispatch_action",
|
|
"optional",
|
|
"multiple",
|
|
"emoji",
|
|
}
|
|
recursive_allowlist = {
|
|
"text",
|
|
"title",
|
|
"description",
|
|
"label",
|
|
"placeholder",
|
|
"accessory",
|
|
"fields",
|
|
"elements",
|
|
"options",
|
|
"option_groups",
|
|
"confirm",
|
|
"submit",
|
|
"close",
|
|
"hint",
|
|
}
|
|
|
|
def _sanitize(value):
|
|
if isinstance(value, list):
|
|
return [
|
|
item
|
|
for item in (_sanitize(v) for v in value)
|
|
if item not in (None, {}, [], "")
|
|
]
|
|
if isinstance(value, dict):
|
|
sanitized = {}
|
|
for key, item in value.items():
|
|
if key in scalar_allowlist:
|
|
sanitized[key] = item
|
|
elif key in recursive_allowlist:
|
|
cleaned = _sanitize(item)
|
|
if cleaned not in (None, {}, [], ""):
|
|
sanitized[key] = cleaned
|
|
return sanitized
|
|
if isinstance(value, (str, int, float, bool)) or value is None:
|
|
return value
|
|
return repr(value)
|
|
|
|
try:
|
|
payload = json.dumps(_sanitize(blocks), ensure_ascii=False, indent=2)
|
|
except Exception:
|
|
payload = repr(blocks)
|
|
|
|
if len(payload) > max_chars:
|
|
payload = payload[: max_chars - 18].rstrip() + "\n... [truncated]"
|
|
|
|
return f"[Slack Block Kit payload for this message]\n```json\n{payload}\n```"
|
|
|
|
|
|
def _apply_slack_proxy(client: Any, proxy_url: Optional[str]) -> None:
|
|
"""Apply a resolved proxy to a Slack SDK client or clear it explicitly."""
|
|
if hasattr(client, "proxy"):
|
|
client.proxy = proxy_url
|
|
|
|
|
|
_SLACK_PROXY_HOSTS = (
|
|
"slack.com",
|
|
"files.slack.com",
|
|
"wss-primary.slack.com",
|
|
)
|
|
|
|
|
|
def _resolve_slack_proxy_url() -> Optional[str]:
|
|
"""Resolve a proxy URL that Slack SDK clients can safely use."""
|
|
proxy_url = resolve_proxy_url()
|
|
if not proxy_url:
|
|
return None
|
|
|
|
normalized = proxy_url.lower()
|
|
if not normalized.startswith(("http://", "https://")):
|
|
logger.info(
|
|
"[Slack] Ignoring unsupported proxy scheme for Slack transport: %s",
|
|
safe_url_for_log(proxy_url),
|
|
)
|
|
return None
|
|
|
|
if any(is_host_excluded_by_no_proxy(host) for host in _SLACK_PROXY_HOSTS):
|
|
logger.info("[Slack] NO_PROXY bypasses Slack proxy configuration")
|
|
return None
|
|
|
|
return proxy_url
|
|
|
|
|
|
class SlackAdapter(BasePlatformAdapter):
|
|
"""
|
|
Slack bot adapter using Socket Mode.
|
|
|
|
Requires two tokens:
|
|
- SLACK_BOT_TOKEN (xoxb-...) for API calls
|
|
- SLACK_APP_TOKEN (xapp-...) for Socket Mode connection
|
|
|
|
Features:
|
|
- DMs and channel messages (mention-gated in channels)
|
|
- Thread support
|
|
- File/image/audio attachments
|
|
- Slash commands (/hermes)
|
|
- Typing indicators (not natively supported by Slack bots)
|
|
"""
|
|
|
|
MAX_MESSAGE_LENGTH = 39000 # Slack API allows 40,000 chars; leave margin
|
|
|
|
def __init__(self, config: PlatformConfig):
|
|
super().__init__(config, Platform.SLACK)
|
|
self._app: Optional[Any] = None
|
|
self._handler: Optional[Any] = None
|
|
self._bot_user_id: Optional[str] = None
|
|
self._user_name_cache: Dict[str, str] = {} # user_id → display name
|
|
self._socket_mode_task: Optional[asyncio.Task] = None
|
|
# Multi-workspace support
|
|
self._team_clients: Dict[str, Any] = {} # team_id → WebClient
|
|
self._team_bot_user_ids: Dict[str, str] = {} # team_id → bot_user_id
|
|
self._channel_team: Dict[str, str] = {} # channel_id → team_id
|
|
# Dedup cache: prevents duplicate bot responses when Socket Mode
|
|
# reconnects redeliver events.
|
|
self._dedup = MessageDeduplicator()
|
|
# Track pending approval message_ts → resolved flag to prevent
|
|
# double-clicks on approval buttons.
|
|
self._approval_resolved: Dict[str, bool] = {}
|
|
# Track timestamps of messages sent by the bot so we can respond
|
|
# to thread replies even without an explicit @mention.
|
|
self._bot_message_ts: set = set()
|
|
self._BOT_TS_MAX = 5000 # cap to avoid unbounded growth
|
|
# Track threads where the bot has been @mentioned — once mentioned,
|
|
# respond to ALL subsequent messages in that thread automatically.
|
|
self._mentioned_threads: set = set()
|
|
self._MENTIONED_THREADS_MAX = 5000
|
|
# Assistant thread metadata keyed by (channel_id, thread_ts). Slack's
|
|
# AI Assistant lifecycle events can arrive before/alongside message
|
|
# events, and they carry the user/thread identity needed for stable
|
|
# session + memory scoping.
|
|
self._assistant_threads: Dict[Tuple[str, str], Dict[str, str]] = {}
|
|
self._ASSISTANT_THREADS_MAX = 5000
|
|
# Cache for _fetch_thread_context results: cache_key → _ThreadContextCache
|
|
self._thread_context_cache: Dict[str, _ThreadContextCache] = {}
|
|
self._THREAD_CACHE_TTL = 60.0
|
|
# Track message IDs that should get reaction lifecycle (DMs / @mentions).
|
|
self._reacting_message_ids: set = set()
|
|
# Track active assistant thread status indicators so stop_typing can
|
|
# clear them (chat_id → thread_ts).
|
|
self._active_status_threads: Dict[str, str] = {}
|
|
# Slash-command contexts: stash response_url + user_id so send()
|
|
# can route the first reply ephemerally. Keyed by
|
|
# (channel_id, user_id) to avoid cross-user collisions.
|
|
# Each value: {"response_url": str, "ts": float}
|
|
self._slash_command_contexts: Dict[Tuple[str, str], Dict[str, Any]] = {}
|
|
# Socket Mode resilience: track runtime connection state so we can
|
|
# self-heal when Slack silently drops the websocket.
|
|
self._app_token: Optional[str] = None
|
|
self._proxy_url: Optional[str] = None
|
|
self._socket_watchdog_task: Optional[asyncio.Task] = None
|
|
self._socket_reconnect_lock = asyncio.Lock()
|
|
self._socket_watchdog_interval_s = 15.0
|
|
|
|
def _start_socket_mode_handler(self) -> None:
|
|
"""Start the Slack Socket Mode background task."""
|
|
if not self._app or not self._app_token:
|
|
raise RuntimeError("Socket Mode requires an initialized app and app token")
|
|
|
|
self._handler = AsyncSocketModeHandler(
|
|
self._app, self._app_token, proxy=self._proxy_url
|
|
)
|
|
_apply_slack_proxy(self._handler.client, self._proxy_url)
|
|
|
|
task = asyncio.create_task(self._handler.start_async())
|
|
self._socket_mode_task = task
|
|
task.add_done_callback(self._on_socket_mode_task_done)
|
|
|
|
async def _stop_socket_mode_handler(self) -> None:
|
|
"""Stop Socket Mode handler and task."""
|
|
handler = self._handler
|
|
task = self._socket_mode_task
|
|
self._handler = None
|
|
self._socket_mode_task = None
|
|
|
|
if handler is not None:
|
|
try:
|
|
await handler.close_async()
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.warning(
|
|
"[Slack] Error while closing Socket Mode handler: %s",
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
|
|
if task is not None and not task.done():
|
|
task.cancel()
|
|
try:
|
|
await task
|
|
except asyncio.CancelledError:
|
|
pass
|
|
except Exception: # pragma: no cover - defensive logging
|
|
logger.debug(
|
|
"[Slack] Socket Mode task failed while stopping", exc_info=True
|
|
)
|
|
|
|
async def _socket_transport_connected(self) -> Optional[bool]:
|
|
"""Best-effort check of current Socket Mode transport state."""
|
|
client = getattr(self._handler, "client", None)
|
|
if client is None:
|
|
return None
|
|
|
|
state = getattr(client, "is_connected", None)
|
|
if state is None:
|
|
return None
|
|
|
|
try:
|
|
value = state() if callable(state) else state
|
|
if asyncio.iscoroutine(value):
|
|
value = await value
|
|
return bool(value)
|
|
except Exception: # pragma: no cover - optional client API
|
|
logger.debug(
|
|
"[Slack] Could not inspect Socket Mode transport state", exc_info=True
|
|
)
|
|
return None
|
|
|
|
async def _restart_socket_mode(self, reason: str) -> None:
|
|
"""Reconnect Socket Mode without rebuilding adapter state."""
|
|
if not self._running:
|
|
return
|
|
|
|
async with self._socket_reconnect_lock:
|
|
if not self._running or not self._app or not self._app_token:
|
|
return
|
|
|
|
logger.warning("[Slack] Socket Mode unhealthy (%s); reconnecting", reason)
|
|
await self._stop_socket_mode_handler()
|
|
|
|
try:
|
|
self._start_socket_mode_handler()
|
|
except Exception as exc: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[Slack] Socket Mode reconnect failed: %s", exc, exc_info=True
|
|
)
|
|
|
|
async def _socket_watchdog_loop(self) -> None:
|
|
"""Monitor Socket Mode and reconnect if the task/transport dies.
|
|
|
|
The body is wrapped in a broad except so a transient bug in
|
|
``_restart_socket_mode`` or the transport probe cannot permanently
|
|
disable self-healing — the loop logs and keeps polling.
|
|
"""
|
|
while self._running:
|
|
try:
|
|
await asyncio.sleep(self._socket_watchdog_interval_s)
|
|
if not self._running:
|
|
break
|
|
|
|
task = self._socket_mode_task
|
|
if task is None:
|
|
await self._restart_socket_mode("socket task missing")
|
|
continue
|
|
|
|
if task.done():
|
|
await self._restart_socket_mode("socket task stopped")
|
|
continue
|
|
|
|
connected = await self._socket_transport_connected()
|
|
if connected is False:
|
|
await self._restart_socket_mode("transport disconnected")
|
|
except asyncio.CancelledError:
|
|
raise
|
|
except Exception: # pragma: no cover - defensive logging
|
|
logger.warning(
|
|
"[Slack] Socket Mode watchdog iteration failed; continuing",
|
|
exc_info=True,
|
|
)
|
|
|
|
def _on_socket_watchdog_done(self, task: asyncio.Task) -> None:
|
|
if task is not self._socket_watchdog_task:
|
|
return
|
|
if task.cancelled() or not self._running:
|
|
return
|
|
try:
|
|
exc = task.exception()
|
|
except (asyncio.CancelledError, Exception): # pragma: no cover
|
|
exc = None
|
|
if exc is not None:
|
|
logger.warning(
|
|
"[Slack] Socket Mode watchdog exited with error; restarting: %s",
|
|
exc,
|
|
exc_info=True,
|
|
)
|
|
else:
|
|
logger.warning("[Slack] Socket Mode watchdog exited; restarting")
|
|
self._socket_watchdog_task = None
|
|
self._ensure_socket_watchdog()
|
|
|
|
def _ensure_socket_watchdog(self) -> None:
|
|
if self._socket_watchdog_task is None or self._socket_watchdog_task.done():
|
|
task = asyncio.create_task(self._socket_watchdog_loop())
|
|
self._socket_watchdog_task = task
|
|
task.add_done_callback(self._on_socket_watchdog_done)
|
|
|
|
def _on_socket_mode_task_done(self, task: asyncio.Task) -> None:
|
|
# Ignore stale tasks from intentional reconnect/shutdown.
|
|
if task is not self._socket_mode_task:
|
|
return
|
|
if task.cancelled():
|
|
return
|
|
if not self._running:
|
|
return
|
|
|
|
exc = None
|
|
try:
|
|
exc = task.exception()
|
|
except asyncio.CancelledError:
|
|
return
|
|
except Exception: # pragma: no cover - defensive logging
|
|
logger.debug(
|
|
"[Slack] Could not inspect Socket Mode task exception", exc_info=True
|
|
)
|
|
|
|
if exc is not None:
|
|
logger.warning(
|
|
"[Slack] Socket Mode task exited with error: %s", exc, exc_info=True
|
|
)
|
|
else:
|
|
logger.warning("[Slack] Socket Mode task exited unexpectedly")
|
|
|
|
try:
|
|
loop = asyncio.get_running_loop()
|
|
except RuntimeError:
|
|
return
|
|
loop.create_task(self._restart_socket_mode("socket task exited"))
|
|
|
|
def _describe_slack_api_error(
|
|
self, response: Any, *, file_obj: Optional[Dict[str, Any]] = None
|
|
) -> Optional[str]:
|
|
"""Convert Slack API auth/permission failures into actionable user-facing text."""
|
|
if response is None or not hasattr(response, "get"):
|
|
return None
|
|
|
|
error = str(response.get("error", "") or "").strip()
|
|
if not error:
|
|
return None
|
|
|
|
file_label = str(
|
|
(file_obj or {}).get("name")
|
|
or (file_obj or {}).get("id")
|
|
or "this attachment"
|
|
)
|
|
needed = str(response.get("needed", "") or "").strip()
|
|
provided = str(response.get("provided", "") or "").strip()
|
|
reinstall_hint = " Update the Slack app scopes/settings and reinstall the app to the workspace."
|
|
provided_hint = f" Current bot scopes: {provided}." if provided else ""
|
|
|
|
if error == "missing_scope":
|
|
needed_hint = (
|
|
f"Missing scope: {needed}."
|
|
if needed
|
|
else "Missing required Slack scope."
|
|
)
|
|
return f"Slack attachment access failed for {file_label}. {needed_hint}{provided_hint}{reinstall_hint}"
|
|
if error in {"not_authed", "invalid_auth", "account_inactive", "token_revoked"}:
|
|
return f"Slack attachment access failed for {file_label} because the bot token is not authorized ({error}). Refresh the token/reinstall the app."
|
|
if error in {"file_not_found", "file_deleted"}:
|
|
return f"Slack attachment {file_label} is no longer available ({error})."
|
|
if error in {
|
|
"access_denied",
|
|
"file_access_denied",
|
|
"no_permission",
|
|
"not_allowed_token_type",
|
|
"restricted_action",
|
|
}:
|
|
return f"Slack attachment access failed for {file_label} because the bot does not have permission ({error}). Check workspace permissions/scopes and reinstall if needed."
|
|
return None
|
|
|
|
def _describe_slack_download_failure(
|
|
self, exc: Exception, *, file_obj: Optional[Dict[str, Any]] = None
|
|
) -> Optional[str]:
|
|
"""Translate Slack download exceptions into user-facing attachment diagnostics."""
|
|
file_label = str(
|
|
(file_obj or {}).get("name")
|
|
or (file_obj or {}).get("id")
|
|
or "this attachment"
|
|
)
|
|
|
|
response = getattr(exc, "response", None)
|
|
api_detail = self._describe_slack_api_error(response, file_obj=file_obj)
|
|
if api_detail:
|
|
return api_detail
|
|
|
|
try:
|
|
import httpx
|
|
except Exception: # pragma: no cover
|
|
httpx = None
|
|
|
|
if httpx is not None and isinstance(exc, httpx.HTTPStatusError):
|
|
status = exc.response.status_code
|
|
if status == 401:
|
|
return f"Slack attachment access failed for {file_label} with HTTP 401. The bot token is not authorized for this file."
|
|
if status == 403:
|
|
return f"Slack attachment access failed for {file_label} with HTTP 403. The bot likely lacks permission or scope to read this file."
|
|
if status == 404:
|
|
return f"Slack attachment {file_label} returned HTTP 404 and is no longer reachable."
|
|
|
|
message = str(exc)
|
|
if (
|
|
"Slack returned HTML instead of media" in message
|
|
or "non-image data" in message
|
|
):
|
|
return (
|
|
f"Slack attachment access failed for {file_label}: Slack returned an HTML/login or non-media response. "
|
|
"This usually means a scope, auth, or file-permission problem."
|
|
)
|
|
return None
|
|
|
|
# ------------------------------------------------------------------
|
|
# Slash-command ephemeral helpers
|
|
# ------------------------------------------------------------------
|
|
|
|
_SLASH_CTX_TTL = 120.0 # seconds — response_url is valid for 30 min;
|
|
# we use a much shorter TTL to avoid routing unrelated messages
|
|
# as ephemeral if the command handler was slow or dropped.
|
|
|
|
def _pop_slash_context(
|
|
self,
|
|
chat_id: str,
|
|
) -> Optional[Dict[str, Any]]:
|
|
"""Return and remove the slash-command context for *chat_id*, if fresh.
|
|
|
|
Contexts older than ``_SLASH_CTX_TTL`` seconds are silently discarded.
|
|
|
|
Uses the ``_slash_user_id`` ContextVar (set in ``_handle_slash_command``)
|
|
to match the exact ``(channel_id, user_id)`` key. This prevents a
|
|
concurrent slash command from a different user on the same channel from
|
|
stealing another user's ephemeral context. Falls back to a
|
|
channel-only scan when the ContextVar is unset (e.g. send() called
|
|
from a non-slash code path — should not match anything).
|
|
"""
|
|
now = time.monotonic()
|
|
# Clean up stale entries on every lookup — dict is small.
|
|
stale_keys = [
|
|
k
|
|
for k, v in self._slash_command_contexts.items()
|
|
if now - v["ts"] > self._SLASH_CTX_TTL
|
|
]
|
|
for k in stale_keys:
|
|
self._slash_command_contexts.pop(k, None)
|
|
|
|
# Precise match: (channel_id, user_id) from ContextVar.
|
|
uid = _slash_user_id.get()
|
|
if uid:
|
|
return self._slash_command_contexts.pop((chat_id, uid), None)
|
|
|
|
# Fallback: channel-only scan (only reachable when ContextVar is
|
|
# unset, i.e. send() called outside a slash-command async context).
|
|
match_key = None
|
|
for key in list(self._slash_command_contexts):
|
|
if key[0] == chat_id:
|
|
match_key = key
|
|
break
|
|
if match_key is None:
|
|
return None
|
|
return self._slash_command_contexts.pop(match_key)
|
|
|
|
async def _send_slash_ephemeral(
|
|
self,
|
|
ctx: Dict[str, Any],
|
|
content: str,
|
|
) -> "SendResult":
|
|
"""Replace the initial ephemeral ack via ``response_url``.
|
|
|
|
Slack's ``response_url`` accepts a POST with ``replace_original``
|
|
for up to 30 minutes after the slash command was invoked. This
|
|
lets us swap the "Running /cmd…" placeholder with the real reply,
|
|
and the message stays ephemeral ("Only visible to you").
|
|
|
|
Falls back to a simple ``True`` SendResult if the POST fails —
|
|
the user already saw the initial ack, so a delivery failure here
|
|
is non-critical.
|
|
"""
|
|
formatted = self.format_message(content)
|
|
# Slack's response_url has the same ~40k char limit as chat_postMessage.
|
|
# Truncate to MAX_MESSAGE_LENGTH and use only the first chunk — the
|
|
# response_url replaces a single ephemeral ack, so multi-chunk isn't
|
|
# possible. Long responses are rare for command replies.
|
|
chunks = self.truncate_message(formatted, self.MAX_MESSAGE_LENGTH)
|
|
text = chunks[0] if chunks else formatted
|
|
payload = {
|
|
"response_type": "ephemeral",
|
|
"replace_original": True,
|
|
"text": text,
|
|
}
|
|
try:
|
|
async with aiohttp.ClientSession(trust_env=True) as session:
|
|
async with session.post(
|
|
ctx["response_url"],
|
|
json=payload,
|
|
timeout=aiohttp.ClientTimeout(total=10),
|
|
) as resp:
|
|
if resp.status == 200:
|
|
return SendResult(success=True, message_id=None)
|
|
body = await resp.text()
|
|
logger.warning(
|
|
"[Slack] response_url POST returned %s: %s",
|
|
resp.status,
|
|
body[:200],
|
|
)
|
|
except Exception as e:
|
|
logger.warning(
|
|
"[Slack] response_url POST failed: %s",
|
|
e,
|
|
)
|
|
# Non-fatal — the user saw the initial ack already.
|
|
return SendResult(success=True, message_id=None)
|
|
|
|
async def connect(self) -> bool:
|
|
"""Connect to Slack via Socket Mode."""
|
|
if not SLACK_AVAILABLE:
|
|
logger.error(
|
|
"[Slack] slack-bolt not installed. Run: pip install slack-bolt",
|
|
)
|
|
return False
|
|
|
|
raw_token = self.config.token
|
|
app_token = os.getenv("SLACK_APP_TOKEN")
|
|
|
|
if not raw_token:
|
|
logger.error("[Slack] SLACK_BOT_TOKEN not set")
|
|
return False
|
|
if not app_token:
|
|
logger.error("[Slack] SLACK_APP_TOKEN not set")
|
|
return False
|
|
|
|
proxy_url = _resolve_slack_proxy_url()
|
|
if proxy_url:
|
|
logger.info(
|
|
"[Slack] Using proxy for Slack transport: %s",
|
|
safe_url_for_log(proxy_url),
|
|
)
|
|
|
|
# Support comma-separated bot tokens for multi-workspace
|
|
bot_tokens = [t.strip() for t in raw_token.split(",") if t.strip()]
|
|
|
|
# Also load tokens from OAuth token file
|
|
from hermes_constants import get_hermes_home
|
|
|
|
tokens_file = get_hermes_home() / "slack_tokens.json"
|
|
if tokens_file.exists():
|
|
try:
|
|
saved = json.loads(tokens_file.read_text(encoding="utf-8"))
|
|
for team_id, entry in saved.items():
|
|
tok = entry.get("token", "") if isinstance(entry, dict) else ""
|
|
if tok and tok not in bot_tokens:
|
|
bot_tokens.append(tok)
|
|
team_label = (
|
|
entry.get("team_name", team_id)
|
|
if isinstance(entry, dict)
|
|
else team_id
|
|
)
|
|
logger.info(
|
|
"[Slack] Loaded saved token for workspace %s", team_label
|
|
)
|
|
except Exception as e:
|
|
logger.warning("[Slack] Failed to read %s: %s", tokens_file, e)
|
|
|
|
lock_acquired = False
|
|
try:
|
|
if not self._acquire_platform_lock(
|
|
"slack-app-token", app_token, "Slack app token"
|
|
):
|
|
return False
|
|
lock_acquired = True
|
|
self._running = False
|
|
|
|
# Tear down any prior reconnect state before flipping ``_running``
|
|
# back on. We must cancel + await the existing watchdog (not just
|
|
# check ``task.done()`` later) so an old watchdog can't observe
|
|
# ``_running=False``, exit, and then leave us with no monitor when
|
|
# ``_ensure_socket_watchdog`` runs before the new task is visible.
|
|
watchdog_task = self._socket_watchdog_task
|
|
self._socket_watchdog_task = None
|
|
if watchdog_task is not None and not watchdog_task.done():
|
|
watchdog_task.cancel()
|
|
try:
|
|
await watchdog_task
|
|
except asyncio.CancelledError:
|
|
pass
|
|
except Exception: # pragma: no cover - defensive logging
|
|
logger.debug(
|
|
"[Slack] Prior watchdog task failed while stopping",
|
|
exc_info=True,
|
|
)
|
|
|
|
# Close any previous handler before creating a new one so that
|
|
# calling connect() a second time (e.g. during a gateway restart or
|
|
# in-process reconnect attempt) does not leave a zombie Socket Mode
|
|
# connection alive. Both the old and new connections would otherwise
|
|
# receive every Slack event and dispatch it twice, producing double
|
|
# responses — the same bug that affected DiscordAdapter (#18187).
|
|
await self._stop_socket_mode_handler()
|
|
self._app = None
|
|
self._app_token = app_token
|
|
self._proxy_url = proxy_url
|
|
|
|
# Reset multi-workspace state before re-populating it so a
|
|
# reconnect that drops a workspace (or rotates the primary bot
|
|
# token) doesn't carry stale ``_bot_user_id`` / ``_team_clients``
|
|
# / ``_team_bot_user_ids`` entries from the prior session.
|
|
self._bot_user_id = None
|
|
self._team_clients = {}
|
|
self._team_bot_user_ids = {}
|
|
|
|
# First token is the primary — used for AsyncApp / Socket Mode
|
|
primary_token = bot_tokens[0]
|
|
self._app = AsyncApp(token=primary_token)
|
|
_apply_slack_proxy(self._app.client, proxy_url)
|
|
|
|
# Register each bot token and map team_id → client
|
|
for token in bot_tokens:
|
|
client = AsyncWebClient(token=token)
|
|
_apply_slack_proxy(client, proxy_url)
|
|
auth_response = await client.auth_test()
|
|
team_id = auth_response.get("team_id", "")
|
|
bot_user_id = auth_response.get("user_id", "")
|
|
bot_name = auth_response.get("user", "unknown")
|
|
team_name = auth_response.get("team", "unknown")
|
|
|
|
self._team_clients[team_id] = client
|
|
self._team_bot_user_ids[team_id] = bot_user_id
|
|
|
|
# First token always wins as the primary bot user id; we
|
|
# cleared ``_bot_user_id`` above so this picks up the current
|
|
# token's identity even on reconnect.
|
|
if self._bot_user_id is None:
|
|
self._bot_user_id = bot_user_id
|
|
|
|
logger.info(
|
|
"[Slack] Authenticated as @%s in workspace %s (team: %s)",
|
|
bot_name,
|
|
team_name,
|
|
team_id,
|
|
)
|
|
|
|
# Register message event handler
|
|
@self._app.event("message")
|
|
async def handle_message_event(event, say):
|
|
await self._handle_slack_message(event)
|
|
|
|
# Handle app_mention explicitly. In some Slack app configurations,
|
|
# channel mentions arrive only as app_mention events rather than the
|
|
# generic message event. Forward them into the normal message
|
|
# pipeline so @mentions reliably produce replies.
|
|
# NOTE: when Slack fires BOTH message and app_mention for the same
|
|
# @mention, they share the same event ts — the dedup in
|
|
# _handle_slack_message (MessageDeduplicator) suppresses the second.
|
|
@self._app.event("app_mention")
|
|
async def handle_app_mention(event, say):
|
|
await self._handle_slack_message(event)
|
|
|
|
# File lifecycle events can arrive around snippet uploads even when
|
|
# the actual user message is what we care about. Ack them so Slack
|
|
# doesn't log noisy 404 "unhandled request" warnings.
|
|
@self._app.event("file_shared")
|
|
async def handle_file_shared(event, say):
|
|
pass
|
|
|
|
@self._app.event("file_created")
|
|
async def handle_file_created(event, say):
|
|
pass
|
|
|
|
@self._app.event("file_change")
|
|
async def handle_file_change(event, say):
|
|
pass
|
|
|
|
@self._app.event("assistant_thread_started")
|
|
async def handle_assistant_thread_started(event, say):
|
|
await self._handle_assistant_thread_lifecycle_event(event)
|
|
|
|
@self._app.event("assistant_thread_context_changed")
|
|
async def handle_assistant_thread_context_changed(event, say):
|
|
await self._handle_assistant_thread_lifecycle_event(event)
|
|
|
|
# Register slash command handler(s)
|
|
#
|
|
# Every gateway command from COMMAND_REGISTRY is a native Slack
|
|
# slash, matching Discord and Telegram's model (e.g. /btw, /stop,
|
|
# /model work directly without /hermes prefix). A single regex
|
|
# matcher dispatches all of them to one handler so we don't need
|
|
# N identical @app.command() decorators.
|
|
#
|
|
# The slash commands must ALSO be declared in the Slack app
|
|
# manifest (see `hermes slack manifest`). In Socket Mode, Slack
|
|
# routes the command event through the socket regardless of the
|
|
# manifest's request URL, but it will not deliver an event for
|
|
# a slash command the manifest doesn't declare.
|
|
from hermes_cli.commands import slack_native_slashes
|
|
import re as _re
|
|
|
|
_slash_names = [name for name, _d, _h in slack_native_slashes()]
|
|
if _slash_names:
|
|
_slash_pattern = _re.compile(
|
|
r"^/(?:" + "|".join(_re.escape(n) for n in _slash_names) + r")$"
|
|
)
|
|
else: # pragma: no cover - registry always non-empty
|
|
_slash_pattern = _re.compile(r"^/hermes$")
|
|
|
|
@self._app.command(_slash_pattern)
|
|
async def handle_hermes_command(ack, command):
|
|
slash = (command.get("command") or "").lstrip("/")
|
|
await ack(
|
|
response_type="ephemeral",
|
|
text=f"Running `/{slash}`…",
|
|
)
|
|
await self._handle_slash_command(command)
|
|
|
|
# Register Block Kit action handlers for approval buttons
|
|
for _action_id in (
|
|
"hermes_approve_once",
|
|
"hermes_approve_session",
|
|
"hermes_approve_always",
|
|
"hermes_deny",
|
|
):
|
|
self._app.action(_action_id)(self._handle_approval_action)
|
|
|
|
# Register Block Kit action handlers for slash-confirm buttons
|
|
# (generic three-option prompts; see tools/slash_confirm.py).
|
|
for _action_id in (
|
|
"hermes_confirm_once",
|
|
"hermes_confirm_always",
|
|
"hermes_confirm_cancel",
|
|
):
|
|
self._app.action(_action_id)(self._handle_slash_confirm_action)
|
|
|
|
# Bring up the handler and watchdog atomically. ``_running`` only
|
|
# flips to True after the handler is alive so the watchdog loop
|
|
# observes the live task immediately; on any failure here we tear
|
|
# down whatever we managed to start, leave ``_running=False``, and
|
|
# let the ``finally`` block release the platform lock cleanly.
|
|
try:
|
|
self._start_socket_mode_handler()
|
|
self._running = True
|
|
self._ensure_socket_watchdog()
|
|
except Exception:
|
|
self._running = False
|
|
try:
|
|
await self._stop_socket_mode_handler()
|
|
except Exception: # pragma: no cover - defensive logging
|
|
logger.debug(
|
|
"[Slack] Cleanup after failed start raised", exc_info=True
|
|
)
|
|
raise
|
|
|
|
logger.info(
|
|
"[Slack] Socket Mode connected (%d workspace(s))",
|
|
len(self._team_clients),
|
|
)
|
|
return True
|
|
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error("[Slack] Connection failed: %s", e, exc_info=True)
|
|
return False
|
|
finally:
|
|
if lock_acquired and not self._running:
|
|
self._release_platform_lock()
|
|
|
|
async def create_handoff_thread(
|
|
self,
|
|
parent_chat_id: str,
|
|
name: str,
|
|
) -> Optional[str]:
|
|
"""Create a Slack thread anchor for a session handoff.
|
|
|
|
Slack threads are anchored to a parent message (``thread_ts``), not
|
|
a channel-level construct. So we post a seed message into the home
|
|
channel and return its ``ts`` — the watcher uses that as the
|
|
``thread_id`` for subsequent sends.
|
|
|
|
Returns the seed message ts as a string, or ``None`` on failure.
|
|
"""
|
|
if not self._app:
|
|
return None
|
|
try:
|
|
client = self._get_client(parent_chat_id)
|
|
if client is None:
|
|
return None
|
|
seed_text = (
|
|
f":thread: Hermes handoff — *{(name or 'session').strip()[:80]}*"
|
|
)
|
|
result = await client.chat_postMessage(
|
|
channel=parent_chat_id,
|
|
text=seed_text,
|
|
)
|
|
ts = (
|
|
result.get("ts")
|
|
if isinstance(result, dict)
|
|
else getattr(result, "get", lambda _k, _d=None: None)("ts")
|
|
)
|
|
if ts:
|
|
return str(ts)
|
|
except Exception as exc:
|
|
logger.warning(
|
|
"[%s] Handoff thread: seed-post failed for channel %s: %s",
|
|
self.name,
|
|
parent_chat_id,
|
|
exc,
|
|
)
|
|
return None
|
|
|
|
async def disconnect(self) -> None:
|
|
"""Disconnect from Slack."""
|
|
self._running = False
|
|
|
|
watchdog_task = self._socket_watchdog_task
|
|
self._socket_watchdog_task = None
|
|
if watchdog_task is not None and not watchdog_task.done():
|
|
watchdog_task.cancel()
|
|
try:
|
|
await watchdog_task
|
|
except asyncio.CancelledError:
|
|
pass
|
|
except Exception: # pragma: no cover - defensive logging
|
|
# Watchdog may have lost the cancellation race and exited with
|
|
# an unrelated exception. Log and continue so handler cleanup
|
|
# and lock release still happen.
|
|
logger.debug(
|
|
"[Slack] Watchdog task raised during disconnect", exc_info=True
|
|
)
|
|
|
|
await self._stop_socket_mode_handler()
|
|
self._app = None
|
|
self._app_token = None
|
|
self._proxy_url = None
|
|
|
|
self._release_platform_lock()
|
|
|
|
logger.info("[Slack] Disconnected")
|
|
|
|
def _get_client(self, chat_id: str) -> Any:
|
|
"""Return the workspace-specific WebClient for a channel."""
|
|
team_id = self._channel_team.get(chat_id)
|
|
if team_id and team_id in self._team_clients:
|
|
return self._team_clients[team_id]
|
|
return self._app.client # fallback to primary
|
|
|
|
async def send(
|
|
self,
|
|
chat_id: str,
|
|
content: str,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a message to a Slack channel or DM."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
try:
|
|
# Check for a pending slash-command context. When the user ran a
|
|
# native slash command (e.g. /q, /stop, /model), the initial ack
|
|
# already showed an ephemeral "Running /cmd…" message. If we have
|
|
# a stashed response_url for this channel, replace that ack with
|
|
# the actual command reply ephemerally instead of posting publicly.
|
|
slash_ctx = self._pop_slash_context(chat_id)
|
|
if slash_ctx:
|
|
return await self._send_slash_ephemeral(
|
|
slash_ctx,
|
|
content,
|
|
)
|
|
|
|
# Convert standard markdown → Slack mrkdwn
|
|
formatted = self.format_message(content)
|
|
|
|
# Split long messages, preserving code block boundaries
|
|
chunks = self.truncate_message(formatted, self.MAX_MESSAGE_LENGTH)
|
|
|
|
thread_ts = self._resolve_thread_ts(reply_to, metadata)
|
|
last_result = None
|
|
|
|
# reply_broadcast: also post thread replies to the main channel.
|
|
# Controlled via platform config: gateway.slack.reply_broadcast
|
|
broadcast = self.config.extra.get("reply_broadcast", False)
|
|
|
|
for i, chunk in enumerate(chunks):
|
|
kwargs = {
|
|
"channel": chat_id,
|
|
"text": chunk,
|
|
"mrkdwn": True,
|
|
}
|
|
if thread_ts:
|
|
kwargs["thread_ts"] = thread_ts
|
|
# Only broadcast the first chunk of the first reply
|
|
if broadcast and i == 0:
|
|
kwargs["reply_broadcast"] = True
|
|
|
|
last_result = await self._get_client(chat_id).chat_postMessage(**kwargs)
|
|
|
|
# Clear Slack Assistant status as soon as the final message is posted.
|
|
if thread_ts:
|
|
await self.stop_typing(chat_id)
|
|
|
|
# Track the sent message ts so we can auto-respond to thread
|
|
# replies without requiring @mention.
|
|
sent_ts = last_result.get("ts") if last_result else None
|
|
if sent_ts:
|
|
self._bot_message_ts.add(sent_ts)
|
|
# Also register the thread root so replies-to-my-replies work
|
|
if thread_ts:
|
|
self._bot_message_ts.add(thread_ts)
|
|
if len(self._bot_message_ts) > self._BOT_TS_MAX:
|
|
excess = len(self._bot_message_ts) - self._BOT_TS_MAX // 2
|
|
for old_ts in list(self._bot_message_ts)[:excess]:
|
|
self._bot_message_ts.discard(old_ts)
|
|
|
|
return SendResult(
|
|
success=True,
|
|
message_id=sent_ts,
|
|
raw_response=last_result,
|
|
)
|
|
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error("[Slack] Send error: %s", e, exc_info=True)
|
|
return SendResult(success=False, error=str(e))
|
|
|
|
async def send_private_notice(
|
|
self,
|
|
chat_id: str,
|
|
user_id: str,
|
|
content: str,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a Slack ephemeral message visible only to one user."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
if not chat_id or not user_id:
|
|
return SendResult(success=False, error="chat_id and user_id are required")
|
|
|
|
try:
|
|
formatted = self.format_message(content)
|
|
thread_ts = self._resolve_thread_ts(reply_to, metadata)
|
|
kwargs = {
|
|
"channel": chat_id,
|
|
"user": user_id,
|
|
"text": formatted,
|
|
"mrkdwn": True,
|
|
}
|
|
if thread_ts:
|
|
kwargs["thread_ts"] = thread_ts
|
|
|
|
result = await self._get_client(chat_id).chat_postEphemeral(**kwargs)
|
|
return SendResult(
|
|
success=True,
|
|
message_id=result.get("message_ts") or result.get("ts"),
|
|
raw_response=result,
|
|
)
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error("[Slack] Ephemeral send error: %s", e, exc_info=True)
|
|
return SendResult(success=False, error=str(e))
|
|
|
|
async def edit_message(
|
|
self,
|
|
chat_id: str,
|
|
message_id: str,
|
|
content: str,
|
|
*,
|
|
finalize: bool = False,
|
|
) -> SendResult:
|
|
"""Edit a previously sent Slack message."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
try:
|
|
formatted = self.format_message(content)
|
|
await self._get_client(chat_id).chat_update(
|
|
channel=chat_id,
|
|
ts=message_id,
|
|
text=formatted,
|
|
)
|
|
if finalize:
|
|
await self.stop_typing(chat_id)
|
|
return SendResult(success=True, message_id=message_id)
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[Slack] Failed to edit message %s in channel %s: %s",
|
|
message_id,
|
|
chat_id,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
return SendResult(success=False, error=str(e))
|
|
|
|
async def send_typing(self, chat_id: str, metadata=None) -> None:
|
|
"""Show a typing/status indicator using assistant.threads.setStatus.
|
|
|
|
Displays "is thinking..." next to the bot name in a thread.
|
|
Requires the assistant:write or chat:write scope.
|
|
Auto-clears when the bot sends a reply to the thread.
|
|
"""
|
|
if not self._app:
|
|
return
|
|
|
|
thread_ts = None
|
|
if metadata:
|
|
thread_ts = metadata.get("thread_id") or metadata.get("thread_ts")
|
|
|
|
if not thread_ts:
|
|
return # Can only set status in a thread context
|
|
|
|
self._active_status_threads[chat_id] = thread_ts
|
|
try:
|
|
await self._get_client(chat_id).assistant_threads_setStatus(
|
|
channel_id=chat_id,
|
|
thread_ts=thread_ts,
|
|
status="is thinking...",
|
|
)
|
|
except Exception as e:
|
|
# Silently ignore — may lack assistant:write scope or not be
|
|
# in an assistant-enabled context. Falls back to reactions.
|
|
logger.debug("[Slack] assistant.threads.setStatus failed: %s", e)
|
|
|
|
async def stop_typing(self, chat_id: str, metadata=None) -> None:
|
|
"""Clear the assistant thread status indicator."""
|
|
if not self._app:
|
|
return
|
|
thread_ts = self._active_status_threads.pop(chat_id, None)
|
|
if not thread_ts:
|
|
return
|
|
try:
|
|
await self._get_client(chat_id).assistant_threads_setStatus(
|
|
channel_id=chat_id,
|
|
thread_ts=thread_ts,
|
|
status="",
|
|
)
|
|
except Exception as e:
|
|
logger.debug("[Slack] assistant.threads.setStatus clear failed: %s", e)
|
|
|
|
def _dm_top_level_threads_as_sessions(self) -> bool:
|
|
"""Whether top-level Slack DMs get per-message session threads.
|
|
|
|
Defaults to ``True`` so each visible DM reply thread is isolated as its
|
|
own Hermes session — matching the per-thread behavior channels already
|
|
have. Set ``platforms.slack.extra.dm_top_level_threads_as_sessions``
|
|
to ``false`` in config.yaml to revert to the legacy behavior where all
|
|
top-level DMs share one continuous session.
|
|
"""
|
|
raw = self.config.extra.get("dm_top_level_threads_as_sessions")
|
|
if raw is None:
|
|
return True # default: each DM thread is its own session
|
|
return str(raw).strip().lower() in {"1", "true", "yes", "on"}
|
|
|
|
def _resolve_thread_ts(
|
|
self,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> Optional[str]:
|
|
"""Resolve the correct thread_ts for a Slack API call.
|
|
|
|
Prefers metadata thread_id (the thread parent's ts, set by the
|
|
gateway) over reply_to (which may be a child message's ts).
|
|
|
|
When ``reply_in_thread`` is ``false`` in the platform extra config,
|
|
top-level channel messages receive direct channel replies instead of
|
|
thread replies. Messages that originate inside an existing thread are
|
|
always replied to in-thread to preserve conversation context.
|
|
"""
|
|
# When reply_in_thread is disabled (default: True for backward compat),
|
|
# only thread messages that are already part of an existing thread.
|
|
# For top-level channel messages, the inbound handler sets
|
|
# metadata.thread_id to the message's own ts as a session-keying
|
|
# fallback (see the `thread_ts = event.get("thread_ts") or ts` branch),
|
|
# so metadata alone can't distinguish a real thread reply from a
|
|
# top-level message. reply_to is the incoming message's own id, so
|
|
# when thread_id == reply_to the "thread" is synthetic and we reply
|
|
# directly in the channel instead.
|
|
if not self.config.extra.get("reply_in_thread", True):
|
|
md = metadata or {}
|
|
existing_thread = md.get("thread_id") or md.get("thread_ts")
|
|
if existing_thread and reply_to and existing_thread == reply_to:
|
|
existing_thread = None
|
|
return existing_thread or None
|
|
|
|
if metadata:
|
|
if metadata.get("thread_id"):
|
|
return metadata["thread_id"]
|
|
if metadata.get("thread_ts"):
|
|
return metadata["thread_ts"]
|
|
return reply_to
|
|
|
|
async def _upload_file(
|
|
self,
|
|
chat_id: str,
|
|
file_path: str,
|
|
caption: Optional[str] = None,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Upload a local file to Slack."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
if not os.path.exists(file_path):
|
|
raise FileNotFoundError(f"File not found: {file_path}")
|
|
|
|
thread_ts = self._resolve_thread_ts(reply_to, metadata)
|
|
last_exc = None
|
|
for attempt in range(3):
|
|
try:
|
|
result = await self._get_client(chat_id).files_upload_v2(
|
|
channel=chat_id,
|
|
file=file_path,
|
|
filename=os.path.basename(file_path),
|
|
initial_comment=caption or "",
|
|
thread_ts=thread_ts,
|
|
)
|
|
self._record_uploaded_file_thread(chat_id, thread_ts)
|
|
return SendResult(success=True, raw_response=result)
|
|
except Exception as exc:
|
|
last_exc = exc
|
|
if not self._is_retryable_upload_error(exc) or attempt >= 2:
|
|
raise
|
|
logger.debug(
|
|
"[Slack] Upload retry %d/2 for %s: %s",
|
|
attempt + 1,
|
|
file_path,
|
|
exc,
|
|
)
|
|
await asyncio.sleep(1.5 * (attempt + 1))
|
|
|
|
raise last_exc
|
|
|
|
async def send_multiple_images(
|
|
self,
|
|
chat_id: str,
|
|
images: List[Tuple[str, str]],
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
human_delay: float = 0.0,
|
|
) -> None:
|
|
"""Send a batch of images as a single Slack message with multiple file uploads.
|
|
|
|
Uses ``files_upload_v2`` with its ``file_uploads`` parameter so all
|
|
images show up attached to one ``initial_comment`` message instead
|
|
of N separate messages. Falls back to the base per-image loop on
|
|
any failure.
|
|
|
|
The batch limit is 10 file uploads per call (Slack server-side cap).
|
|
"""
|
|
if not self._app:
|
|
return
|
|
if not images:
|
|
return
|
|
|
|
try:
|
|
import httpx as _httpx
|
|
from urllib.parse import unquote as _unquote
|
|
from tools.url_safety import is_safe_url as _is_safe_url
|
|
except Exception:
|
|
await super().send_multiple_images(chat_id, images, metadata, human_delay)
|
|
return
|
|
|
|
thread_ts = self._resolve_thread_ts(None, metadata)
|
|
|
|
CHUNK = 10
|
|
chunks = [images[i : i + CHUNK] for i in range(0, len(images), CHUNK)]
|
|
|
|
for chunk_idx, chunk in enumerate(chunks):
|
|
if human_delay > 0 and chunk_idx > 0:
|
|
await asyncio.sleep(human_delay)
|
|
|
|
file_uploads: List[Dict[str, Any]] = []
|
|
initial_comment_parts: List[str] = []
|
|
try:
|
|
async with _httpx.AsyncClient(
|
|
timeout=30.0, follow_redirects=True
|
|
) as http_client:
|
|
for image_url, alt_text in chunk:
|
|
if alt_text:
|
|
initial_comment_parts.append(alt_text)
|
|
|
|
if image_url.startswith("file://"):
|
|
local_path = _unquote(image_url[7:])
|
|
if not os.path.exists(local_path):
|
|
logger.warning(
|
|
"[Slack] Skipping missing image: %s", local_path
|
|
)
|
|
continue
|
|
file_uploads.append(
|
|
{
|
|
"file": local_path,
|
|
"filename": os.path.basename(local_path),
|
|
}
|
|
)
|
|
else:
|
|
if not _is_safe_url(image_url):
|
|
logger.warning(
|
|
"[Slack] Blocked unsafe image URL in batch"
|
|
)
|
|
continue
|
|
try:
|
|
response = await http_client.get(image_url)
|
|
response.raise_for_status()
|
|
ext = "png"
|
|
ct = response.headers.get("content-type", "")
|
|
if "jpeg" in ct or "jpg" in ct:
|
|
ext = "jpg"
|
|
elif "gif" in ct:
|
|
ext = "gif"
|
|
elif "webp" in ct:
|
|
ext = "webp"
|
|
file_uploads.append(
|
|
{
|
|
"content": response.content,
|
|
"filename": f"image_{len(file_uploads)}.{ext}",
|
|
}
|
|
)
|
|
except Exception as dl_err:
|
|
logger.warning(
|
|
"[Slack] Download failed for %s: %s",
|
|
safe_url_for_log(image_url),
|
|
dl_err,
|
|
)
|
|
continue
|
|
|
|
if not file_uploads:
|
|
continue
|
|
|
|
initial_comment = (
|
|
"\n".join(initial_comment_parts) if initial_comment_parts else ""
|
|
)
|
|
logger.info(
|
|
"[Slack] Sending %d image(s) in single files_upload_v2 (chunk %d/%d)",
|
|
len(file_uploads),
|
|
chunk_idx + 1,
|
|
len(chunks),
|
|
)
|
|
result = await self._get_client(chat_id).files_upload_v2(
|
|
channel=chat_id,
|
|
file_uploads=file_uploads,
|
|
initial_comment=initial_comment,
|
|
thread_ts=thread_ts,
|
|
)
|
|
self._record_uploaded_file_thread(chat_id, thread_ts)
|
|
_ = result
|
|
except Exception as e:
|
|
logger.warning(
|
|
"[Slack] Multi-image files_upload_v2 failed (chunk %d/%d), falling back to per-image: %s",
|
|
chunk_idx + 1,
|
|
len(chunks),
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
await super().send_multiple_images(
|
|
chat_id, chunk, metadata, human_delay=human_delay
|
|
)
|
|
|
|
def _record_uploaded_file_thread(
|
|
self, chat_id: str, thread_ts: Optional[str]
|
|
) -> None:
|
|
"""Treat successful file uploads as bot participation in a thread."""
|
|
if not thread_ts:
|
|
return
|
|
self._bot_message_ts.add(thread_ts)
|
|
if len(self._bot_message_ts) > self._BOT_TS_MAX:
|
|
excess = len(self._bot_message_ts) - self._BOT_TS_MAX // 2
|
|
for old_ts in list(self._bot_message_ts)[:excess]:
|
|
self._bot_message_ts.discard(old_ts)
|
|
|
|
def _is_retryable_upload_error(self, exc: Exception) -> bool:
|
|
"""Best-effort detection for transient Slack upload failures."""
|
|
status_code = getattr(getattr(exc, "response", None), "status_code", None)
|
|
if status_code is not None:
|
|
return status_code == 429 or status_code >= 500
|
|
|
|
body = " ".join(
|
|
str(part)
|
|
for part in (
|
|
exc,
|
|
getattr(exc, "message", ""),
|
|
getattr(exc, "response", None),
|
|
)
|
|
if part
|
|
).lower()
|
|
if "rate_limited" in body or "ratelimited" in body or "429" in body:
|
|
return True
|
|
if (
|
|
"connection reset" in body
|
|
or "service unavailable" in body
|
|
or "temporarily unavailable" in body
|
|
):
|
|
return True
|
|
return self._is_retryable_error(body)
|
|
|
|
# ----- Markdown → mrkdwn conversion -----
|
|
|
|
def format_message(self, content: str) -> str:
|
|
"""Convert standard markdown to Slack mrkdwn format.
|
|
|
|
Protected regions (code blocks, inline code) are extracted first so
|
|
their contents are never modified. Standard markdown constructs
|
|
(headers, bold, italic, links) are translated to mrkdwn syntax.
|
|
"""
|
|
if not content:
|
|
return content
|
|
|
|
placeholders: dict = {}
|
|
counter = [0]
|
|
|
|
def _ph(value: str) -> str:
|
|
"""Stash value behind a placeholder that survives later passes."""
|
|
key = f"\x00SL{counter[0]}\x00"
|
|
counter[0] += 1
|
|
placeholders[key] = value
|
|
return key
|
|
|
|
text = content
|
|
|
|
# 1) Protect fenced code blocks (``` ... ```)
|
|
text = re.sub(
|
|
r"(```(?:[^\n]*\n)?[\s\S]*?```)",
|
|
lambda m: _ph(m.group(0)),
|
|
text,
|
|
)
|
|
|
|
# 2) Protect inline code (`...`)
|
|
text = re.sub(r"(`[^`]+`)", lambda m: _ph(m.group(0)), text)
|
|
|
|
# 3) Convert markdown links [text](url) → <url|text>
|
|
def _convert_markdown_link(m):
|
|
label = m.group(1)
|
|
url = m.group(2).strip()
|
|
if url.startswith("<") and url.endswith(">"):
|
|
url = url[1:-1].strip()
|
|
return _ph(f"<{url}|{label}>")
|
|
|
|
text = re.sub(
|
|
r"(?<!!)\[([^\]]+)\]\(([^()]*(?:\([^()]*\)[^()]*)*)\)",
|
|
_convert_markdown_link,
|
|
text,
|
|
)
|
|
|
|
# 4) Protect existing Slack entities/manual links so escaping and later
|
|
# formatting passes don't break them.
|
|
text = re.sub(
|
|
r"(<(?:[@#!]|(?:https?|mailto|tel):)[^>\n]+>)",
|
|
lambda m: _ph(m.group(1)),
|
|
text,
|
|
)
|
|
|
|
# 5) Protect blockquote markers before escaping
|
|
text = re.sub(r"^(>+\s)", lambda m: _ph(m.group(0)), text, flags=re.MULTILINE)
|
|
|
|
# 6) Escape Slack control characters in remaining plain text.
|
|
# Unescape first so already-escaped input doesn't get double-escaped.
|
|
text = text.replace("&", "&").replace("<", "<").replace(">", ">")
|
|
text = text.replace("&", "&").replace("<", "<").replace(">", ">")
|
|
|
|
# 7) Convert headers (## Title) → *Title* (bold)
|
|
def _convert_header(m):
|
|
inner = m.group(1).strip()
|
|
# Strip redundant bold markers inside a header
|
|
inner = re.sub(r"\*\*(.+?)\*\*", r"\1", inner)
|
|
return _ph(f"*{inner}*")
|
|
|
|
text = re.sub(r"^#{1,6}\s+(.+)$", _convert_header, text, flags=re.MULTILINE)
|
|
|
|
# 8) Convert bold+italic: ***text*** → *_text_* (Slack bold wrapping italic)
|
|
text = re.sub(
|
|
r"\*\*\*(.+?)\*\*\*",
|
|
lambda m: _ph(f"*_{m.group(1)}_*"),
|
|
text,
|
|
)
|
|
|
|
# 9) Convert bold: **text** → *text* (Slack bold)
|
|
text = re.sub(
|
|
r"\*\*(.+?)\*\*",
|
|
lambda m: _ph(f"*{m.group(1)}*"),
|
|
text,
|
|
)
|
|
|
|
# 10) Convert italic: _text_ stays as _text_ (already Slack italic)
|
|
# Single *text* → _text_ (Slack italic), but only when the
|
|
# emphasized text touches non-whitespace on both sides so literal
|
|
# delimiters like "a * b * c" are preserved.
|
|
text = re.sub(
|
|
r"(?<!\*)\*(\S(?:[^*\n]*?\S)?)\*(?!\*)",
|
|
lambda m: _ph(f"_{m.group(1)}_"),
|
|
text,
|
|
)
|
|
|
|
# 11) Convert strikethrough: ~~text~~ → ~text~
|
|
text = re.sub(
|
|
r"~~(.+?)~~",
|
|
lambda m: _ph(f"~{m.group(1)}~"),
|
|
text,
|
|
)
|
|
|
|
# 12) Blockquotes: > prefix is already protected by step 5 above.
|
|
|
|
# 13) Restore placeholders in reverse order
|
|
for key in reversed(placeholders):
|
|
text = text.replace(key, placeholders[key])
|
|
|
|
return text
|
|
|
|
# ----- Reactions -----
|
|
|
|
async def _add_reaction(self, channel: str, timestamp: str, emoji: str) -> bool:
|
|
"""Add an emoji reaction to a message. Returns True on success."""
|
|
if not self._app:
|
|
return False
|
|
try:
|
|
await self._get_client(channel).reactions_add(
|
|
channel=channel, timestamp=timestamp, name=emoji
|
|
)
|
|
return True
|
|
except Exception as e:
|
|
# Don't log as error — may fail if already reacted or missing scope
|
|
logger.debug("[Slack] reactions.add failed (%s): %s", emoji, e)
|
|
return False
|
|
|
|
async def _remove_reaction(self, channel: str, timestamp: str, emoji: str) -> bool:
|
|
"""Remove an emoji reaction from a message. Returns True on success."""
|
|
if not self._app:
|
|
return False
|
|
try:
|
|
await self._get_client(channel).reactions_remove(
|
|
channel=channel, timestamp=timestamp, name=emoji
|
|
)
|
|
return True
|
|
except Exception as e:
|
|
logger.debug("[Slack] reactions.remove failed (%s): %s", emoji, e)
|
|
return False
|
|
|
|
def _reactions_enabled(self) -> bool:
|
|
"""Check if message reactions are enabled via config/env."""
|
|
return os.getenv("SLACK_REACTIONS", "true").lower() not in {"false", "0", "no"}
|
|
|
|
async def on_processing_start(self, event: MessageEvent) -> None:
|
|
"""Add an in-progress reaction when message processing begins."""
|
|
if not self._reactions_enabled():
|
|
return
|
|
ts = getattr(event, "message_id", None)
|
|
if not ts or ts not in self._reacting_message_ids:
|
|
return
|
|
channel_id = getattr(event.source, "chat_id", None)
|
|
if channel_id:
|
|
await self._add_reaction(channel_id, ts, "eyes")
|
|
|
|
async def on_processing_complete(
|
|
self, event: MessageEvent, outcome: ProcessingOutcome
|
|
) -> None:
|
|
"""Swap the in-progress reaction for a final success/failure reaction."""
|
|
if not self._reactions_enabled():
|
|
return
|
|
ts = getattr(event, "message_id", None)
|
|
if not ts or ts not in self._reacting_message_ids:
|
|
return
|
|
self._reacting_message_ids.discard(ts)
|
|
channel_id = getattr(event.source, "chat_id", None)
|
|
if not channel_id:
|
|
return
|
|
await self._remove_reaction(channel_id, ts, "eyes")
|
|
if outcome == ProcessingOutcome.SUCCESS:
|
|
await self._add_reaction(channel_id, ts, "white_check_mark")
|
|
elif outcome == ProcessingOutcome.FAILURE:
|
|
await self._add_reaction(channel_id, ts, "x")
|
|
|
|
# ----- User identity resolution -----
|
|
|
|
async def _resolve_user_name(self, user_id: str, chat_id: str = "") -> str:
|
|
"""Resolve a Slack user ID to a display name, with caching."""
|
|
if not user_id:
|
|
return ""
|
|
if user_id in self._user_name_cache:
|
|
return self._user_name_cache[user_id]
|
|
|
|
if not self._app:
|
|
return user_id
|
|
|
|
try:
|
|
client = self._get_client(chat_id) if chat_id else self._app.client
|
|
result = await client.users_info(user=user_id)
|
|
user = result.get("user", {})
|
|
# Prefer display_name → real_name → user_id
|
|
profile = user.get("profile", {})
|
|
name = (
|
|
profile.get("display_name")
|
|
or profile.get("real_name")
|
|
or user.get("real_name")
|
|
or user.get("name")
|
|
or user_id
|
|
)
|
|
self._user_name_cache[user_id] = name
|
|
return name
|
|
except Exception as e:
|
|
logger.debug("[Slack] users.info failed for %s: %s", user_id, e)
|
|
self._user_name_cache[user_id] = user_id
|
|
return user_id
|
|
|
|
async def send_image_file(
|
|
self,
|
|
chat_id: str,
|
|
image_path: str,
|
|
caption: Optional[str] = None,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a local image file to Slack by uploading it."""
|
|
try:
|
|
return await self._upload_file(
|
|
chat_id, image_path, caption, reply_to, metadata
|
|
)
|
|
except FileNotFoundError:
|
|
return SendResult(
|
|
success=False, error=f"Image file not found: {image_path}"
|
|
)
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[%s] Failed to send local Slack image %s: %s",
|
|
self.name,
|
|
image_path,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
text = f"🖼️ Image: {image_path}"
|
|
if caption:
|
|
text = f"{caption}\n{text}"
|
|
return await self.send(chat_id, text, reply_to=reply_to, metadata=metadata)
|
|
|
|
async def send_image(
|
|
self,
|
|
chat_id: str,
|
|
image_url: str,
|
|
caption: Optional[str] = None,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send an image to Slack by uploading the URL as a file."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
from tools.url_safety import is_safe_url
|
|
|
|
if not is_safe_url(image_url):
|
|
logger.warning("[Slack] Blocked unsafe image URL (SSRF protection)")
|
|
return await super().send_image(
|
|
chat_id, image_url, caption, reply_to, metadata=metadata
|
|
)
|
|
|
|
try:
|
|
import httpx
|
|
|
|
async def _ssrf_redirect_guard(response):
|
|
"""Re-check redirect targets so public URLs cannot bounce into private IPs."""
|
|
if response.is_redirect and response.next_request:
|
|
redirect_url = str(response.next_request.url)
|
|
if not is_safe_url(redirect_url):
|
|
raise ValueError("Blocked redirect to private/internal address")
|
|
|
|
# Download the image first
|
|
async with httpx.AsyncClient(
|
|
timeout=30.0,
|
|
follow_redirects=True,
|
|
event_hooks={"response": [_ssrf_redirect_guard]},
|
|
) as client:
|
|
response = await client.get(image_url)
|
|
response.raise_for_status()
|
|
|
|
thread_ts = self._resolve_thread_ts(reply_to, metadata)
|
|
result = await self._get_client(chat_id).files_upload_v2(
|
|
channel=chat_id,
|
|
content=response.content,
|
|
filename="image.png",
|
|
initial_comment=caption or "",
|
|
thread_ts=thread_ts,
|
|
)
|
|
self._record_uploaded_file_thread(chat_id, thread_ts)
|
|
|
|
return SendResult(success=True, raw_response=result)
|
|
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.warning(
|
|
"[Slack] Failed to upload image from URL %s, falling back to text: %s",
|
|
safe_url_for_log(image_url),
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
# Fall back to sending the URL as text
|
|
text = f"{caption}\n{image_url}" if caption else image_url
|
|
return await self.send(
|
|
chat_id=chat_id,
|
|
content=text,
|
|
reply_to=reply_to,
|
|
metadata=metadata,
|
|
)
|
|
|
|
async def send_voice(
|
|
self,
|
|
chat_id: str,
|
|
audio_path: str,
|
|
caption: Optional[str] = None,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
**kwargs,
|
|
) -> SendResult:
|
|
"""Send an audio file to Slack."""
|
|
try:
|
|
return await self._upload_file(
|
|
chat_id, audio_path, caption, reply_to, metadata
|
|
)
|
|
except FileNotFoundError:
|
|
return SendResult(
|
|
success=False, error=f"Audio file not found: {audio_path}"
|
|
)
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[Slack] Failed to send audio file %s: %s",
|
|
audio_path,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
return SendResult(success=False, error=str(e))
|
|
|
|
async def send_video(
|
|
self,
|
|
chat_id: str,
|
|
video_path: str,
|
|
caption: Optional[str] = None,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a video file to Slack."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
if not os.path.exists(video_path):
|
|
return SendResult(
|
|
success=False, error=f"Video file not found: {video_path}"
|
|
)
|
|
|
|
try:
|
|
thread_ts = self._resolve_thread_ts(reply_to, metadata)
|
|
last_exc = None
|
|
for attempt in range(3):
|
|
try:
|
|
result = await self._get_client(chat_id).files_upload_v2(
|
|
channel=chat_id,
|
|
file=video_path,
|
|
filename=os.path.basename(video_path),
|
|
initial_comment=caption or "",
|
|
thread_ts=thread_ts,
|
|
)
|
|
self._record_uploaded_file_thread(chat_id, thread_ts)
|
|
return SendResult(success=True, raw_response=result)
|
|
except Exception as exc:
|
|
last_exc = exc
|
|
if not self._is_retryable_upload_error(exc) or attempt >= 2:
|
|
raise
|
|
logger.debug(
|
|
"[Slack] Video upload retry %d/2 for %s: %s",
|
|
attempt + 1,
|
|
video_path,
|
|
exc,
|
|
)
|
|
await asyncio.sleep(1.5 * (attempt + 1))
|
|
|
|
raise last_exc
|
|
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[%s] Failed to send video %s: %s",
|
|
self.name,
|
|
video_path,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
text = f"🎬 Video: {video_path}"
|
|
if caption:
|
|
text = f"{caption}\n{text}"
|
|
return await self.send(chat_id, text, reply_to=reply_to, metadata=metadata)
|
|
|
|
async def send_document(
|
|
self,
|
|
chat_id: str,
|
|
file_path: str,
|
|
caption: Optional[str] = None,
|
|
file_name: Optional[str] = None,
|
|
reply_to: Optional[str] = None,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a document/file attachment to Slack."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
if not os.path.exists(file_path):
|
|
return SendResult(success=False, error=f"File not found: {file_path}")
|
|
|
|
display_name = file_name or os.path.basename(file_path)
|
|
thread_ts = self._resolve_thread_ts(reply_to, metadata)
|
|
|
|
try:
|
|
last_exc = None
|
|
for attempt in range(3):
|
|
try:
|
|
result = await self._get_client(chat_id).files_upload_v2(
|
|
channel=chat_id,
|
|
file=file_path,
|
|
filename=display_name,
|
|
initial_comment=caption or "",
|
|
thread_ts=thread_ts,
|
|
)
|
|
self._record_uploaded_file_thread(chat_id, thread_ts)
|
|
return SendResult(success=True, raw_response=result)
|
|
except Exception as exc:
|
|
last_exc = exc
|
|
if not self._is_retryable_upload_error(exc) or attempt >= 2:
|
|
raise
|
|
logger.debug(
|
|
"[Slack] Document upload retry %d/2 for %s: %s",
|
|
attempt + 1,
|
|
file_path,
|
|
exc,
|
|
)
|
|
await asyncio.sleep(1.5 * (attempt + 1))
|
|
|
|
raise last_exc
|
|
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[%s] Failed to send document %s: %s",
|
|
self.name,
|
|
file_path,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
text = f"📎 File: {file_path}"
|
|
if caption:
|
|
text = f"{caption}\n{text}"
|
|
return await self.send(chat_id, text, reply_to=reply_to, metadata=metadata)
|
|
|
|
async def get_chat_info(self, chat_id: str) -> Dict[str, Any]:
|
|
"""Get information about a Slack channel."""
|
|
if not self._app:
|
|
return {"name": chat_id, "type": "unknown"}
|
|
|
|
try:
|
|
result = await self._get_client(chat_id).conversations_info(channel=chat_id)
|
|
channel = result.get("channel", {})
|
|
is_dm = channel.get("is_im", False)
|
|
return {
|
|
"name": channel.get("name", chat_id),
|
|
"type": "dm" if is_dm else "group",
|
|
}
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
logger.error(
|
|
"[Slack] Failed to fetch chat info for %s: %s",
|
|
chat_id,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
return {"name": chat_id, "type": "unknown"}
|
|
|
|
# ----- Internal handlers -----
|
|
|
|
def _assistant_thread_key(
|
|
self, channel_id: str, thread_ts: str
|
|
) -> Optional[Tuple[str, str]]:
|
|
"""Return a stable cache key for Slack assistant thread metadata."""
|
|
if not channel_id or not thread_ts:
|
|
return None
|
|
return (str(channel_id), str(thread_ts))
|
|
|
|
def _extract_assistant_thread_metadata(self, event: dict) -> Dict[str, str]:
|
|
"""Extract Slack Assistant thread identity data from an event payload."""
|
|
assistant_thread = event.get("assistant_thread") or {}
|
|
context = assistant_thread.get("context") or event.get("context") or {}
|
|
|
|
channel_id = (
|
|
assistant_thread.get("channel_id")
|
|
or event.get("channel")
|
|
or context.get("channel_id")
|
|
or ""
|
|
)
|
|
thread_ts = (
|
|
assistant_thread.get("thread_ts")
|
|
or event.get("thread_ts")
|
|
or event.get("message_ts")
|
|
or ""
|
|
)
|
|
user_id = (
|
|
assistant_thread.get("user_id")
|
|
or event.get("user")
|
|
or context.get("user_id")
|
|
or ""
|
|
)
|
|
team_id = (
|
|
event.get("team")
|
|
or event.get("team_id")
|
|
or assistant_thread.get("team_id")
|
|
or ""
|
|
)
|
|
context_channel_id = context.get("channel_id") or ""
|
|
|
|
return {
|
|
"channel_id": str(channel_id) if channel_id else "",
|
|
"thread_ts": str(thread_ts) if thread_ts else "",
|
|
"user_id": str(user_id) if user_id else "",
|
|
"team_id": str(team_id) if team_id else "",
|
|
"context_channel_id": str(context_channel_id) if context_channel_id else "",
|
|
}
|
|
|
|
def _cache_assistant_thread_metadata(self, metadata: Dict[str, str]) -> None:
|
|
"""Remember assistant thread identity data for later message events."""
|
|
channel_id = metadata.get("channel_id", "")
|
|
thread_ts = metadata.get("thread_ts", "")
|
|
key = self._assistant_thread_key(channel_id, thread_ts)
|
|
if not key:
|
|
return
|
|
|
|
existing = self._assistant_threads.get(key, {})
|
|
merged = dict(existing)
|
|
merged.update({k: v for k, v in metadata.items() if v})
|
|
self._assistant_threads[key] = merged
|
|
|
|
# Evict oldest entries when the cache exceeds the limit
|
|
if len(self._assistant_threads) > self._ASSISTANT_THREADS_MAX:
|
|
excess = len(self._assistant_threads) - self._ASSISTANT_THREADS_MAX // 2
|
|
for old_key in list(self._assistant_threads)[:excess]:
|
|
del self._assistant_threads[old_key]
|
|
|
|
team_id = merged.get("team_id", "")
|
|
if team_id and channel_id:
|
|
self._channel_team[channel_id] = team_id
|
|
|
|
def _lookup_assistant_thread_metadata(
|
|
self,
|
|
event: dict,
|
|
channel_id: str = "",
|
|
thread_ts: str = "",
|
|
) -> Dict[str, str]:
|
|
"""Load cached assistant-thread metadata that matches the current event."""
|
|
metadata = self._extract_assistant_thread_metadata(event)
|
|
if channel_id and not metadata.get("channel_id"):
|
|
metadata["channel_id"] = channel_id
|
|
if thread_ts and not metadata.get("thread_ts"):
|
|
metadata["thread_ts"] = thread_ts
|
|
|
|
key = self._assistant_thread_key(
|
|
metadata.get("channel_id", ""),
|
|
metadata.get("thread_ts", ""),
|
|
)
|
|
cached = self._assistant_threads.get(key, {}) if key else {}
|
|
if cached:
|
|
merged = dict(cached)
|
|
merged.update({k: v for k, v in metadata.items() if v})
|
|
return merged
|
|
return metadata
|
|
|
|
def _seed_assistant_thread_session(self, metadata: Dict[str, str]) -> None:
|
|
"""Prime the session store so assistant threads get stable user scoping."""
|
|
session_store = getattr(self, "_session_store", None)
|
|
if not session_store:
|
|
return
|
|
|
|
channel_id = metadata.get("channel_id", "")
|
|
thread_ts = metadata.get("thread_ts", "")
|
|
user_id = metadata.get("user_id", "")
|
|
if not channel_id or not thread_ts or not user_id:
|
|
return
|
|
|
|
source = self.build_source(
|
|
chat_id=channel_id,
|
|
chat_name=channel_id,
|
|
chat_type="dm",
|
|
user_id=user_id,
|
|
thread_id=thread_ts,
|
|
chat_topic=metadata.get("context_channel_id") or None,
|
|
)
|
|
|
|
try:
|
|
session_store.get_or_create_session(source)
|
|
except Exception:
|
|
logger.debug(
|
|
"[Slack] Failed to seed assistant thread session for %s/%s",
|
|
channel_id,
|
|
thread_ts,
|
|
exc_info=True,
|
|
)
|
|
|
|
async def _handle_assistant_thread_lifecycle_event(self, event: dict) -> None:
|
|
"""Handle Slack Assistant lifecycle events that carry user/thread identity."""
|
|
metadata = self._extract_assistant_thread_metadata(event)
|
|
self._cache_assistant_thread_metadata(metadata)
|
|
self._seed_assistant_thread_session(metadata)
|
|
|
|
async def _handle_slack_message(self, event: dict) -> None:
|
|
"""Handle an incoming Slack message event."""
|
|
# Dedup: Slack Socket Mode can redeliver events after reconnects (#4777)
|
|
event_ts = event.get("ts", "")
|
|
if event_ts and self._dedup.is_duplicate(event_ts):
|
|
return
|
|
|
|
# Bot message filtering (SLACK_ALLOW_BOTS / config allow_bots):
|
|
# "none" — ignore all bot messages (default, backward-compatible)
|
|
# "mentions" — accept bot messages only when they @mention us
|
|
# "all" — accept all bot messages (except our own)
|
|
if event.get("bot_id") or event.get("subtype") == "bot_message":
|
|
allow_bots = self.config.extra.get("allow_bots", "")
|
|
if not allow_bots:
|
|
allow_bots = os.getenv("SLACK_ALLOW_BOTS", "none")
|
|
allow_bots = str(allow_bots).lower().strip()
|
|
if allow_bots == "none":
|
|
return
|
|
elif allow_bots == "mentions":
|
|
text_check = event.get("text", "")
|
|
if self._bot_user_id and f"<@{self._bot_user_id}>" not in text_check:
|
|
return
|
|
# "all" falls through to process the message
|
|
# Always ignore our own messages to prevent echo loops
|
|
msg_user = event.get("user", "")
|
|
if msg_user and self._bot_user_id and msg_user == self._bot_user_id:
|
|
return
|
|
|
|
# Ignore message edits and deletions
|
|
subtype = event.get("subtype")
|
|
if subtype in {"message_changed", "message_deleted"}:
|
|
return
|
|
|
|
original_text = event.get("text", "")
|
|
|
|
# Slack blocks native slash commands inside threads ("/queue is not
|
|
# supported in threads. Sorry!"). As a workaround, recognise a
|
|
# leading ``!`` as an alternate command prefix and rewrite it to
|
|
# ``/`` so the rest of the pipeline (MessageType.COMMAND tagging,
|
|
# gateway dispatcher) handles it like a normal slash command. Only
|
|
# rewrite when the first token resolves to a known gateway command
|
|
# so casual messages like "!nice work" pass through unchanged.
|
|
if original_text.startswith("!"):
|
|
try:
|
|
from hermes_cli.commands import is_gateway_known_command
|
|
|
|
first_token = original_text[1:].split(maxsplit=1)[0]
|
|
# Strip "@suffix" the same way get_command() does, so
|
|
# forms like ``!stop@hermes`` still resolve.
|
|
cmd_name = first_token.split("@", 1)[0].lower()
|
|
if (
|
|
cmd_name
|
|
and "/" not in cmd_name
|
|
and is_gateway_known_command(cmd_name)
|
|
):
|
|
original_text = "/" + original_text[1:]
|
|
except Exception: # pragma: no cover - defensive
|
|
pass
|
|
|
|
text = original_text
|
|
|
|
# Extract quoted/forwarded content from Slack blocks.
|
|
# Slack's modern composer embeds forwarded messages in the ``blocks``
|
|
# array as ``rich_text_quote`` elements, which are NOT reflected in
|
|
# the plain ``text`` field. Merge block text so the agent sees the
|
|
# full message content.
|
|
blocks = event.get("blocks")
|
|
if blocks:
|
|
blocks_text = _extract_text_from_slack_blocks(blocks)
|
|
if blocks_text:
|
|
# Only append if the blocks contain text not already present
|
|
# in the plain text field (avoids duplication).
|
|
stripped_blocks = blocks_text.strip()
|
|
if stripped_blocks and stripped_blocks not in text.strip():
|
|
logger.debug(
|
|
"Slack: extracted additional text from blocks "
|
|
"(likely quoted/forwarded content): %s",
|
|
stripped_blocks[:300],
|
|
)
|
|
text = (text.strip() + "\n" + stripped_blocks).strip()
|
|
|
|
blocks_payload = _serialize_slack_blocks_for_agent(blocks)
|
|
if blocks_payload:
|
|
text = (text.strip() + "\n\n" + blocks_payload).strip()
|
|
|
|
# Extract link unfurls / rich attachments (e.g. Notion previews).
|
|
# Slack places unfurled link previews in the ``attachments`` array with
|
|
# fields like title, title_link/from_url, text, footer, and fallback.
|
|
# Without reading these, the agent never sees shared link previews.
|
|
slack_attachments = event.get("attachments") or []
|
|
if slack_attachments:
|
|
att_parts: list[str] = []
|
|
for att in slack_attachments:
|
|
att_title = att.get("title", "")
|
|
att_url = att.get("title_link", "") or att.get("from_url", "")
|
|
att_text = att.get("text", "")
|
|
att_footer = att.get("footer", "")
|
|
att_fallback = att.get("fallback", "")
|
|
|
|
# Skip message-type attachments (e.g. Slack bot messages with
|
|
# is_msg_unfurl) to avoid echoing our own content.
|
|
if att.get("is_msg_unfurl"):
|
|
continue
|
|
|
|
# Build a readable representation.
|
|
if att_title and att_url:
|
|
header = f"📎 [{att_title}]({att_url})"
|
|
elif att_title:
|
|
header = f"📎 {att_title}"
|
|
elif att_url:
|
|
header = f"📎 {att_url}"
|
|
else:
|
|
header = None
|
|
|
|
# Prefer preview text, fall back to fallback description.
|
|
body = att_text or att_fallback or ""
|
|
if body:
|
|
body = body.strip()
|
|
if len(body) > 500:
|
|
body = body[:497] + "..."
|
|
|
|
if header and body:
|
|
section = f"{header}\n {body}"
|
|
elif header:
|
|
section = header
|
|
elif body:
|
|
section = f"📎 {body}"
|
|
else:
|
|
continue
|
|
|
|
# Deduplicate only when the fully rendered section is already
|
|
# present. The shared URL often already appears in the user's
|
|
# message text, and skipping on URL/title alone would hide the
|
|
# preview body we actually want the agent to see.
|
|
if section in text:
|
|
continue
|
|
|
|
if att_footer:
|
|
section = f"{section}\n _{att_footer}_"
|
|
|
|
att_parts.append(section)
|
|
|
|
if att_parts:
|
|
attachment_text = "\n\n".join(att_parts)
|
|
text = (text.strip() + "\n\n" + attachment_text).strip()
|
|
logger.debug(
|
|
"Slack: appended %d link unfurl(s) to message text",
|
|
len(att_parts),
|
|
)
|
|
|
|
channel_id = event.get("channel", "")
|
|
ts = event.get("ts", "")
|
|
assistant_meta = self._lookup_assistant_thread_metadata(
|
|
event,
|
|
channel_id=channel_id,
|
|
thread_ts=event.get("thread_ts", ""),
|
|
)
|
|
user_id = event.get("user") or assistant_meta.get("user_id", "")
|
|
if not channel_id:
|
|
channel_id = assistant_meta.get("channel_id", "")
|
|
team_id = (
|
|
event.get("team")
|
|
or event.get("team_id")
|
|
or assistant_meta.get("team_id", "")
|
|
)
|
|
|
|
# Track which workspace owns this channel
|
|
if team_id and channel_id:
|
|
self._channel_team[channel_id] = team_id
|
|
|
|
# Determine if this is a DM or channel message
|
|
channel_type = event.get("channel_type", "")
|
|
if not channel_type and channel_id.startswith("D"):
|
|
channel_type = "im"
|
|
is_dm = channel_type in {"im", "mpim"} # Both 1:1 and group DMs
|
|
|
|
# Build thread_ts for session keying.
|
|
# In channels: fall back to ts so each top-level @mention starts a
|
|
# new thread/session (the bot always replies in a thread).
|
|
# In DMs: fall back to ts so each top-level DM reply thread gets
|
|
# its own session key (matching channel behavior). Set
|
|
# dm_top_level_threads_as_sessions: false in config to revert to
|
|
# legacy single-session-per-DM-channel behavior.
|
|
if is_dm:
|
|
thread_ts = event.get("thread_ts") or assistant_meta.get("thread_ts")
|
|
if not thread_ts and self._dm_top_level_threads_as_sessions():
|
|
thread_ts = ts
|
|
else:
|
|
thread_ts = event.get("thread_ts") or ts # ts fallback for channels
|
|
|
|
# In channels, respond if:
|
|
# 0. Channel is in free_response_channels, OR require_mention is
|
|
# disabled — always process regardless of mention.
|
|
# 1. The bot is @mentioned in this message, OR
|
|
# 2. The message is a reply in a thread the bot started/participated in, OR
|
|
# 3. The message is in a thread where the bot was previously @mentioned, OR
|
|
# 4. There's an existing session for this thread (survives restarts)
|
|
bot_uid = self._team_bot_user_ids.get(team_id, self._bot_user_id)
|
|
routing_text = original_text or ""
|
|
is_mentioned = bot_uid and f"<@{bot_uid}>" in routing_text
|
|
event_thread_ts = event.get("thread_ts")
|
|
is_thread_reply = bool(event_thread_ts and event_thread_ts != ts)
|
|
|
|
if not is_dm and bot_uid:
|
|
# Check allowed channels — if set, only respond in these channels (whitelist)
|
|
allowed_channels = self._slack_allowed_channels()
|
|
if allowed_channels and channel_id not in allowed_channels:
|
|
logger.debug(
|
|
"[Slack] Ignoring message in non-allowed channel: %s", channel_id
|
|
)
|
|
return
|
|
|
|
if channel_id in self._slack_free_response_channels():
|
|
pass # Free-response channel — always process
|
|
elif not self._slack_require_mention():
|
|
pass # Mention requirement disabled globally for Slack
|
|
elif self._slack_strict_mention() and not is_mentioned:
|
|
return # Strict mode: ignore until @-mentioned again
|
|
elif not is_mentioned:
|
|
reply_to_bot_thread = (
|
|
is_thread_reply and event_thread_ts in self._bot_message_ts
|
|
)
|
|
in_mentioned_thread = (
|
|
event_thread_ts is not None
|
|
and event_thread_ts in self._mentioned_threads
|
|
)
|
|
has_session = is_thread_reply and self._has_active_session_for_thread(
|
|
channel_id=channel_id,
|
|
thread_ts=event_thread_ts,
|
|
user_id=user_id,
|
|
)
|
|
if (
|
|
not reply_to_bot_thread
|
|
and not in_mentioned_thread
|
|
and not has_session
|
|
):
|
|
return
|
|
|
|
if is_mentioned:
|
|
# Strip the bot mention from the text
|
|
text = text.replace(f"<@{bot_uid}>", "").strip()
|
|
# Register this thread so all future messages auto-trigger the bot.
|
|
# Skipped in strict mode: strict_mention=true bots must be
|
|
# re-mentioned every turn, so remembering the thread would
|
|
# defeat the feature (and re-enable agent-to-agent ack loops).
|
|
if event_thread_ts and not self._slack_strict_mention():
|
|
self._mentioned_threads.add(event_thread_ts)
|
|
if len(self._mentioned_threads) > self._MENTIONED_THREADS_MAX:
|
|
to_remove = list(self._mentioned_threads)[
|
|
: self._MENTIONED_THREADS_MAX // 2
|
|
]
|
|
for t in to_remove:
|
|
self._mentioned_threads.discard(t)
|
|
|
|
# When entering a thread for the first time (no existing session),
|
|
# fetch thread context so the agent understands the conversation.
|
|
if is_thread_reply and not self._has_active_session_for_thread(
|
|
channel_id=channel_id,
|
|
thread_ts=event_thread_ts,
|
|
user_id=user_id,
|
|
):
|
|
thread_context = await self._fetch_thread_context(
|
|
channel_id=channel_id,
|
|
thread_ts=event_thread_ts,
|
|
current_ts=ts,
|
|
team_id=team_id,
|
|
)
|
|
if thread_context:
|
|
text = thread_context + text
|
|
|
|
# Determine message type
|
|
msg_type = MessageType.TEXT
|
|
if (original_text or "").startswith("/"):
|
|
msg_type = MessageType.COMMAND
|
|
|
|
# Handle file attachments
|
|
media_urls = []
|
|
media_types = []
|
|
attachment_notices: List[str] = []
|
|
files = event.get("files", [])
|
|
for f in files:
|
|
# Slack Connect channels return stub file objects with
|
|
# file_access="check_file_info" and no URL fields. We must
|
|
# call files.info to retrieve the full object (including url_private_download)
|
|
# before we can download it.
|
|
# https://docs.slack.dev/reference/objects/file-object/#slack_connect_files
|
|
if f.get("file_access") == "check_file_info":
|
|
file_id = f.get("id")
|
|
if not file_id:
|
|
continue
|
|
try:
|
|
info_resp = await self._get_client(channel_id).files_info(
|
|
file=file_id
|
|
)
|
|
if info_resp.get("ok"):
|
|
f = info_resp["file"]
|
|
else:
|
|
detail = self._describe_slack_api_error(info_resp, file_obj=f)
|
|
if detail:
|
|
attachment_notices.append(detail)
|
|
logger.warning("[Slack] %s", detail)
|
|
else:
|
|
logger.warning(
|
|
"[Slack] files.info failed for %s: %s",
|
|
file_id,
|
|
info_resp.get("error"),
|
|
)
|
|
continue
|
|
except Exception as e:
|
|
response = getattr(e, "response", None)
|
|
detail = self._describe_slack_api_error(response, file_obj=f)
|
|
if detail:
|
|
attachment_notices.append(detail)
|
|
logger.warning("[Slack] %s", detail)
|
|
else:
|
|
logger.warning(
|
|
"[Slack] files.info error for %s: %s",
|
|
file_id,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
continue
|
|
|
|
mimetype = f.get("mimetype", "unknown")
|
|
url = f.get("url_private_download") or f.get("url_private", "")
|
|
if mimetype.startswith("image/") and url:
|
|
try:
|
|
ext = "." + mimetype.split("/")[-1].split(";")[0]
|
|
if ext not in {".jpg", ".jpeg", ".png", ".gif", ".webp"}:
|
|
ext = ".jpg"
|
|
# Slack private URLs require the bot token as auth header
|
|
cached = await self._download_slack_file(url, ext, team_id=team_id)
|
|
media_urls.append(cached)
|
|
media_types.append(mimetype)
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
detail = self._describe_slack_download_failure(e, file_obj=f)
|
|
if detail:
|
|
attachment_notices.append(detail)
|
|
logger.warning("[Slack] %s", detail)
|
|
else:
|
|
logger.warning(
|
|
"[Slack] Failed to cache image from %s: %s",
|
|
url,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
elif mimetype.startswith("audio/") and url:
|
|
try:
|
|
ext = "." + mimetype.split("/")[-1].split(";")[0]
|
|
if ext not in {".ogg", ".mp3", ".wav", ".webm", ".m4a"}:
|
|
ext = ".ogg"
|
|
cached = await self._download_slack_file(
|
|
url, ext, audio=True, team_id=team_id
|
|
)
|
|
media_urls.append(cached)
|
|
media_types.append(mimetype)
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
detail = self._describe_slack_download_failure(e, file_obj=f)
|
|
if detail:
|
|
attachment_notices.append(detail)
|
|
logger.warning("[Slack] %s", detail)
|
|
else:
|
|
logger.warning(
|
|
"[Slack] Failed to cache audio from %s: %s",
|
|
url,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
elif url:
|
|
# Try to handle as a document attachment
|
|
try:
|
|
original_filename = f.get("name", "")
|
|
ext = ""
|
|
if original_filename:
|
|
_, ext = os.path.splitext(original_filename)
|
|
ext = ext.lower()
|
|
|
|
# Fallback: reverse-lookup from MIME type
|
|
if not ext and mimetype:
|
|
mime_to_ext = {
|
|
v: k for k, v in SUPPORTED_DOCUMENT_TYPES.items()
|
|
}
|
|
ext = mime_to_ext.get(mimetype, "")
|
|
|
|
if ext not in SUPPORTED_DOCUMENT_TYPES:
|
|
continue # Skip unsupported file types silently
|
|
|
|
# Check file size (Slack limit: 20 MB for bots)
|
|
file_size = f.get("size", 0)
|
|
MAX_DOC_BYTES = 20 * 1024 * 1024
|
|
if not file_size or file_size > MAX_DOC_BYTES:
|
|
logger.warning(
|
|
"[Slack] Document too large or unknown size: %s", file_size
|
|
)
|
|
continue
|
|
|
|
# Download and cache
|
|
raw_bytes = await self._download_slack_file_bytes(
|
|
url, team_id=team_id
|
|
)
|
|
cached_path = cache_document_from_bytes(
|
|
raw_bytes, original_filename or f"document{ext}"
|
|
)
|
|
doc_mime = SUPPORTED_DOCUMENT_TYPES[ext]
|
|
media_urls.append(cached_path)
|
|
media_types.append(doc_mime)
|
|
logger.debug("[Slack] Cached user document: %s", cached_path)
|
|
|
|
# Inject small text-ish files directly into the prompt so
|
|
# snippets like JSON/YAML/configs are actually visible to the agent.
|
|
MAX_TEXT_INJECT_BYTES = 100 * 1024
|
|
TEXT_INJECT_EXTENSIONS = {
|
|
".md",
|
|
".txt",
|
|
".csv",
|
|
".log",
|
|
".json",
|
|
".xml",
|
|
".yaml",
|
|
".yml",
|
|
".toml",
|
|
".ini",
|
|
".cfg",
|
|
}
|
|
if (
|
|
ext in TEXT_INJECT_EXTENSIONS
|
|
and len(raw_bytes) <= MAX_TEXT_INJECT_BYTES
|
|
):
|
|
try:
|
|
text_content = raw_bytes.decode("utf-8")
|
|
display_name = original_filename or f"document{ext}"
|
|
display_name = re.sub(r"[^\w.\- ]", "_", display_name)
|
|
injection = f"[Content of {display_name}]:\n{text_content}"
|
|
if text:
|
|
text = f"{injection}\n\n{text}"
|
|
else:
|
|
text = injection
|
|
except UnicodeDecodeError:
|
|
pass # Binary content, skip injection
|
|
|
|
except Exception as e: # pragma: no cover - defensive logging
|
|
detail = self._describe_slack_download_failure(e, file_obj=f)
|
|
if detail:
|
|
attachment_notices.append(detail)
|
|
logger.warning("[Slack] %s", detail)
|
|
else:
|
|
logger.warning(
|
|
"[Slack] Failed to cache document from %s: %s",
|
|
url,
|
|
e,
|
|
exc_info=True,
|
|
)
|
|
|
|
if attachment_notices:
|
|
notice_block = "[Slack attachment notice]\n" + "\n".join(
|
|
f"- {n}" for n in attachment_notices
|
|
)
|
|
text = f"{notice_block}\n\n{text}" if text else notice_block
|
|
|
|
if msg_type != MessageType.COMMAND and media_types:
|
|
if any(m.startswith("image/") for m in media_types):
|
|
msg_type = MessageType.PHOTO
|
|
elif any(m.startswith("audio/") for m in media_types):
|
|
msg_type = MessageType.VOICE
|
|
else:
|
|
msg_type = MessageType.DOCUMENT
|
|
|
|
# Resolve user display name (cached after first lookup)
|
|
user_name = await self._resolve_user_name(user_id, chat_id=channel_id)
|
|
|
|
# Build source
|
|
source = self.build_source(
|
|
chat_id=channel_id,
|
|
chat_name=channel_id, # Will be resolved later if needed
|
|
chat_type="dm" if is_dm else "group",
|
|
user_id=user_id,
|
|
user_name=user_name,
|
|
thread_id=thread_ts,
|
|
)
|
|
|
|
# Per-channel ephemeral prompt
|
|
from gateway.platforms.base import (
|
|
resolve_channel_prompt,
|
|
resolve_channel_skills,
|
|
)
|
|
|
|
_channel_prompt = resolve_channel_prompt(
|
|
self.config.extra,
|
|
channel_id,
|
|
None,
|
|
)
|
|
_auto_skill = resolve_channel_skills(
|
|
self.config.extra,
|
|
channel_id,
|
|
None,
|
|
)
|
|
|
|
# Extract reply context if this message is a thread reply.
|
|
# Mirrors the Telegram/Discord implementations so that gateway.run
|
|
# can inject a `[Replying to: "..."]` prefix when the parent is not
|
|
# already in the session history. Uses the thread-context cache when
|
|
# available to avoid redundant conversations.replies calls.
|
|
reply_to_text = None
|
|
if thread_ts and thread_ts != ts:
|
|
try:
|
|
reply_to_text = (
|
|
await self._fetch_thread_parent_text(
|
|
channel_id=channel_id,
|
|
thread_ts=thread_ts,
|
|
team_id=team_id,
|
|
)
|
|
or None
|
|
)
|
|
except Exception: # pragma: no cover - defensive
|
|
reply_to_text = None
|
|
|
|
msg_event = MessageEvent(
|
|
text=text,
|
|
message_type=msg_type,
|
|
source=source,
|
|
raw_message=event,
|
|
message_id=ts,
|
|
media_urls=media_urls,
|
|
media_types=media_types,
|
|
reply_to_message_id=thread_ts if thread_ts != ts else None,
|
|
channel_prompt=_channel_prompt,
|
|
reply_to_text=reply_to_text,
|
|
auto_skill=_auto_skill,
|
|
)
|
|
|
|
# Only react when bot is directly addressed (DM or @mention).
|
|
# In listen-all channels (require_mention=false), reacting to every
|
|
# casual message would be noisy.
|
|
_should_react = (is_dm or is_mentioned) and self._reactions_enabled()
|
|
if _should_react:
|
|
self._reacting_message_ids.add(ts)
|
|
|
|
await self.handle_message(msg_event)
|
|
|
|
# ----- Approval button support (Block Kit) -----
|
|
|
|
async def send_exec_approval(
|
|
self,
|
|
chat_id: str,
|
|
command: str,
|
|
session_key: str,
|
|
description: str = "dangerous command",
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a Block Kit approval prompt with interactive buttons.
|
|
|
|
The buttons call ``resolve_gateway_approval()`` to unblock the waiting
|
|
agent thread — same mechanism as the text ``/approve`` flow.
|
|
"""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
try:
|
|
cmd_preview = command[:2900] + "..." if len(command) > 2900 else command
|
|
thread_ts = self._resolve_thread_ts(None, metadata)
|
|
|
|
blocks = [
|
|
{
|
|
"type": "section",
|
|
"text": {
|
|
"type": "mrkdwn",
|
|
"text": (
|
|
f":warning: *Command Approval Required*\n"
|
|
f"```{cmd_preview}```\n"
|
|
f"Reason: {description}"
|
|
),
|
|
},
|
|
},
|
|
{
|
|
"type": "actions",
|
|
"elements": [
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Allow Once"},
|
|
"style": "primary",
|
|
"action_id": "hermes_approve_once",
|
|
"value": session_key,
|
|
},
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Allow Session"},
|
|
"action_id": "hermes_approve_session",
|
|
"value": session_key,
|
|
},
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Always Allow"},
|
|
"action_id": "hermes_approve_always",
|
|
"value": session_key,
|
|
},
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Deny"},
|
|
"style": "danger",
|
|
"action_id": "hermes_deny",
|
|
"value": session_key,
|
|
},
|
|
],
|
|
},
|
|
]
|
|
|
|
kwargs: Dict[str, Any] = {
|
|
"channel": chat_id,
|
|
"text": f"⚠️ Command approval required: {cmd_preview[:100]}",
|
|
"blocks": blocks,
|
|
}
|
|
if thread_ts:
|
|
kwargs["thread_ts"] = thread_ts
|
|
|
|
result = await self._get_client(chat_id).chat_postMessage(**kwargs)
|
|
msg_ts = result.get("ts", "")
|
|
if msg_ts:
|
|
self._approval_resolved[msg_ts] = False
|
|
|
|
return SendResult(success=True, message_id=msg_ts, raw_response=result)
|
|
except Exception as e:
|
|
logger.error("[Slack] send_exec_approval failed: %s", e, exc_info=True)
|
|
return SendResult(success=False, error=str(e))
|
|
|
|
async def send_slash_confirm(
|
|
self,
|
|
chat_id: str,
|
|
title: str,
|
|
message: str,
|
|
session_key: str,
|
|
confirm_id: str,
|
|
metadata: Optional[Dict[str, Any]] = None,
|
|
) -> SendResult:
|
|
"""Send a Block Kit three-option slash-command confirmation prompt."""
|
|
if not self._app:
|
|
return SendResult(success=False, error="Not connected")
|
|
|
|
try:
|
|
body = message[:2900] + "..." if len(message) > 2900 else message
|
|
thread_ts = self._resolve_thread_ts(None, metadata)
|
|
# Encode session_key and confirm_id into the button value so the
|
|
# callback handler can resolve without extra bookkeeping.
|
|
value = f"{session_key}|{confirm_id}"
|
|
|
|
blocks = [
|
|
{
|
|
"type": "section",
|
|
"text": {
|
|
"type": "mrkdwn",
|
|
"text": f"*{title or 'Confirm'}*\n\n{body}",
|
|
},
|
|
},
|
|
{
|
|
"type": "actions",
|
|
"elements": [
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Approve Once"},
|
|
"style": "primary",
|
|
"action_id": "hermes_confirm_once",
|
|
"value": value,
|
|
},
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Always Approve"},
|
|
"action_id": "hermes_confirm_always",
|
|
"value": value,
|
|
},
|
|
{
|
|
"type": "button",
|
|
"text": {"type": "plain_text", "text": "Cancel"},
|
|
"style": "danger",
|
|
"action_id": "hermes_confirm_cancel",
|
|
"value": value,
|
|
},
|
|
],
|
|
},
|
|
]
|
|
|
|
kwargs: Dict[str, Any] = {
|
|
"channel": chat_id,
|
|
"text": f"{title or 'Confirm'}: {body[:100]}",
|
|
"blocks": blocks,
|
|
}
|
|
if thread_ts:
|
|
kwargs["thread_ts"] = thread_ts
|
|
|
|
result = await self._get_client(chat_id).chat_postMessage(**kwargs)
|
|
return SendResult(
|
|
success=True, message_id=result.get("ts", ""), raw_response=result
|
|
)
|
|
except Exception as e:
|
|
logger.error("[Slack] send_slash_confirm failed: %s", e, exc_info=True)
|
|
return SendResult(success=False, error=str(e))
|
|
|
|
async def _handle_slash_confirm_action(self, ack, body, action) -> None:
|
|
"""Handle a slash-confirm button click from Block Kit."""
|
|
await ack()
|
|
|
|
action_id = action.get("action_id", "")
|
|
value = action.get("value", "")
|
|
message = body.get("message", {})
|
|
msg_ts = message.get("ts", "")
|
|
channel_id = body.get("channel", {}).get("id", "")
|
|
user_name = body.get("user", {}).get("name", "unknown")
|
|
user_id = body.get("user", {}).get("id", "")
|
|
|
|
# Authorization — reuse the exec-approval allowlist.
|
|
allowed_csv = os.getenv("SLACK_ALLOWED_USERS", "").strip()
|
|
if allowed_csv:
|
|
allowed_ids = {uid.strip() for uid in allowed_csv.split(",") if uid.strip()}
|
|
if "*" not in allowed_ids and user_id not in allowed_ids:
|
|
logger.warning(
|
|
"[Slack] Unauthorized slash-confirm click by %s (%s) — ignoring",
|
|
user_name,
|
|
user_id,
|
|
)
|
|
return
|
|
|
|
# Parse session_key|confirm_id back out
|
|
if "|" not in value:
|
|
logger.warning("[Slack] Malformed slash-confirm value: %s", value)
|
|
return
|
|
session_key, confirm_id = value.split("|", 1)
|
|
|
|
choice_map = {
|
|
"hermes_confirm_once": "once",
|
|
"hermes_confirm_always": "always",
|
|
"hermes_confirm_cancel": "cancel",
|
|
}
|
|
choice = choice_map.get(action_id, "cancel")
|
|
|
|
label_map = {
|
|
"once": f"✅ Approved once by {user_name}",
|
|
"always": f"🔒 Always approved by {user_name}",
|
|
"cancel": f"❌ Cancelled by {user_name}",
|
|
}
|
|
decision_text = label_map.get(choice, f"Resolved by {user_name}")
|
|
|
|
# Pull original prompt body out of the section block so we can show
|
|
# the decision inline without losing context.
|
|
original_text = ""
|
|
for block in message.get("blocks", []):
|
|
if block.get("type") == "section":
|
|
original_text = block.get("text", {}).get("text", "")
|
|
break
|
|
|
|
updated_blocks = [
|
|
{
|
|
"type": "section",
|
|
"text": {
|
|
"type": "mrkdwn",
|
|
"text": original_text or "Confirmation prompt",
|
|
},
|
|
},
|
|
{
|
|
"type": "context",
|
|
"elements": [
|
|
{"type": "mrkdwn", "text": decision_text},
|
|
],
|
|
},
|
|
]
|
|
|
|
try:
|
|
await self._get_client(channel_id).chat_update(
|
|
channel=channel_id,
|
|
ts=msg_ts,
|
|
text=decision_text,
|
|
blocks=updated_blocks,
|
|
)
|
|
except Exception as e:
|
|
logger.warning("[Slack] Failed to update slash-confirm message: %s", e)
|
|
|
|
# Resolve via the module-level primitive and post any follow-up.
|
|
try:
|
|
from tools import slash_confirm as _slash_confirm_mod
|
|
|
|
result_text = await _slash_confirm_mod.resolve(
|
|
session_key, confirm_id, choice
|
|
)
|
|
if result_text:
|
|
post_kwargs: Dict[str, Any] = {
|
|
"channel": channel_id,
|
|
"text": result_text,
|
|
}
|
|
# Inherit the thread so the reply stays in the same place.
|
|
thread_ts = message.get("thread_ts") or msg_ts
|
|
if thread_ts:
|
|
post_kwargs["thread_ts"] = thread_ts
|
|
await self._get_client(channel_id).chat_postMessage(**post_kwargs)
|
|
logger.info(
|
|
"Slack button resolved slash-confirm for session %s (choice=%s, user=%s)",
|
|
session_key,
|
|
choice,
|
|
user_name,
|
|
)
|
|
except Exception as exc:
|
|
logger.error(
|
|
"Failed to resolve slash-confirm from Slack button: %s",
|
|
exc,
|
|
exc_info=True,
|
|
)
|
|
|
|
async def _handle_approval_action(self, ack, body, action) -> None:
|
|
"""Handle an approval button click from Block Kit."""
|
|
await ack()
|
|
|
|
action_id = action.get("action_id", "")
|
|
session_key = action.get("value", "")
|
|
message = body.get("message", {})
|
|
msg_ts = message.get("ts", "")
|
|
channel_id = body.get("channel", {}).get("id", "")
|
|
user_name = body.get("user", {}).get("name", "unknown")
|
|
user_id = body.get("user", {}).get("id", "")
|
|
|
|
# Only authorized users may click approval buttons. Button clicks
|
|
# bypass the normal message auth flow in gateway/run.py, so we must
|
|
# check here as well.
|
|
allowed_csv = os.getenv("SLACK_ALLOWED_USERS", "").strip()
|
|
if allowed_csv:
|
|
allowed_ids = {uid.strip() for uid in allowed_csv.split(",") if uid.strip()}
|
|
if "*" not in allowed_ids and user_id not in allowed_ids:
|
|
logger.warning(
|
|
"[Slack] Unauthorized approval click by %s (%s) — ignoring",
|
|
user_name,
|
|
user_id,
|
|
)
|
|
return
|
|
|
|
# Map action_id to approval choice
|
|
choice_map = {
|
|
"hermes_approve_once": "once",
|
|
"hermes_approve_session": "session",
|
|
"hermes_approve_always": "always",
|
|
"hermes_deny": "deny",
|
|
}
|
|
choice = choice_map.get(action_id, "deny")
|
|
|
|
# Prevent double-clicks — atomic pop; first caller gets False, others get True (default)
|
|
if self._approval_resolved.pop(msg_ts, True):
|
|
return
|
|
|
|
# Update the message to show the decision and remove buttons
|
|
label_map = {
|
|
"once": f"✅ Approved once by {user_name}",
|
|
"session": f"✅ Approved for session by {user_name}",
|
|
"always": f"✅ Approved permanently by {user_name}",
|
|
"deny": f"❌ Denied by {user_name}",
|
|
}
|
|
decision_text = label_map.get(choice, f"Resolved by {user_name}")
|
|
|
|
# Get original text from the section block
|
|
original_text = ""
|
|
for block in message.get("blocks", []):
|
|
if block.get("type") == "section":
|
|
original_text = block.get("text", {}).get("text", "")
|
|
break
|
|
|
|
updated_blocks = [
|
|
{
|
|
"type": "section",
|
|
"text": {
|
|
"type": "mrkdwn",
|
|
"text": original_text or "Command approval request",
|
|
},
|
|
},
|
|
{
|
|
"type": "context",
|
|
"elements": [
|
|
{"type": "mrkdwn", "text": decision_text},
|
|
],
|
|
},
|
|
]
|
|
|
|
try:
|
|
await self._get_client(channel_id).chat_update(
|
|
channel=channel_id,
|
|
ts=msg_ts,
|
|
text=decision_text,
|
|
blocks=updated_blocks,
|
|
)
|
|
except Exception as e:
|
|
logger.warning("[Slack] Failed to update approval message: %s", e)
|
|
|
|
# Resolve the approval — this unblocks the agent thread
|
|
try:
|
|
from tools.approval import resolve_gateway_approval
|
|
|
|
count = resolve_gateway_approval(session_key, choice)
|
|
logger.info(
|
|
"Slack button resolved %d approval(s) for session %s (choice=%s, user=%s)",
|
|
count,
|
|
session_key,
|
|
choice,
|
|
user_name,
|
|
)
|
|
except Exception as exc:
|
|
logger.error(
|
|
"Failed to resolve gateway approval from Slack button: %s", exc
|
|
)
|
|
|
|
# (approval state already consumed by atomic pop above)
|
|
|
|
# ----- Thread context fetching -----
|
|
|
|
async def _fetch_thread_context(
|
|
self,
|
|
channel_id: str,
|
|
thread_ts: str,
|
|
current_ts: str,
|
|
team_id: str = "",
|
|
limit: int = 30,
|
|
) -> str:
|
|
"""Fetch recent thread messages to provide context when the bot is
|
|
mentioned mid-thread for the first time.
|
|
|
|
This method is only called when there is NO active session for the
|
|
thread (guarded at the call site by _has_active_session_for_thread).
|
|
That guard ensures thread messages are prepended only on the very
|
|
first turn — after that the session history already holds them, so
|
|
there is no duplication across subsequent turns.
|
|
|
|
Results are cached for _THREAD_CACHE_TTL seconds per thread to avoid
|
|
hammering conversations.replies (Tier 3, ~50 req/min).
|
|
|
|
Returns a formatted string with prior thread history, or empty string
|
|
on failure or if the thread has no prior messages.
|
|
"""
|
|
cache_key = f"{channel_id}:{thread_ts}:{team_id}"
|
|
now = time.monotonic()
|
|
cached = self._thread_context_cache.get(cache_key)
|
|
if cached and (now - cached.fetched_at) < self._THREAD_CACHE_TTL:
|
|
return cached.content
|
|
|
|
try:
|
|
client = self._get_client(channel_id)
|
|
|
|
# Retry with exponential backoff for Tier-3 rate limits (429).
|
|
result = None
|
|
for attempt in range(3):
|
|
try:
|
|
result = await client.conversations_replies(
|
|
channel=channel_id,
|
|
ts=thread_ts,
|
|
limit=limit + 1, # +1 because it includes the current message
|
|
inclusive=True,
|
|
)
|
|
break
|
|
except Exception as exc:
|
|
# Check for rate-limit error from slack_sdk
|
|
err_str = str(exc).lower()
|
|
is_rate_limit = (
|
|
"ratelimited" in err_str
|
|
or "429" in err_str
|
|
or "rate_limited" in err_str
|
|
)
|
|
if is_rate_limit and attempt < 2:
|
|
retry_after = 1.0 * (2**attempt) # 1s, 2s
|
|
logger.warning(
|
|
"[Slack] conversations.replies rate limited; retrying in %.1fs (attempt %d/3)",
|
|
retry_after,
|
|
attempt + 1,
|
|
)
|
|
await asyncio.sleep(retry_after)
|
|
continue
|
|
raise
|
|
|
|
if result is None:
|
|
return ""
|
|
|
|
messages = result.get("messages", [])
|
|
if not messages:
|
|
return ""
|
|
|
|
bot_uid = self._team_bot_user_ids.get(team_id, self._bot_user_id)
|
|
context_parts = []
|
|
parent_text = ""
|
|
for msg in messages:
|
|
msg_ts = msg.get("ts", "")
|
|
# Exclude the current triggering message — it will be delivered
|
|
# as the user message itself, so including it here would duplicate it.
|
|
if msg_ts == current_ts:
|
|
continue
|
|
|
|
is_parent = msg_ts == thread_ts
|
|
is_bot = bool(msg.get("bot_id")) or msg.get("subtype") == "bot_message"
|
|
msg_user = msg.get("user", "")
|
|
|
|
# Identify "our own" bot for this workspace (multi-workspace safe).
|
|
msg_team = msg.get("team") or team_id
|
|
self_bot_uid = (
|
|
self._team_bot_user_ids.get(msg_team) if msg_team else None
|
|
) or self._bot_user_id
|
|
|
|
# Exclude only our own prior bot replies (circular context).
|
|
# Keep:
|
|
# - the thread parent even if it was posted by a bot
|
|
# (e.g. a cron job summary we are now replying to);
|
|
# - other bots' child messages (useful third-party context).
|
|
if (
|
|
is_bot
|
|
and not is_parent
|
|
and self_bot_uid
|
|
and msg_user == self_bot_uid
|
|
):
|
|
continue
|
|
|
|
msg_text = msg.get("text", "").strip()
|
|
if not msg_text:
|
|
continue
|
|
|
|
# Strip bot mentions from context messages
|
|
if bot_uid:
|
|
msg_text = msg_text.replace(f"<@{bot_uid}>", "").strip()
|
|
|
|
prefix = "[thread parent] " if is_parent else ""
|
|
display_user = msg_user or "unknown"
|
|
# Prefer the bot's own name when the message is a bot post.
|
|
if is_bot and not display_user:
|
|
display_user = msg.get("username") or "bot"
|
|
name = await self._resolve_user_name(display_user, chat_id=channel_id)
|
|
context_parts.append(f"{prefix}{name}: {msg_text}")
|
|
if is_parent:
|
|
parent_text = msg_text
|
|
|
|
content = ""
|
|
if context_parts:
|
|
content = (
|
|
"[Thread context — prior messages in this thread (not yet in conversation history):]\n"
|
|
+ "\n".join(context_parts)
|
|
+ "\n[End of thread context]\n\n"
|
|
)
|
|
|
|
self._thread_context_cache[cache_key] = _ThreadContextCache(
|
|
content=content,
|
|
fetched_at=now,
|
|
message_count=len(context_parts),
|
|
parent_text=parent_text,
|
|
)
|
|
return content
|
|
|
|
except Exception as e:
|
|
logger.warning("[Slack] Failed to fetch thread context: %s", e)
|
|
return ""
|
|
|
|
async def _fetch_thread_parent_text(
|
|
self,
|
|
channel_id: str,
|
|
thread_ts: str,
|
|
team_id: str = "",
|
|
) -> str:
|
|
"""Return the raw text of the thread parent message (for reply_to_text).
|
|
|
|
Uses the same per-thread cache as :meth:`_fetch_thread_context` to avoid
|
|
hitting ``conversations.replies`` twice. Falls back to a cheap single-
|
|
message fetch (``limit=1, inclusive=True``) when the cache is cold.
|
|
|
|
Returns empty string on any failure — callers should treat an empty
|
|
return as "no parent context to inject".
|
|
"""
|
|
cache_key = f"{channel_id}:{thread_ts}:{team_id}"
|
|
now = time.monotonic()
|
|
cached = self._thread_context_cache.get(cache_key)
|
|
if cached and (now - cached.fetched_at) < self._THREAD_CACHE_TTL:
|
|
return cached.parent_text
|
|
|
|
try:
|
|
client = self._get_client(channel_id)
|
|
result = await client.conversations_replies(
|
|
channel=channel_id,
|
|
ts=thread_ts,
|
|
limit=1,
|
|
inclusive=True,
|
|
)
|
|
messages = result.get("messages", []) if result else []
|
|
if not messages:
|
|
return ""
|
|
parent = messages[0]
|
|
if parent.get("ts", "") != thread_ts:
|
|
return ""
|
|
bot_uid = self._team_bot_user_ids.get(team_id, self._bot_user_id)
|
|
text = (parent.get("text") or "").strip()
|
|
if bot_uid:
|
|
text = text.replace(f"<@{bot_uid}>", "").strip()
|
|
return text
|
|
except Exception as exc: # pragma: no cover - defensive
|
|
logger.debug("[Slack] Failed to fetch thread parent text: %s", exc)
|
|
return ""
|
|
|
|
async def _handle_slash_command(self, command: dict) -> None:
|
|
"""Handle Slack slash commands.
|
|
|
|
Every gateway command in COMMAND_REGISTRY is registered as a native
|
|
Slack slash (``/btw``, ``/stop``, ``/model``, etc.), matching the
|
|
Discord and Telegram model. The slash name itself is the command;
|
|
any text after it is the argument list.
|
|
|
|
The legacy ``/hermes <subcommand> [args]`` form is preserved for
|
|
backward compatibility with older workspace manifests and for users
|
|
who want a single entry point for free-form questions (``/hermes
|
|
what's the weather`` — non-slash text is treated as a regular
|
|
message).
|
|
"""
|
|
slash_name = (command.get("command") or "").lstrip("/").strip()
|
|
text = command.get("text", "").strip()
|
|
user_id = command.get("user_id", "")
|
|
channel_id = command.get("channel_id", "")
|
|
team_id = command.get("team_id", "")
|
|
|
|
# Track which workspace owns this channel
|
|
if team_id and channel_id:
|
|
self._channel_team[channel_id] = team_id
|
|
|
|
if slash_name in {"hermes", ""}:
|
|
# Legacy /hermes <subcommand> [args] routing + free-form questions.
|
|
# Empty slash_name falls into this branch for backward compat
|
|
# with any caller that didn't populate command["command"].
|
|
from hermes_cli.commands import slack_subcommand_map
|
|
|
|
subcommand_map = slack_subcommand_map()
|
|
subcommand_map["compact"] = "/compress"
|
|
# Guard against whitespace-only text where ``text`` is truthy but
|
|
# ``text.split()`` returns ``[]`` (e.g. user sends ``/hermes ``).
|
|
parts = text.split() if text else []
|
|
first_word = parts[0] if parts else ""
|
|
if first_word in subcommand_map:
|
|
rest = text[len(first_word) :].strip()
|
|
text = (
|
|
f"{subcommand_map[first_word]} {rest}".strip()
|
|
if rest
|
|
else subcommand_map[first_word]
|
|
)
|
|
elif text:
|
|
pass # Treat as a regular question
|
|
else:
|
|
text = "/help"
|
|
else:
|
|
# Native slash — /<slash_name> [args]. Route directly through the
|
|
# gateway command dispatcher by prepending the slash.
|
|
text = f"/{slash_name} {text}".strip()
|
|
|
|
# Slack slash commands can originate from DMs or shared channels.
|
|
# Preserve DM semantics only for DM channel IDs; shared channels must
|
|
# keep group semantics so different users do not collide into one
|
|
# session key.
|
|
is_dm = str(channel_id).startswith("D")
|
|
source = self.build_source(
|
|
chat_id=channel_id,
|
|
chat_type="dm" if is_dm else "group",
|
|
user_id=user_id,
|
|
)
|
|
|
|
event = MessageEvent(
|
|
text=text,
|
|
message_type=(
|
|
MessageType.COMMAND if text.startswith("/") else MessageType.TEXT
|
|
),
|
|
source=source,
|
|
raw_message=command,
|
|
)
|
|
|
|
# Stash the Slack response_url so the first reply for this
|
|
# channel+user can be routed ephemerally (replaces the initial
|
|
# "Running /cmd…" ack shown by handle_hermes_command).
|
|
# Only stash for COMMAND events (text starts with "/") — free-form
|
|
# questions via "/hermes <question>" must produce public replies so
|
|
# the whole channel can see the agent's answer.
|
|
response_url = command.get("response_url", "")
|
|
if response_url and user_id and channel_id and text.startswith("/"):
|
|
self._slash_command_contexts[(channel_id, user_id)] = {
|
|
"response_url": response_url,
|
|
"ts": time.monotonic(),
|
|
}
|
|
|
|
# Set the ContextVar so send() can match the correct stashed
|
|
# response_url even when multiple users slash concurrently.
|
|
_slash_user_id_token = _slash_user_id.set(user_id or None)
|
|
try:
|
|
await self.handle_message(event)
|
|
finally:
|
|
_slash_user_id.reset(_slash_user_id_token)
|
|
|
|
def _has_active_session_for_thread(
|
|
self,
|
|
channel_id: str,
|
|
thread_ts: str,
|
|
user_id: str,
|
|
) -> bool:
|
|
"""Check if there's an active session for a thread.
|
|
|
|
Used to determine if thread replies without @mentions should be
|
|
processed (they should if there's an active session).
|
|
|
|
Uses ``build_session_key()`` as the single source of truth for key
|
|
construction — avoids the bug where manual key building didn't
|
|
respect ``thread_sessions_per_user`` and ``group_sessions_per_user``
|
|
settings correctly.
|
|
"""
|
|
session_store = getattr(self, "_session_store", None)
|
|
if not session_store:
|
|
return False
|
|
|
|
try:
|
|
from gateway.session import SessionSource, build_session_key
|
|
|
|
source = SessionSource(
|
|
platform=Platform.SLACK,
|
|
chat_id=channel_id,
|
|
chat_type="group",
|
|
user_id=user_id,
|
|
thread_id=thread_ts,
|
|
)
|
|
|
|
# Read session isolation settings from the store's config
|
|
store_cfg = getattr(session_store, "config", None)
|
|
gspu = (
|
|
getattr(store_cfg, "group_sessions_per_user", True)
|
|
if store_cfg
|
|
else True
|
|
)
|
|
tspu = (
|
|
getattr(store_cfg, "thread_sessions_per_user", False)
|
|
if store_cfg
|
|
else False
|
|
)
|
|
|
|
session_key = build_session_key(
|
|
source,
|
|
group_sessions_per_user=gspu,
|
|
thread_sessions_per_user=tspu,
|
|
)
|
|
|
|
session_store._ensure_loaded()
|
|
return session_key in session_store._entries
|
|
except Exception:
|
|
return False
|
|
|
|
async def _download_slack_file(
|
|
self, url: str, ext: str, audio: bool = False, team_id: str = ""
|
|
) -> str:
|
|
"""Download a Slack file using the bot token for auth, with retry."""
|
|
import httpx
|
|
|
|
bot_token = (
|
|
self._team_clients[team_id].token
|
|
if team_id and team_id in self._team_clients
|
|
else self.config.token
|
|
)
|
|
|
|
async with httpx.AsyncClient(timeout=30.0, follow_redirects=True) as client:
|
|
for attempt in range(3):
|
|
try:
|
|
response = await client.get(
|
|
url,
|
|
headers={"Authorization": f"Bearer {bot_token}"},
|
|
)
|
|
response.raise_for_status()
|
|
|
|
# Slack may return an HTML sign-in/redirect page
|
|
# instead of actual media bytes (e.g. expired token,
|
|
# restricted file access). Detect this early so we
|
|
# don't cache bogus data and confuse downstream tools.
|
|
ct = response.headers.get("content-type", "")
|
|
if "text/html" in ct:
|
|
raise ValueError(
|
|
"Slack returned HTML instead of media "
|
|
f"(content-type: {ct}); "
|
|
"check bot token scopes and file permissions"
|
|
)
|
|
|
|
if audio:
|
|
from gateway.platforms.base import cache_audio_from_bytes
|
|
|
|
return cache_audio_from_bytes(response.content, ext)
|
|
else:
|
|
from gateway.platforms.base import cache_image_from_bytes
|
|
|
|
return cache_image_from_bytes(response.content, ext)
|
|
except (httpx.TimeoutException, httpx.HTTPStatusError) as exc:
|
|
if (
|
|
isinstance(exc, httpx.HTTPStatusError)
|
|
and exc.response.status_code < 429
|
|
):
|
|
raise
|
|
if attempt < 2:
|
|
logger.debug(
|
|
"Slack file download retry %d/2 for %s: %s",
|
|
attempt + 1,
|
|
url[:80],
|
|
exc,
|
|
)
|
|
await asyncio.sleep(1.5 * (attempt + 1))
|
|
continue
|
|
raise
|
|
|
|
async def _download_slack_file_bytes(self, url: str, team_id: str = "") -> bytes:
|
|
"""Download a Slack file and return raw bytes, with retry."""
|
|
import httpx
|
|
|
|
bot_token = (
|
|
self._team_clients[team_id].token
|
|
if team_id and team_id in self._team_clients
|
|
else self.config.token
|
|
)
|
|
|
|
async with httpx.AsyncClient(timeout=30.0, follow_redirects=True) as client:
|
|
for attempt in range(3):
|
|
try:
|
|
response = await client.get(
|
|
url,
|
|
headers={"Authorization": f"Bearer {bot_token}"},
|
|
)
|
|
response.raise_for_status()
|
|
ct = response.headers.get("content-type", "")
|
|
if "text/html" in ct:
|
|
raise ValueError(
|
|
"Slack returned HTML instead of file bytes "
|
|
f"(content-type: {ct}); "
|
|
"check bot token scopes and file permissions"
|
|
)
|
|
return response.content
|
|
except (
|
|
httpx.TimeoutException,
|
|
httpx.HTTPStatusError,
|
|
ValueError,
|
|
) as exc:
|
|
if (
|
|
isinstance(exc, httpx.HTTPStatusError)
|
|
and exc.response.status_code < 429
|
|
):
|
|
raise
|
|
if isinstance(exc, ValueError):
|
|
raise
|
|
if attempt < 2:
|
|
logger.debug(
|
|
"Slack file download retry %d/2 for %s: %s",
|
|
attempt + 1,
|
|
url[:80],
|
|
exc,
|
|
)
|
|
await asyncio.sleep(1.5 * (attempt + 1))
|
|
continue
|
|
raise
|
|
|
|
# ── Channel mention gating ─────────────────────────────────────────────
|
|
|
|
def _slack_require_mention(self) -> bool:
|
|
"""Return whether channel messages require an explicit bot mention.
|
|
|
|
Uses explicit-false parsing (like Discord/Matrix) rather than
|
|
truthy parsing, since the safe default is True (gating on).
|
|
Unrecognised or empty values keep gating enabled.
|
|
"""
|
|
configured = self.config.extra.get("require_mention")
|
|
if configured is not None:
|
|
if isinstance(configured, str):
|
|
return configured.lower() not in {"false", "0", "no", "off"}
|
|
return bool(configured)
|
|
return os.getenv("SLACK_REQUIRE_MENTION", "true").lower() not in {
|
|
"false",
|
|
"0",
|
|
"no",
|
|
"off",
|
|
}
|
|
|
|
def _slack_strict_mention(self) -> bool:
|
|
"""When true, channel threads require an explicit @-mention on every
|
|
message. Disables all auto-triggers (mentioned-thread memory,
|
|
bot-message follow-up, session-presence). Defaults to False.
|
|
"""
|
|
configured = self.config.extra.get("strict_mention")
|
|
if configured is not None:
|
|
if isinstance(configured, str):
|
|
return configured.lower() in {"true", "1", "yes", "on"}
|
|
return bool(configured)
|
|
return os.getenv("SLACK_STRICT_MENTION", "false").lower() in {
|
|
"true",
|
|
"1",
|
|
"yes",
|
|
"on",
|
|
}
|
|
|
|
def _slack_free_response_channels(self) -> set:
|
|
"""Return channel IDs where no @mention is required."""
|
|
raw = self.config.extra.get("free_response_channels")
|
|
if raw is None:
|
|
raw = os.getenv("SLACK_FREE_RESPONSE_CHANNELS", "")
|
|
if isinstance(raw, list):
|
|
return {str(part).strip() for part in raw if str(part).strip()}
|
|
# Coerce non-list scalars (str/int/float) to str before splitting.
|
|
# A bare numeric YAML value (`free_response_channels: 1234567890`) is
|
|
# loaded as int and was previously falling through the isinstance(str)
|
|
# branch to return an empty set. str() here accepts whatever scalar
|
|
# the YAML loader hands us without changing existing string/CSV
|
|
# semantics.
|
|
s = str(raw).strip() if raw is not None else ""
|
|
if s:
|
|
return {part.strip() for part in s.split(",") if part.strip()}
|
|
return set()
|
|
|
|
def _slack_allowed_channels(self) -> set:
|
|
"""Return the whitelist of channel IDs the bot will respond in.
|
|
|
|
When non-empty, messages from channels NOT in this set are silently
|
|
ignored — even if the bot is @mentioned. DMs are never filtered.
|
|
Empty set means no restriction (fully backward compatible).
|
|
"""
|
|
raw = self.config.extra.get("allowed_channels")
|
|
if raw is None:
|
|
raw = os.getenv("SLACK_ALLOWED_CHANNELS", "")
|
|
if isinstance(raw, list):
|
|
return {str(part).strip() for part in raw if str(part).strip()}
|
|
if isinstance(raw, str) and raw.strip():
|
|
return {part.strip() for part in raw.split(",") if part.strip()}
|
|
return set()
|