perf(serve): reduce worker/router event-loop lag#1453

Merged

mikasenghaas merged 14 commits into

mainfrom

May 24, 2026

Commits on May 23, 2026

perf(serve): offload parse_response_tokens body to a worker thread (E1)

codex
and
claude
committed
perf(envs): offload state_to_output to a worker thread (E2)

codex
and
claude
committed
perf(serve): install uvloop in env_worker + env_server (E4)

codex
and
claude
committed
perf(serve): drop uvloop dep declaration; rely on existing install

codex
and
claude
committed
perf(serve): round-2 — scale thread pool, thread request unpack, batch router sends

codex
and
claude
committed
revert: drop R4 (env_router on_response gather)

mikasenghaas
and
claude
committed
chore(serve): drop intervention IDs, nest parse_response_tokens sync body

mikasenghaas
and
claude
committed
chore(deps): declare uvloop as a direct dependency

mikasenghaas
and
claude
committed
style: ruff fix + format

mikasenghaas
and
claude
committed
fix(deps): mark uvloop as non-Windows / non-PyPy

mikasenghaas
and
claude
committed