Harden long-running behavioral evaluations

2026-09-23 00:19:35 +08:00
parent 9f54f8f5a3
commit afcd6c614e
4 changed files with 35 additions and 3 deletions
@@ -51,6 +51,7 @@ python3 -m logicbench run tasks/short-smoke.json
 | `RENDERER_BASE_URL`, `SOLVER_BASE_URL` | Required independent OpenAI-compatible endpoints |
 | `RENDERER_API_STYLE`, `SOLVER_API_STYLE` | `responses` (default) or `chat_completions` |
 | `RENDERER_MODEL`, `SOLVER_MODEL` | Required, independently selected model IDs |
+| `RENDERER_TIMEOUT_SECONDS`, `SOLVER_TIMEOUT_SECONDS` | Optional per-request timeout; default `240` |

 Outputs under the task's `output_dir` are: