zip-glm47-sy

results/zip-glm47-sy/README.md

@@ -0,0 +1,40 @@
+### zip-glm47-sy
+
+Zip is a lightweight browser-use agent runtime for LLM-driven web automation. It runs as a BrowserGym-compatible AgentLab agent for benchmark evaluation.
+
+#### Model Name
+
+- `z-ai/glm-4.7:nitro` via OpenRouter
+
+#### Model Architecture
+
+Zip uses a general-purpose browser-agent architecture with structured browser context extraction, stable element IDs, semantic DOM-first tools, and an optional planner/worker split. This MiniWoB run used unified mode, where a single tool-equipped agent acts after context extraction, filtering, and oracle checks.
+
+#### Input/Output Format
+
+The agent receives BrowserGym task instructions plus a pruned structured page snapshot containing element IDs, labels, text context, attributes, handler hints, and recent state. It outputs semantic browser tool calls such as click, type, select, read, scroll, drag, and completion decisions.
+
+#### Training Details
+
+No agent-specific training or fine-tuning was used. The run used the base hosted model with Zip's runtime, prompts, tools, and benchmark configuration.
+
+#### Benchmark Configuration
+
+```bash
+uv run --extra agentlab python benchmarks/agentlab/run_browsergym_benchmark.py \
+  --benchmark miniwob \
+  --preset full \
+  --n-repeats 1 \
+  --max-steps 20 \
+  --env-max-steps 10 \
+  --max-elements 80 \
+  --n-jobs 1
+```
+
+#### Additional Notes
+
+- Benchmark: MiniWoB full suite
+- Episodes: 125
+- Study ID: `2026-05-26_15-41-13`
+- Provider: OpenRouter
+- Model: `z-ai/glm-4.7:nitro`

results/zip-glm47-sy/miniwob.json

@@ -0,0 +1,16 @@
+[
+  {
+    "agent_name": "zip-glm47-sy",
+    "study_id": "2026-05-26_15-41-13",
+    "date_time": "2026-05-26 15:41:13",
+    "benchmark": "MiniWoB",
+    "score": 86.4,
+    "std_err": 3.066,
+    "benchmark_specific": "No",
+    "benchmark_tuned": "No",
+    "followed_evaluation_protocol": "Yes",
+    "reproducible": "Yes",
+    "comments": "Zip unified-mode browser agent using OpenRouter z-ai/glm-4.7:nitro; MiniWoB full suite, 125 episodes, one repeat, max_steps=20, env_max_steps=10, max_elements=80.",
+    "original_or_reproduced": "Original"
+  }
+]