JJev Cookbook
课程首页 中文文档 拓展阅读 GitHub ↗

拓展阅读 / NanoJev:小型决策模型

知识库收录材料 · 原始文件 ↗ · 来源、版本与许可

Model-guided edge exploration: measured results

The model supplies four local safety probabilities. Code orders untried edges, records actual collision feedback, and repositions using only physically verified open edges. The policy receives no wall map, full-map solver, or hidden route. Every selected maze is retained.

The main comparison uses 2 × size² attempts, including collisions: 128 for 8×8, 512 for 16×16, and 5,000 for 50×50. It supplements the original 128-attempt integration pilot on the same initial states; both sets remain available. See the frozen cases, original case-selection protocol, and replay audit.

System roles

Initial NanoJev is the existing trained checkpoint, not untouched Qwen. Local-atomic NanoJev adds focused local-question training. Jev supplies its recorded API probabilities. Perfect local geometry is an exact local parser using the same exploration controller, not a full-map BFS planner. Constant 0.5 perception always returns 0.5 for each Boolean proposition; it is not uniform random action selection.

All systems use the same threshold and code: among untried edges with p≥0.5, prioritize goal Manhattan distance, visits, then probability; otherwise physically probe the highest-ranked low-probability edge. Known-open graph search is used only to reach a remaining frontier. Probes and collisions count toward the attempt limit.

Full-horizon results

Each cell is attempts / collisions / status. goal means completed; limit means the attempt budget expired.

Case IDInitialLocal atomicJevPerfect localConstant 0.5
maze:test:8:2326892125 / 9 / goal21 / 5 / goal16 / 0 / goal16 / 0 / goal27 / 11 / goal
maze:test:16:2327692232 / 8 / goal37 / 5 / goal108 / 40 / goal33 / 3 / goal43 / 13 / goal
maze:ood:50:24310922171 / 43 / goal244 / 36 / goal2738 / 1044 / goal133 / 5 / goal162 / 34 / goal

Source reports: Initial NanoJev, Local-atomic NanoJev, Jev, Perfect local geometry, Constant 0.5 perception.

SystemCompletedTotal attemptsSuccessful movesCollisions
Initial NanoJev3/322816860
Local-atomic NanoJev3/330225646
Jev3/3286217781084
Perfect local geometry3/31821748
Constant 0.5 perception3/323217458

Local-atomic NanoJev records 46 collisions versus 60 for Initial NanoJev, but 302 total attempts versus 228. In this cohort, fewer collisions do not translate into better overall navigation efficiency.

Original 128-attempt pilot, retained

Each cell is attempts / collisions / status. goal means completed; limit means the attempt budget expired.

Case IDInitialLocal atomicJevPerfect localConstant 0.5
maze:test:8:2326892125 / 9 / goal21 / 5 / goal16 / 0 / goal16 / 0 / goal27 / 11 / goal
maze:test:16:2327692232 / 8 / goal37 / 5 / goal108 / 40 / goal33 / 3 / goal43 / 13 / goal
maze:ood:50:24310922128 / 31 / limit128 / 14 / limit128 / 25 / limit128 / 5 / limit128 / 29 / limit

Source reports: Initial NanoJev, Local-atomic NanoJev, Jev, Perfect local geometry, Constant 0.5 perception.

The full-horizon controls complete 3/3 with perfect local predictions and 3/3 with constant perception. Their total attempts are 182 and 232; collisions are 8 and 58. Constant-perception completion shows that code exploration contributes substantially. Model value must be assessed through actual efficiency and error reduction, not completion alone.

Interpretation and verification

Each controller visits different states. Its recorded atomic accuracy, scalar Brier, and NLL therefore describe its own visited-state distribution; they are not a direct comparison on identical questions. Use a separate fixed question cohort for model probability quality. This small three-maze study also does not establish generalization to arbitrary 50×50 maps.

The verifier reconstructs each original request from the simulator and uses a RecordedEngine to return only that node's saved probabilities. It checks state/question hashes, consumes every saved node once, and reproduces all actions, collisions, memory edges, and final states. It verifies source, renderer, and implementation hashes and embedded API-input/proxy consistency. It does not rerun inference or independently authenticate private API journals.

bash
python scripts/summarize_model_edges.py

This command reads tracked artifacts and rebuilds the report without model or API calls. The earlier direct-action pilot asked models for whole-map actions. The separate composed_* diagnostic used full-map BFS with model judgments scored separately; neither should be conflated with this probability-guided exploration.

快照未包含部分工程附件或配图;请通过上游链接或原始材料查看,收录范围见来源清单。

第十一章知识库收录材料 · 来源、版本与许可 · 第三方内容版权归各自作者;观点与数字请对照原始来源核验。