JJev Cookbook
课程首页 中文文档 拓展阅读 GitHub ↗

拓展阅读 / NanoJev:小型决策模型

知识库收录材料 · 原始文件 ↗ · 来源、版本与许可

Development results: fixed maze and Snake pilot

The primary pipeline combines atomic judgments + code planning: focused model propositions, exploration memory, and code that composes actions. This page preserves the separate whole-map direct-action stress test. See atomic training and model-guided exploration for the implemented local pipeline. Planner success and event calibration have separate measurements.

All six cases were selected before the new rollouts, with a shared 128-step limit and identical initial states. See the frozen protocol, machine-readable audit, and environment/runbook. This is a bounded integration pilot, not a full-size completion benchmark or a population estimate.

Systems and roles

SystemRoleController
Initial NanoJevExisting NanoJev checkpoint before this game training; not untouched Qwen.greedy
Game-target NanoJevNanoJev trained on programmatic game-question targets.greedy
API-target NanoJevNanoJev trained on saved API-reference game-question targets.greedy
JevRecorded Jev API decision controller.greedy
Reference codeMaze: exact shortest-path actions. Snake: local collision-avoidance/food-progress rule, not global optimal play.greedy
Uniform randomUniform sampling over the offered action set.sample

Initial NanoJev is the earlier trained checkpoint, not raw untrained Qwen. The two game-training arms begin from that same checkpoint. Reference-code wins are due to its explicit algorithm; they are not credited to a learned judgment model. Uniform random samples; the other five systems use greedy actions. This pilot does not compare both controllers for every system.

Maze: success / steps

A success is reaching the goal. Every failure remains in the table. The three exact shortest-path lengths are 16, 24, and 96, so all three are feasible within 128 moves.

Case IDInitialGame targetsAPI targetsJevReferenceRandom
maze:test:8:232689210 / 1280 / 1280 / 1280 / 1281 / 160 / 128
maze:test:16:232769220 / 1280 / 1280 / 1280 / 1281 / 240 / 128
maze:ood:50:243109220 / 1280 / 1280 / 1280 / 1281 / 960 / 128

Snake: food score / steps / outcome

Food score counts food eaten. Surviving to the time limit is distinct from filling the board, and is not a win. wall means wall collision; body means self-collision; limit means the snake remained alive at step 128.

Case IDInitialGame targetsAPI targetsJevReferenceRandom
snake:test:8:232689201 / 7 / wall1 / 5 / wall0 / 9 / wall8 / 58 / body8 / 51 / body0 / 15 / wall
snake:test:16:232769200 / 21 / wall1 / 35 / wall0 / 8 / wall6 / 128 / limit14 / 128 / limit0 / 15 / wall
snake:ood:50:243109200 / 128 / limit0 / 128 / limit0 / 25 / wall0 / 128 / limit2 / 128 / limit0 / 128 / limit

The learned direct-action models and Jev do not solve any of these three mazes within the shared 128-step limit. Local Snake behavior varies substantially, and no system fills a board. These results motivated the separate local-question training and code-exploration pipeline linked above.

Independent question and probability measurements

The probability report and RLCD experiment measure fixed question outputs separately from game trajectories. Atomic clear_*/safe_* truths, planning truth questions, action preferences, and stochastic events have different targets. Better one-step probability scores do not establish long-horizon game success.

Game modelSplitAtomic truth accuracyAlways-true accuracyQuestions
games_gold_seed17test0.7223970.722397317
games_gold_seed17ood0.7500000.750000112
games_api_seed17test0.7160880.722397317
games_api_seed17ood0.7500000.750000112

The aggregate atomic accuracies of these full-map game-training arms do not exceed the fixed always-true control. The OOD Snake subset contains only true safety labels. The subsequent local-maze experiment uses matching local training inputs and reports true/false cases separately from these full-map runs.

Game modelSplitAtomic familyAccuracyAlways trueQuestions
games_gold_seed17testscaled_maze0.5625000.562500176
games_gold_seed17testsnake_one_step_safety_v40.9219860.921986141
games_gold_seed17oodscaled_maze0.5625000.56250064
games_gold_seed17oodsnake_one_step_safety_v41.0000001.00000048
games_api_seed17testscaled_maze0.5738640.562500176
games_api_seed17testsnake_one_step_safety_v40.8936170.921986141
games_api_seed17oodscaled_maze0.5625000.56250064
games_api_seed17oodsnake_one_step_safety_v41.0000001.00000048

The small JSON audit retains confusion counts, separate planning-truth and action-support diagnostics; they are not pooled into atomic accuracy. Maze optimal-action mass and Snake local reference-action mass are separate metrics.

Verification and reproduction

The local audit replays 36 episodes / 3201 transitions, checks every saved before/after hash, final outcome, offered probability support, greedy choice, cohort identity, and horizon. Source-file hashes are retained. This does not rerun model inference, verify private API receipts, or reconstruct random draws absent from the compact artifacts.

bash
python scripts/summarize_development_results.py

This command reads the frozen compact reports and rebuilds the small JSON audit and this document without API/GPU calls. Keep all six source reports and the preselected episode file unchanged.

快照未包含部分工程附件或配图;请通过上游链接或原始材料查看,收录范围见来源清单。

第十一章知识库收录材料 · 来源、版本与许可 · 第三方内容版权归各自作者;观点与数字请对照原始来源核验。