Instrument design tests whether language-model agents can apply physics rather than recall it. NeutronGym is an executable environment for neutron instrument design: agents build instruments through validating tools, McStas ray-traces them, and a graded ladder scores syntax, runtime, structure, and science without an LLM judge. Seven frontier models reproduce at most 7 of 16 published instruments. RL on its reward lifts Qwen3-8B from 11% to 77% on held-out instances, surpassing an untrained Qwen3-32B.
Podden och tillhörande omslagsbild på den här sidan tillhör
Craig Spencer Smith. Innehållet i podden är skapat av Craig Spencer Smith och inte av,
eller tillsammans med, Poddtoppen.