Built on the sts_lightspeed RL fork. It provides a vectorized environment, a single-env gymnasium version, a run archive and HTML reports. Playback needs your own copy of the game (build V2.3.4) with ModTheSpire and BaseMod, and uses Communication Mod. Tested on Windows only.
The example model covers A20 Defect only and the training script is not included. Over 1,000 simulated runs with sampled actions, after 144M training steps, it reached floor 19.6 on average (standard deviation 9.1, best 50) and won none, so it is a starting point rather than a strong player.