The post reports held-out-harness DeepSWE pass@1 rising from roughly 50% to 66%.
It also cites RL batches of 1,568 prompts with 16 rollouts each (25,088 trajectories) and 2.7–3.7 billion training tokens per update. Raschka characterizes the attention stack as conventional GQA plus 128-token sliding-window attention, arguing that data and post-training may matter more than novel attention mechanisms.