Our approach to reasoning produced the top Sudoku model and a chess model that learns faster than DeepMind’s method. Winning at games is the test, not the goal.
A few weeks ago, we had a breakthrough in our research. Since then, we’ve built the world’s best model at solving Sudokus, and a model-only chess engine that beats DeepMind’s transformer-based version. Games are fun, but why does this matter? Just like we use games to teach children, they hold lessons for artificial intelligence.
How did we end up here? When founding the lab, our key insight was a better shape for logic and the code. We had long struggled to make this work, and had already explored a bit of other venues. Then, a curious thought came on a Friday evening, and I let the agents return to our old friend, the neural interpreter. By Sunday, we had stunning results. Our architecture was able to learn much faster than a transformer. It also generalized to samples more complex than anything in the training data.
Results always come with some uncertainty. Something could be off with the data, or perhaps the approach might work with only a very specific type of problem. We went on to test the architecture beyond code, choosing Sudoku as the next target. There is a wide range of published results for Sudoku, and it’s a quick one to work with as it doesn’t need much compute. The same thing as with code happened again - our model was extrapolating beyond the data it had seen. Today it solves 99.8% of Sudoku Extreme, the best result of any learned model. We also do it with fewer parameters than anybody else on the rankings.
In the meantime, we had also started working on chess. The shape of reasoning in chess is more general than in Sudoku. The game requires thinking in consequences, and then aggregating the findings to choose the best move. This is similar to working through problems and solutions - your opponent poses problems, you solve them. This is the shape of intelligence needed throughout life: figuring out what are the problems worth solving, and then solving them. The work around chess is still active. We have already demonstrated a model-only chess engine that learns faster than our reimplementation of DeepMind’s transformer-based variant, with less than 10% of the parameters.
Our upcoming research includes more reasoning tasks, and gradually more focus on the areas that truly matter: language and code.
I’m often asked which part of AI we are solving. We are here to solve it all. The easier paths like becoming a Jev-like restricted logical engine will never win in the long run. The only way to truly compete is to build the best overall intelligence. We are not publishing the methods, as the race is serious. We are running towards intelligence beyond the best human experts. The “why” behind the 041 reasoning engine is superintelligence.

