Марія Бровінська AI Eng 24 November 2025, 15:21

Andrey Karpaty has made LLM Council publicly available — a web application where several AIs argue with each other and choose the best answer.

Andrey Karpaty, a well-known artificial intelligence enthusiast, co-founder of OpenAI, and author of the term «vibe coding,» has published LLM Council in open access — a local web application in which several language models simultaneously answer one question, evaluate competitors' answers, and form the most optimal final answer.

What is the LLM Council?

In the project documentation, Karpaty describesLLM Council as an interface similar to ChatGPT, but with a key difference: it sends the same request to multiple LLMs via OpenRouter and then organizes «cross-model debates.»

The application works in three stages:

Response generation.
Each model receives a question and generates its own answer. In the web interface, the user sees them in separate tabs.
Mutual reviews.
The models receive anonymous responses from other participants and rank them for accuracy and usefulness.
Final decision.
The «main LLM» selected by the user summarizes the opinions of other models and gives a final answer — a kind of machine consensus.

Karpaty explains that he created a tool for «reading books with LLMs together» and comparing different interpretations of content. But in practice, the project turned out to be much more interesting: it allows you to compare models, test their logic, and observe how AI can make collective decisions.