"The most important part of the work is underway". Fedorov told what stage of development the national LLM is at

Fedorov recalled that the technical partner of the project is Kyivstar, which finances the development of the national LLM and will then transfer it to the state. It is based on the Gemma family of models from Google, which are adapted to the Ukrainian language and context.

The quality of the development of the national LLM will be tested by a group of independent experts from various fields, who will check the model for:

• technical quality;
• ethics and safety for users;
• knowledge of the Ukrainian language;
• understanding the national context.

«The most important part of the work is currently underway — collecting data for LLM studies. For high-quality information from the Internet, it is not enough, so we work with government agencies, media, universities and other institutions — these are terabytes of unique data,» said Mykhailo Fedorov.

He added that a legal framework is being created in parallel to «responsibly work with the data provided for training models.»

According to the head of the Ministry of Digital Affairs, a group of experts is already working on creating benchmarks that will help evaluate and improve the quality of the national LLM. This will allow us to keep the focus on the effectiveness and security of the language model.

In January, the first text database for LLM training will be ready, as well as an improved tokenizer — a tool that divides words into elements so that LLM can process language faster and more efficiently. Voting for the name of the Ukrainian LLM will also start this month.

Let us recall that the intentions of the Ministry of Digital Affairs to create its own artificial intelligence that would understand Ukrainians better than ChatGPT initially caused only surprise and smiles, but only a few months passed from words to real actions. dev.ua figured out why Ukraine needs its own LLM.

Read the country’s main IT news in our Telegram

On the topic

Read the country’s main IT news in our Telegram

The Ministry of Digital Affairs and Kyivstar have chosen an AI model to train the national LLM

On the topic

The Ministry of Digital Affairs and Kyivstar have chosen an AI model to train the national LLM

The Ministry of Digital Affairs and Kyivstar are looking for a name for the national LLM: prizes can be won for the best ideas. An hour after the announcement, Ukrainians already have hundreds of options

On the topic

The Ministry of Digital Affairs and Kyivstar are looking for a name for the national LLM: prizes can be won for the best ideas. An hour after the announcement, Ukrainians already have hundreds of options

Ukrainian researchers present Lapa LLM — the first national AI model for reasoning

On the topic

Ukrainian researchers present Lapa LLM — the first national AI model for reasoning