The domestic LLM API platform, created for businesses and startups that use artificial intelligence models in their products or internal processes, has launched in Ukraine. The service offers a single point of access to over 400 models from various providers and provides tools for controlling them.
The domestic LLM API platform, created for businesses and startups that use artificial intelligence models in their products or internal processes, has launched in Ukraine. The service offers a single point of access to over 400 models from various providers and provides tools for controlling them.
As the service developers reported in a press release, the platform is aimed at startups, as well as medium and large companies with a high AI workload that seek to optimize their processes and costs.
The main goal of the project is to simplify the administration of artificial intelligence infrastructure for businesses. Instead of setting up dozens of separate integrations, developers can connect to different AI providers through a single interface. This allows companies to quickly test new models without significant changes to their own code, as well as centrally control costs, limits, and API keys.
One of the platform’s key technological features is the EvalLab module, designed for benchmarking models on a company’s own scenarios. Users can run the same prompts through different models and compare the responses received by three main parameters: speed, cost, and quality score. This allows you to visually test the performance of GPT, Claude, Gemini, or open-source models on real-world tasks in a single interface.
In addition, the module supports the LLM-as-judge methodology. In this scenario, one of the models acts as a «judge» and evaluates the quality of the responses of the other models on a scale from 0 to 100 based on specified criteria.
LLM API representatives emphasize that the service does not add its own markup on top of the cost of requests from original AI providers. In some cases, the team helps customers obtain special, more favorable rates. Registration on the platform is already open to all interested parties.
Recall that in May, the Lapathoniia service, an infrastructure solution for hosting and integrating Ukrainian large-scale language models, launched in Ukraine. According to the developers, the idea of creating the service arose due to the lack of a convenient tool for hosting local neural networks on the market.
