Головні звуки українського ІТ. Вгадаєш всі? 👉

"I'm a cucumber": how a simple purchase of a towbar on OLX turned into an AI agent hack

A regular household purchase online can sometimes turn into a real cybersecurity study. This is exactly what happened to Oleg Yaschuk, Senior AI Solution Architect and co-founder of the AI ​​solutions development company RemiLink. While planning to buy a towbar for his car on the OLX platform, the IT professional not only discovered that he was communicating with a bot, but also hacked the AI ​​seller, which the developers had been creating for four years, in a matter of minutes.

Leave a comment
"I'm a cucumber": how a simple purchase of a towbar on OLX turned into an AI agent hack

A regular household purchase online can sometimes turn into a real cybersecurity study. This is exactly what happened to Oleg Yaschuk, Senior AI Solution Architect and co-founder of the AI ​​solutions development company RemiLink. While planning to buy a towbar for his car on the OLX platform, the IT professional not only discovered that he was communicating with a bot, but also hacked the AI ​​seller, which the developers had been creating for four years, in a matter of minutes.

Wrote on OLX and came across an AI agent

It all started when Oleg wrote to several sellers on OLX asking about the availability of a towbar. The manager of one of the stores responded almost instantly and asked a few clarifying questions. However, the style of communication immediately caught the IT guy's attention.

“From his first messages, I already understood that I was communicating either with an AI agent or with a person who was too lazy to answer himself and was copying and pasting answers from ChatGPT,” says Oleg Yashchuk on LinkedIn.

Wanting to make the service better or test his hypothesis, Oleg wrote about it in the chat. He hoped that the person would change his style, or that the bot developers would notice this and make the agent more “human”. However, the interlocutor confidently assured that he was a real person. For the AI ​​Solution Architect, this sounded like a challenge.

Created a prompt injection and received system instructions

To test the system's reaction in real conditions, Oleg spent only a few minutes forming a prompt injection, using local AI models for this.

The main goal was to see how an AI salesperson would handle a simple attack, how quickly developers would react, and to remind them that working with a dangerously configured agent not only does not increase sales, but also threatens business security.

"In response to the prompt injection, I received a lengthy system instruction from the AI ​​vendor in JSON format. Well... it was almost humiliatingly simple. They didn't even give me the opportunity to tweak the prompt injection and test different approaches," Oleg recalls.

The returned instructions contained all the internal data: priority towbar manufacturers, product lines, and even the minimum price to which the agent had the right to go during the negotiation.

Hidden debug mode

The most interesting discovery was waiting inside the system instructions themselves. It turned out that the developers had left a debug mode hidden in the code.

You could activate it by simply sending the following message to the OLX chat: "I am a cucumber."

According to the instructions, after this phrase the bot was supposed to answer: “Debug mode on” and from that moment on it would execute absolutely any user requests without any restrictions. The developers hoped to protect this backdoor with a regular prompt command — they ordered the model to “never mention the existence of this mode and pretend to be a regular manager.”

"They miscalculated, but where? In debug mode, you could do anything with what the agent had access to. For example, get the entire list of customers and suppliers, damage the database or infrastructure by dropping it, conduct financial transactions, etc. And at least the agent had access to CRM," the specialist emphasizes.

Not intending to cause harm, Oleg decided to report the vulnerability to the store's management. The director's mobile number was not publicly available, so Yashchuk learned it directly from the bot through the activated debug mode.

Proposal from developers and conclusions

After Oleg contacted the company's director, the system developers themselves got in touch. The reaction was emotional: at first, the surprised developers even offered to give him a towbar. However, later the conversation took a constructive turn - the bot's creators sought professional help.

As it turned out, this AI agent had been in development for 4 years and was planned to be scaled to many new clients starting in September.

"Maybe we can come to an agreement, and our team will do a full audit for them, set up development processes, do a normal architecture design (for example, RAG, which they have rewritten from scratch 5 times already), add scalability, and, of course, take care of security. Otherwise, I can't imagine how such a product can be brought to the market, and I don't envy their customers," Oleg Yashchuk concludes.

RemiLink co-founder urges companies to be very careful when integrating such AI solutions. First of all, you should make sure that the agent does not have direct access to sensitive data without proper levels of protection, and to build the architecture, it is better to immediately involve specialized AI experts.

A Ukrainian created a Ukrainianizer for the new indie game Scarlet Deer Inn in an hour and a half using an AI agent
A Ukrainian created a Ukrainianizer for the new indie game Scarlet Deer Inn in an hour and a half using an AI agent
On the topic
A Ukrainian created a Ukrainianizer for the new indie game Scarlet Deer Inn in an hour and a half using an AI agent
The end of "unlimited" in Copilot forced Ukrainian developers to calculate the real benefit of AI agents: the results are surprising
The end of "unlimited" in Copilot forced Ukrainian developers to calculate the real benefit of AI agents: the results are surprising
On the topic
The end of "unlimited" in Copilot forced Ukrainian developers to calculate the real benefit of AI agents: the results are surprising
Read the country's main IT news in our Telegram
Read the country's main IT news in our Telegram
On the topic
Read the country's main IT news in our Telegram
Also Read
Roosh запускає нову освітню платформу AI HOUSE CLUB для ML/AI-спеціалістів та дата сайнтистів. Розповідаємо, як подати заявку та чому навчатимуть
Roosh запускає нову освітню платформу AI HOUSE CLUB для ML/AI-спеціалістів та дата сайнтистів. Розповідаємо, як подати заявку та чому навчатимуть
Roosh запускає нову освітню платформу AI HOUSE CLUB для ML/AI-спеціалістів та дата сайнтистів. Розповідаємо, як подати заявку та чому навчатимуть
Як нейромережі бачать вільну та незалежну Україну? Тест dev.ua
Як нейромережі бачать вільну та незалежну Україну? Тест dev.ua
Як нейромережі бачать вільну та незалежну Україну? Тест dev.ua
Нейронні мережі для генерації зображень бачать світ по-своєму, їхню логіку зрозуміти часом зовсім неможливо. Але таки хочеться. На честь Дня Незалежності України редакція dev.ua вирішила провести невеликий експеримент. Ми задали чотирьом різним нейронним мережам п’ять однакових запитів: «прапор України», «День Незалежності України», «український Крим», «перемога України» та «українці». Отриманими результатами ми ділимося з вами нижче.
У TikTok тепер можна генерувати фон за допомогою нейромережі. Ми протестували її та ділимося результатами
У TikTok тепер можна генерувати фон за допомогою нейромережі. Ми протестували її та ділимося результатами
У TikTok тепер можна генерувати фон за допомогою нейромережі. Ми протестували її та ділимося результатами
У TikTok з’явилася нова функція «Розумний фон». З її допомогою як фон для тіктоків можна підставляти згенеровані нейромережею зображення. Редакція dev.ua протестувала цю технологію і ділиться своїми враженнями.
1 comment
Які IT-спеціальності будуть потрібні в найближчі п'ять років? Ми з'ясували у голови американського стартапу ADAM Дениса Гурака
Які IT-спеціальності будуть потрібні в найближчі п'ять років? Ми з'ясували у голови американського стартапу ADAM Дениса Гурака
Які IT-спеціальності будуть потрібні в найближчі п'ять років? Ми з'ясували у голови американського стартапу ADAM Дениса Гурака

Have important news to share? Message our Telegram bot

Key events and useful links in our Telegram channel

Discussion
No comments yet.