Home News Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

by Raymond Vandervort

Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Blockchain safety firm warns of AI code poisoning risk after OpenAI's ChatGPT recommends scam API

Blockchain safety firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API Blockchain safety firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Blockchain safety firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Blockchain safety experts warn that the risk of AI poisoning has emerged, threatening belief in AI technologies.

Blockchain safety firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Conceal art/illustration via CryptoSlate. Image entails mixed thunder material which would possibly maybe also impartial embody AI-generated thunder material.

Yu Xian, founder of the blockchain safety firm Slowmist, has raised alarms a couple of rising risk acknowledged as AI code poisoning.

This assault form involves injecting contaminated code into the practicing files of AI fashions, which can pose dangers for users who depend upon these tools for technical projects.

The incident

The affirm gained attention after a troubling incident engrossing OpenAI’s ChatGPT. On Nov. 21, a crypto trader named “r_cky0” reported dropping $2,500 in digital property after seeking ChatGPT’s relief to assemble a bot for Solana-based totally mostly memecoin generator Pump.enjoyable.

On the opposite hand, the chatbot on the spot a fraudulent Solana API web page, which resulted in the theft of the person’s non-public keys. The victim illustrious that within half-hour of utilizing the malicious API, all property were drained to a wallet linked to the scam.

[Editor’s Note: ChatGPT appears to have recommended the API after running a search using the new SearchGPT as a ‘sources’ section can be seen in the screenshot. Therefore, it does not seem to be a case of AI poisoning but a failure of the AI to recognize scam links in search results.]

AI scam link API (Supply: X)
AI scam link API (Supply: X)

Additional investigation revealed this take care of constantly receives stolen tokens, reinforcing suspicions that it belongs to a fraudster.

The Slowmist founder illustrious that the fraudulent API’s domain title used to be registered two months ago, suggesting the assault used to be premeditated. Xian furthered that the web page lacked detailed thunder material, consisting only of paperwork and code repositories.

Whereas the poisoning looks deliberate, no evidence suggests OpenAI intentionally integrated the malicious files into ChatGPT’s practicing, with the dwell outcome seemingly coming from SearchGPT.

Implications

Blockchain safety firm Rip-off Sniffer illustrious that this incident illustrates how scammers pollute AI practicing files with contaminated crypto code. The firm talked about that a GitHub person, “solanaapisdev,” has now no longer too long ago created extra than one repositories to control AI fashions to generate fraudulent outputs in fresh months.

AI tools love ChatGPT, now aged by hundreds of tens of millions, face increasing challenges as attackers catch original ideas to utilize them.

Xian cautioned crypto users about the dangers tied to immense language fashions (LLMs) love GPT. He emphasised that after a theoretical risk, AI poisoning has now materialized into a staunch risk. So, with out extra tough defenses, incidents love this would possibly maybe also undermine belief in AI-driven tools and present users to additional monetary losses.

Talked about listed here
Posted In: Solana, AI, Crime, Technology

Source credit : cryptoslate.com

Related Posts