There’s a well-worn pattern in the development of AI chatbots. Researchers discover a vulnerability and exploit it to do ...

While the shortest distance between two points is a straight line, a straight-line attack on a large language model isn't always the most efficient — and least noisy — way to get the LLM to do bad ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Vivek Yadav, an engineering manager from ...

CrowdStrike's 2025 data shows attackers breach AI systems in 51 seconds. Field CISOs reveal how inference security platforms ...

OpenAI's new GPT-4V release supports image uploads — creating a whole new attack vector making large language models (LLMs) vulnerable to multimodal injection image attacks. Attackers can embed ...

Companies worried about cyberattackers using large language models (LLMs) and other generative artificial intelligence (AI) systems that automatically scan and exploit their systems could gain a new ...

OpenAI develops automated attacker system to test ChatGPT Atlas browser security against prompt injection threats and ...

MITRE’s ATLAS threat landscape knowledge base for artificial intelligence is a comprehensive guide to the tactics and processes bad actors use to compromise and exploit AI systems. It’s one thing to ...

PALO ALTO, Calif., May 15, 2025 /PRNewswire/ -- Pangea, a leading provider of AI security guardrails, today released findings from its global $10,000 Prompt Injection Challenge conducted in March 2025 ...

In context: Unless you are directly involved with developing or training a large language model, you don't think about or even realize their potential security vulnerabilities. Whether it's providing ...