Solved Hackers can hide AI prompt injection attacks in resized images


Borg 386

Well-known member
Power User
VIP
Local time
6:15 PM
Posts
3,417
Location
In a crazy house with a cat trying to kill me
OS
Win 11 Pro, Win 10 pro, Win 13.7 Pro Chinese Ver
A new method of hiding instructions for "AI" systems takes advantage of how images are compressed when uploaded.

In the example highlighted by Trail of Bits and BleepingComputer, an image is delivered to a user, the user uploads the image to Gemini (or uses something like Android’s built-in circle-to-search tool), and the hidden text in the image becomes visible as Google’s backend compresses it before it’s “read” to save on bandwidth and processing power. After being compressed, the prompt text is successfully injected, telling Gemini to email the user’s personal calendar information to a third party.

 

My Computer My Computer

At a glance

Win 11 Pro, Win 10 pro, Win 13.7 Pro Chinese Ver12th Gen Intel(R) Core(TM) i9-12900 2.40 GHz64.0 GB of transcendental dimensional RAMNVIDIA GeForce RTX 3070 Ti
OS
Win 11 Pro, Win 10 pro, Win 13.7 Pro Chinese Ver
Computer type
PC/Desktop
Manufacturer/Model
It's a Dell Dude
CPU
12th Gen Intel(R) Core(TM) i9-12900 2.40 GHz
Motherboard
Father is bored too...
Memory
64.0 GB of transcendental dimensional RAM
Graphics Card(s)
NVIDIA GeForce RTX 3070 Ti
Sound Card
N/A
Monitor(s) Displays
27" Samsung Monitor/Alternative Dimensional Viewing Portal
Screen Resolution
Fuzzy after a couple drinks
Hard Drives
2 or 3, depending on if it's a night they're arguing about having a "split personality crisis" because I partitioned the drive.
PSU
Shockingly active
Case
Don't get on my case....man
Cooling
Scotch on the rocks on the weekends.
Keyboard
Steel Series Lighted Glow in the dark something or another
Mouse
Currently being stalked by the cat...
Internet Speed
DSL
Browser
Defeated by Mario...wait...OH...BRowser...
Antivirus
Yep
Back
Top Bottom