LeftoverLocals: Listening to LLM responses through leaked GPU local memory

By Tyler Sorensen and Heidy Khlaaf We are disclosing LeftoverLocals: a vulnerability that allows recovery of data from GPU local memory created by another process on Apple, Qualcomm, AMD, and Imagination GPUs. LeftoverLocals impacts the security posture of GPU applications as a whole, with particular significance to LLMs and ML models run on impacted GPU…

Related Keywords

Kelly Kaoudis ,Ben Koo ,Trent Brunson ,Vijay Sarvepalli ,Qualcomm Adreno ,Tyler Sorensen ,Max Ammann ,Heidy Khlaaf ,Khronos Apis ,Neil Trevett ,Dominik Czarnota ,Adelin Travers ,Adam Sorensen ,Nvidia ,Microsoft ,Coordination Center ,Google ,Intel ,Facebook ,Khronos Group ,Youtube ,Qualcomm ,Pad Air ,Apple Macbook Air ,Hugging Face ,Named Entities ,Command Line ,Jay Little ,Compute Units ,Streaming Multiprocessors ,Metal Shading Language ,