LeftoverLocals: Listening to LLM responses through leaked G

By Tyler Sorensen and Heidy Khlaaf We are disclosing LeftoverLocals: a vulnerability that allows recovery of data from GPU local memory created by another process on Apple, Qualcomm, AMD, and Imagination GPUs. LeftoverLocals impacts the security posture of GPU applications as a whole, with particular significance to LLMs and ML models run on impacted GPU…

Related Keywords

Kelly Kaoudis , Ben Koo , Trent Brunson , Vijay Sarvepalli , Qualcomm Adreno , Tyler Sorensen , Max Ammann , Heidy Khlaaf , Khronos Apis , Neil Trevett , Dominik Czarnota , Adelin Travers , Adam Sorensen , Nvidia , Microsoft , Coordination Center , Google , Intel , Facebook , Khronos Group , Youtube , Qualcomm , Pad Air , Apple Macbook Air , Hugging Face , Named Entities , Command Line , Jay Little , Compute Units , Streaming Multiprocessors , Metal Shading Language ,