Automatic Tool Invocation when Browsing with ChatGPT - Threats and Mitigations
Brief
In the previous post we demonstrated how instructions embedded in untrusted data can invoke ChatGPT’s memory tool. The examples we looked at included Uploaded Files , Connected Apps and also the Browsing tool.
When it came to the browsing tool we observed that mitigations were put in place and older demo exploits did not work anymore. After chatting with other security researchers, I learned that they had observed the same.