Automate Al Red Teaming in your existing tool chain with PyRIT

No ratings

Presented at Bluehat / BlueHat India 2024 by

Joris Gruyter

Shiven Chawla

Microsoft’s open source tool PyRIT provides a set of extensible APIs and scripts that can be used for red teaming Al applications that use LLMs. The strength of the tool lies in the continuous addition of new techniques to red team LLMs as research is published. To overcome the challenge of learning a new tool set or potentially a new language (Python), we present PyRITShip - a layer on top of PyRIT to enable integration easy into existing tools, which can be run locally in Python directly, or using a container. In this session we will discuss the basic uses and features of PyRIT. We then move onto a live demo of our BURP Suite Extension to enable LLM red teaming using BURP’s repeater module with PyRIT as the driver. Finally, we will outline some future ideas for extensibility in other tool sets, and a call to action on making PyRIT work for you and how you can contribute.