Responsible AI Toolbox is an open-source effort at Microsoft for accelerating and operationalizing Responsible AI via a set of interoperable tools, libraries, and customizable dashboards. Recently, we released two new tools as part of the toolbox: 

- Responsible AI Mitigations: Python library for implementing and exploring mitigations for Responsible AI. 

- Responsible AI Tracker: JupyterLab extension for tracking, managing, and comparing Responsible AI mitigations and experiments. 

Both tools contribute to supporting a systematic and targeted process of model improvement by identifying, diagnosing, mitigating, and comparing failure modes. 

During the presentation we will delve into the new tooling additions and will illustrate their functionalities through a hands-on demonstration. In particular, we will show how insights extracted through Responsible AI Dashboard through the identification and diagnosis stage can then be used to ideate and implement different mitigation techniques via the Responsible AI Mitigations library. Finally, we will also demonstrate how different mitigation techniques can be compared and validated through Responsible AI Tracker directly on Jupyter Lab.   

Instructor's Bio

Besmira Nushi 

Principal Researcher at Microsoft

Her interests lie at the intersection of human and machine intelligence focusing on Reliable Machine Learning and Human-AI Collaboration. She has made practical and scientific contributions on implementing and deploying Responsible AI tools for debugging and troubleshooting ML systems. Currently, Besmira is leading the research behind several Responsible AI tools for debugging ML systems, such as Responsible AI Toolbox, Error Analysis, and BackwardCompatibilityML.

Rahee Ghosh Peshawaria

Senior Technical Program Manager at Microsoft

Rahee is a Senior Technical Program Manager in Microsoft Research who works on creating new tools that promote and enable responsible development of AI systems. Her other work is focused around data security and privacy. She earned her Master’s degree in Computer Engineering from Carnegie Mellon University.


  • 1

    ON-DEMAND WEBINAR: Responsible AI Mitigations and Tracker: New open-source tools for guiding mitigations in Responsible AI

    • Ai+ Training

    • Webinar recording

    • Welcome to ODSC East 2023 in Boston or virtually!