Microsoft launches tools to try and stop people messing with chatbots
Microsoft has launched a suite of new tools within Azure aimed at boosting the safety and security of generative AI applications, with a special focus on chatbots.
The tools are hoped to help organizations mitigate various risks associated with the deployment of generative AI, including concerns about abusive content and prompt injections.
The latest offerings include features like real-time monitoring to track and shut down abusive content or users as well as protections against new attack vectors like jailbreaks and prompt injections.
Microsoft boosts chatbot security
According to a recent McKinsey survey, nine in 10 (91%) corporate leaders express feeling unprepared for the risks associated with generative AI despite the benefits it could have on their business in terms of productivity and efficiency.
Microsoft’s new tools aim to address these concerns, and are the culmination of technical innovation and research based on its own experience with in-house products like Copilot.
Microsoft’s multibillion-dollar investment in OpenAI has undoubtedly played an important role in this, unlocking various opportunities for research and experience in the AI landscape.
Prompt injections involve manipulating AI systems to generate harmful unintended content. Microsoft’s Prompt Shields is designed to block both direct and indirect prompt attacks. The tool relies on advanced machine learning algorithms and natural language processing to analyze prompts and third-party data for potentially malicious intent.
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
As well as addressing security concerns, Microsoft’s latest tools are also hoped to improve the reliability of generative AI applications by automatically evaluating them through stress testing to ensure that risks like jailbreaks are minimized.
Another prominent update, real-time monitoring, is designed to let developers track inputs and outputs that trigger safety features, allowing them to tweak the back end and adjust content filter configurations to improve safety more manually.
It seems that every AI-related announcement Microsoft has made in recent months has affirmed its commitment to responsible and safe AI, and these latest tools are certainly a testament to that.
More from TechRadar Pro
Microsoft has launched a suite of new tools within Azure aimed at boosting the safety and security of generative AI applications, with a special focus on chatbots. The tools are hoped to help organizations mitigate various risks associated with the deployment of generative AI, including concerns about abusive content and…
Recent Posts
- Microsoft launches Phi-3, its smallest AI model yet
- Could ChatGPT be the next big cybersecurity worry — researchers say it can crack systems faster than ever before
- Meta Quest’s software is coming to new Asus ROG and Lenovo headsets
- Sony’s wearable air conditioner is the first step towards a real Dune stillsuit
- Fortnite will let players hide mean emotes
Archives
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- December 2011