Microsoft opens access to its security testing tool for language models

called PyRIT (Python Risk Identification Toolkit), the tester can be used to evaluate the results of language models for hallucinations, biases, and prohibited content generation.

AI chatbots can also have 'hallucinations'; understand

On Valentine's Day this year, reporter Kevin Roose had a disturbing interaction with the chatbot integrated into Google's artificial intelligence (AI)-powered search engine. Microsoft, Bing. Know more!

It can also identify possible ways to use the model, such as generating malware and jailbreaking, as well as potential privacy harms such as identity theft.

The tool automates 'red team' tasks by sending malicious warnings. When it receives a response, it scores the model and sends a new prompt to provide further testing.

A Microsoft used PyRIT to test one of its assistant systems Copilot AI, generating thousands of malicious prompts to assess your ability to deal with nefarious inputs. Using PyRIT, the testing process was completed in a matter of hours. Normally, testing would take weeks.

Microsoft lance Copilot Pro with new AI features; know more

A Microsoft presents the Copilot Pro, a premium subscription that enhances the gaming experience Copilot with advanced features.

A Microsoft said he opened PyRIT in hopes of empowering security professionals and machine learning engineers to find risks in generative security systems. artificial intelligence.

“This allows them to have empirical data on how their model is performing today and detect any performance degradation based on future improvements,” says the PyRIT GitHub page.

Read also

Humane offers free months of AI Pin to compensate for delays

Humane announced that its AI Pin would begin shipping in March, but there was a slight delay. Early adopters are now being told that orders will arrive in mid-April at the earliest, according to a video update from Humane employee Sam Sheffer.

Looking for an Artificial Intelligence tool to make your life easier? In this guide, you browse a catalog of AI-powered robots and learn about their functionalities. Check out the evaluation that our team of journalists gave them!