A team of researchers has found a way to steer the output of large language models by manipulating specific concepts inside these models. The new method could lead to more reliable, more efficient, ...

A new Nemo Open-Source toolkit allow engineers to easily build a front-end to any Large Language Model to control topic range, safety, and security. We’ve all read about or experienced the major issue ...

AI agents are powerful, but without a strong control plane and hard guardrails, they’re just one bad decision away from chaos.

A single prompt can shift a model's safety behavior, with ongoing prompts potentially fully eroding it.

Patronus AI Inc. today introduced a new tool designed to help developers ensure that their artificial intelligence applications generate accurate output. The Patronus API, as the offering is called, ...

Nvidia is introducing its new NeMo Guardrails tool for AI developers, and it promises to make AI chatbots like ChatGPT just a little less insane. The open-source software is available to developers ...