When Salesforce recently rolled out an AI agent on its website, the agent started to hallucinate and wasn’t giving consistent results.

Salesforce ended up temporarily turning it off, Shibani Ahuja, senior vice president of enterprise IT strategy, said during a roundtable discussion at Fortune ’s Brainstorm Tech conference in Park City, Utah.

But the agent, it turned out, wasn’t the problem. “What we had noticed was there was an underlying problem with our data,” Ahuja said. When her team investigated what had happened, they found that Salesforce had published contradictory “knowledge articles” on its website.

“It wasn’t actually the agent. It was the agent that helped us identify a problem that always existed,” Ahuja said. “We turned it into an auditor agent that actually checked ou

See Full Page