-+ 0.00%
-+ 0.00%
-+ 0.00%

Visa benchmark finds AI models fail 42.8% of shopping tests

PUBT·11/05/2026 14:43:58
Listen to the news
Visa benchmark finds AI models fail 42.8% of shopping tests
  • Visa's new AI shopping benchmark found 42.8% of test runs failed across 22 models.
  • Purchases still occurred in 54% of failed runs, despite unmet customer requirements or incomplete discovery of customer needs.
  • Models passed all three attempts at a shopping scenario just 34.2% of the time, highlighting inconsistent performance.
  • Pass rates ranged from 28.9% for the worst-performing models to 82.2% for the best.
  • The five most expensive models averaged a 67.1% pass rate, versus 50.2% for the five least expensive.


Disclaimer: This news brief was created by Public Technologies (PUBT) using generative artificial intelligence. While PUBT strives to provide accurate and timely information, this AI-generated content is for informational purposes only and should not be interpreted as financial, investment, or legal advice. Visa Inc. published the original content used to generate this news brief via Business Wire (Ref. ID: 202611050943BIZWIRE_USPR_____20261105_BW169310) on November 05, 2026, and is solely responsible for the information contained therein.