Stray Dog

Meta's Muse Wonder ties for first in Visa shopping test

  • Good news: Muse Wonder ties for first in Visa's agentic shopping benchmark and placed a wrong order in only 2 of its 8 failures.
  • Bad news: It costs $1.55 a run against $0.54 for Gemini 4 Argon, which makes scaling hard in low-value shopping.
  • Bad news: Singapore's joint guidance names Muse and advises against linking agents to bank, government or health accounts, which narrows what users will allow.
Read the full notes

In Visa's agentic shopping benchmark, Muse Wonder ties for first place and is less likely to place a wrong order when it fails, but each run costs about three times as much as its rival. Singapore's joint guidance from three government agencies names Muse and advises against linking agents to bank, government or health accounts.

Read more

Third parties have vouched for the capability, but the contradiction remains: it is expensive, and users do not dare hand over control.

Key evidence

  • Visa press release, 5 Nov (first-hand): 22 models, 12 labs and 15 shopping scenarios. Models first had to talk through the buyer's needs and then decide whether to order. The overall pass rate was 57.2%, with a high of 82.2% and a low of 28.9%. Only 34.2% passed all three runs. In 54% of failed runs the model placed an order anyway.
  • Snapshot by model (Visa's October results, cited by FourWeekMBA and matching what a16z partner Olivia Moore posted; the Visa data page could not be opened for a direct check): Muse Wonder and Gemini 4 Argon tie for first, both passing 37 of 45 runs. Claude Fable 5.1 scored 75.6%. OpenAI's best, GPT-6 Astra, scored 64.4%, level with the free Muse Spark 1.3.
  • Behaviour on failure: Muse Wonder placed a wrong order in only 2 of its 8 failures. Gemini 4 Argon did so in 5 of 8. Claude Fable 5.1 placed an order in all 11 of its failures.
  • Cost: Muse Wonder costs $1.55 a run against $0.54 for Gemini 4 Argon. Per successful order that is $1.88 against $0.66, so Muse is about 2.9 times as expensive, but it is twice as fast (2.1 minutes against 4.3 minutes).
  • The test only went as far as deciding what to buy. It did not cover checkout or payment. Muse Wonder is open only to paying users.
  • On 6 Nov Singapore's Cyber Security Agency, GovTech and the Infocomm Media Development Authority jointly issued security guidance for personal AI agents (reference AD-2026-015). Channel NewsAsia's examples included Dots, Hermes, Muse, Grok Bot and OpenClaw. The Straits Times noted that the guidance came after Muse launched in Singapore.
Show 2 more
  • Main points of the guidance: connect only the apps that are needed; do not hand bank, government or health accounts to an agent; do not give out credit card numbers, passwords or one-time codes; complete verification yourself through Singpass; prefer 'confirm each time' to 'always allow'; do not rely on chat instructions alone to restrict an agent; and users are legally responsible for what their agents do.
  • Singapore is Muse's fourth market and its Asian showcase. The guidance is not binding, but it will narrow the scope users grant. Like Wells Fargo's terms (agent instructions count as the customer's own authorisation) and the University of Notre Dame's block, it pushes responsibility onto the user.

Catalysts to watch

  • Results from the next phase of the Visa benchmark (checkout and payment).
  • Changes to Muse Wonder pricing or cost structure (Zuckerberg has admitted Muse is compute-hungry, and S&P's outlook downgrade named costs).
  • Similar official guidance or bans appearing in markets other than Singapore.
  • Meta's product response to the limits on agent authorisation (making financial accounts less necessary).

Risks

  • Cost: each run costs about three times as much as the rival's, making it hard to scale in low-value shopping.
  • Tighter permissions: Singapore's guidance, Wells Fargo's terms, Notre Dame's block and users' legal liability together squeeze what Muse can do for users into low-risk shopping and travel tasks.
  • Third-party data has not been checked directly (the Visa data page could not be opened) and needs to be reviewed later.
  • The free Muse Spark 1.3 ties with GPT-6 Astra but is not the benchmark leader, so paid conversion depends on Wonder.

Sources 6

  1. Visa press release, 5 Nov 2026
  2. FourWeekMBA (citing Visa's October results)
  3. a16z, Olivia Moore, public data
  4. Singapore Cyber Security Agency, AD-2026-015 (6 Nov 2026)
  5. Channel NewsAsia (CNA)
  6. The Straits Times