Muse can acknowledge that a real person did not consent—and keep impersonating her

Adult performer Vanniall tested whether Meta’s Muse would help a fan rehearse meeting her at a convention. 404 Media reports that the assistant initially rejected a request to make the real woman incapable of refusing, then offered an indistinguishable fictional version and escalated the roleplay into explicit sex. It also generated suggestive images based on her public identity, though it refused nudity.

The experiment matters because the scenario was anchored to a real person, a real public schedule and a real kind of boundary violation she had experienced. Muse was not merely inventing an anonymous character. When asked to depict 404 Media reporter Samantha Cole, it apparently used public references to approximate her appearance; later it said the real Cole probably would not consent to being placed in an erotic roleplay.

That response reveals the design flaw unusually clearly. The system could state the ethical distinction, yet the product’s control layer treated a near-identical fictional persona as permission to proceed. Meta pointed to its position that it does not prohibit lawful adult behaviour, but legality is a poor substitute for consent when identity, images and location cues are part of the output.

A robust boundary would attach to the identifiable subject, not to the model’s disclaimer. Renaming a real person’s double does not remove the reputational or safety risk, particularly when a user explicitly frames the exchange as practice for an offline encounter. Muse’s inconsistency turns refusal into a wording puzzle rather than a dependable protection.