AI personas and synthetic users: Fast research or risky illusion?

10.9.2025

Today, AI can simulate virtual users—with profiles, interviews, and feedback at the touch of a button. For many companies, this sounds like a gain in efficiency. But how useful are AI personas really, and what are their limitations?

Reading time:
minutes

This article was written by:

Yann Metzmacher

User research – the systematic investigation of user needs – is now an essential part of good UX and product development. Interviews, tests, and observations help to understand real requirements, identify priorities, and develop relevant solutions. But this process takes time and money – two resources that are in short supply in many projects.

This is where a new trend comes in: AI personas and so-called synthetic users. They promise to make target groups quickly accessible and deliver research results in minutes instead of weeks. But does this approach deliver what it promises?

What's behind it?

AI personas are created using generative models such as ChatGPT, Gemini, or specialized platforms. When you enter a rough description of your target audience, the AI generates typical parameters such as age, income, habits, values, or social media behavior. This results in profiles that serve as representatives of a target audience. With the right prompt wording, these personas can also be fine-tuned and condensed.

Synthetic users go one step further. They generate not only profiles, but also entire interviews. When you enter a research question, these virtual users respond like real interview partners – including biographical details and pre-formulated statements.

At first glance, such results are reminiscent of classic research artifacts. But unlike real personas or interviews, they lack the human context of experience and observation.

The market research and marketing software Delve AI creates synthetic users with realistic profiles – including demographics, behavior, and interests. © Delve AI

The advantages: speed and entry assistance

  • Efficiency: Personas or interviews can be created in minutes instead of weeks.
  • Cost advantage: A clear advantage, especially for smaller projects or tight budgets.
  • Basis for discussion: Virtual users help to structure hypotheses and involve teams in discussions.
  • Low barrier to entry: Projects can be started quickly, even if there is little prior knowledge about target groups.
  • Broad applicability: Particularly useful when entering new markets or topics and making initial assumptions visible.

For B2B companies with complex products and long decision-making cycles, this quick start can help outline initial requirements and prepare workshops.

Delve AI integrates with Slack: questions to synthetic users are answered directly in the chat and provide immediately actionable insights. © Delve AI

The limits: Why real people remain irreplaceable

However, research by the Nielsen Norman Group (NN/g) – an internationally recognized consulting institute for usability and user experience – shows how distorted the results of synthetic users can be.

  • Overly positive responses (“sycophancy”): In one study, synthetic users reported having successfully completed all online courses. Real participants, on the other hand, reported dropouts, lack of time, and motivation problems. Differences were also evident in forum activities: Real users often found discussion forums to be of little use, while synthetic users highlighted them as a key component.
  • Lack of prioritization: AI personas cite numerous needs – interactivity, personalization, flexibility – but all appear to be equally important. Real users, on the other hand, clearly weigh and prioritize, which is crucial for product decisions.
  • No real experiences: AI cannot use products. Stories seem plausible but remain generic. Nuances and contextual factors that shape human behavior are lost.
  • Risky concept testing: If you ask synthetic users whether a drone delivery service for medication would be useful, the answer is almost always positive – “faster, more efficient, more modern.” Real users, on the other hand, would raise safety concerns, cost issues, or practical hurdles.
  • Organizational risks: Especially in companies with low UX maturity, there is a danger that virtual users will be misunderstood as a substitute for real research. This threatens to lead to wrong product decisions and a devaluation of user research practice as a whole.

Best cases: Where synthetic users could be used effectively

Synthetic users are no substitute for real interviews – but when used correctly, they can provide valuable services. We have put together a few potential scenarios for you:

  • E-commerce load testing: Before Black Friday, an online store simulates tens of thousands of simultaneous purchase processes. Synthetic users help to identify system limitations early on and prevent failures.
  • Banking app under heavy load: A bank uses synthetic logins and transactions to test whether the system remains stable on days with unusually high traffic – such as at the beginning of the month.
  • Healthcare training without patient data: A health app trains chatbots with synthetic patient dialogues without having to use sensitive patient data.
  • UX prototyping in an international context: An e-learning provider simulates how user groups from different countries interact with learning platforms.
  • Marketing pre-tests: A company creates synthetic target group segments and tests campaign variants before rolling them out to real target groups.

A real-world example: A leading US insurer uses Dynatrace Synthetic Monitoring to continuously test critical applications. Simulated logins and transactions check availability and performance – and report problems before real users are affected. In addition, the company uses synthetic tests on its competitors' login pages to compare its own performance in the market environment.

Is fake research better than no research at all?

When resources for real interviews are lacking, synthetic research can be a helpful starting point. However, there is a risk that inaccurate results will be accepted without verification – or that teams will become accustomed to quick availability and permanently dispense with real research. Exclusively using synthetic research can therefore prove to be a mistake in the long term.

AI personas and synthetic users are tools with potential, but they must not be misunderstood. They are suitable for initiating projects more quickly, visualizing hypotheses, and activating teams. However, they cannot replace the depth, empathy, and authenticity that only direct contact with real people can provide.

Three recommendations for B2B companies

1. Use synthetic users for getting started and forming hypotheses, but always validate results with real research.

2. Use them where scaling and monitoring are required – for example, for load testing or market benchmarking (i.e., systematic performance comparison with competitors).

3. Avoid using synthetic users as the sole basis for decision-making in critical projects – they are a supplement, not a substitute.

Contact us

Would you like to know how your company can use AI to complement user research in a meaningful way? Uhura Digital supports you with strategy, research expertise, and the development of digital experiences that really reach users. Contact us for a no-obligation initial consultation.