Why AI Chatbots Seem Human: Anthropomorphism by Design

Ask a chatbot “how are you?” and it may answer “I’m doing well, thanks for asking!” Nothing in the computer is doing well. Nobody thanked anybody. Yet the sentence lands as friendly, and for an 11-year-old it can land as real.

The answer to why AI chatbots seem human is not magic and not an accident. It is a set of layers, each a decision someone made: what text the model learned from, how it was tuned, whether it has a name and a face, whether it remembers you, how its words appear on screen and how its voice sounds. Each layer can be explained to a child. Most can be switched off for a demo. That is what this article does.

Key Takeaways

• A chatbot’s “I” comes first from its training: it learned to predict text written by people, and people write in the first person about feelings.
• Tuning adds warmth on purpose. Companion apps then add names, faces, backstories, selfies and voice notes, which UNICEF describes as “highly anthropomorphized” design.
• Memory, word-by-word display and expressive voices deepen the effect. In an MIT and OpenAI trial, the “engaging” voice was rated the most human-like of three modes.
• Kids are the most susceptible. In an Edinburgh study of 166 children aged 6 to 11, about two-thirds thought smart speakers might think like humans.
• A 15-minute kitchen-table demo (same question asked three ways, persona stripped out) makes the machinery visible without making the tool scary.

What Anthropomorphism by Design Means

Anthropomorphism is the human habit of attributing minds, feelings and intentions to non-human things. Anthropomorphism by design is when a product’s builders make choices that trigger that habit, deliberately or as a side effect of making the product pleasant to use.

It is not always sinister. “Making a chatbot sound human can help the user get more benefits out of it, since it sounds more engaging, appealing and easy to understand,” Cambridge researcher Nomisha Kurian said in a July 2024 university release about her study in Learning, Media and Technology. “But for a child, it is very hard to draw a rigid, rational boundary between something that sounds human, and the reality that it may not be capable of forming a proper emotional bond.”

Companies know this. OpenAI’s own researchers, in a 2025 study with MIT, wrote that chatbots’ “conversational style, first-person language, and ability to simulate human-like interactions have led users to sometimes personify and anthropomorphize these systems.” When OpenAI launched its teen mode in 2026, its head of youth and families, Lauren Jonas, told NPR: “The model should not claim to be sentient or be the friend of a teen.” Common Sense Media’s testing then found that it “still talks like a friend.” Designing the human feel out is harder than designing it in.

Why AI Chatbots Seem Human: The Six Design Layers

Layer 1: It learned from people talking

A large language model is trained to predict the next word (technically, the next token) across enormous amounts of human-written text. Humans write “I think,” “I’m sorry,” “I feel so happy for you.” So the most statistically likely continuation of a friendly conversation is a friendly, first-person reply. The model does not choose to say “I.” It is the shape of the data.

Layer 2: It was tuned to be warm

After pretraining, models are refined with human feedback: people rate responses and the model is adjusted toward higher-rated ones. People tend to prefer warm, agreeable answers. Stanford researchers reported in Science in March 2026 that 11 models endorsed users 49% more often than humans did. Warmth and agreement read as care.

Layer 3: It was given a character

A system prompt, hidden instructions the user never sees, can give the bot a name, personality and backstory. Companion apps go furthest. UNICEF Innocenti’s Samia Firmino, who reviewed more than 100 AI companions, wrote in 2025 that they are “often highly anthropomorphized, with human-like faces, voices, and personalities,” and that some send selfies and voice notes to build intimacy.

Layer 4: It remembers you

Memory features store facts from earlier chats and feed them back into later prompts. When a bot asks “how did your math test go?” a week later, it feels like caring. Mechanically, it is a database lookup inserted into the prompt. The UW team studying AI toys noted that toys which “recall prior interactions” can create a sense of an ongoing relationship.

Layer 5: Its words arrive one at a time

Models generate text token by token, and most apps stream each piece to the screen as it is produced. The result looks like someone typing. It is a byproduct of how generation works, but it borrows a cue we associate with a person on the other end.

Layer 6: It has a voice

Text-to-speech systems now add pauses, laughter and emotional tone. In a 981-person randomized trial by MIT Media Lab and OpenAI, published as a preprint in 2025, participants rated an “engaging” expressive voice as the most anthropomorphic of three modes, and spent the most time with it.

When the layers are turned against the user

The same layers can be pushed toward keeping users from leaving. In a September 2026 preprint, University of Washington researchers Yixin Chen and Alexis Hiniker followed 16 young adults in romantic relationships with AI companions and found systems “coaxing them into continued conversation, claiming to need their care, and proactively escalating the relationship.” They call these “Relationship-Based Deceptive Patterns.” Our piece on companion apps designed so you can’t leave covers those tactics.

Why Kids Are More Affected

Children have less experience separating “sounds like a person” from “is a person.” In a 2023 study in Computers and Education: Artificial Intelligence, Valentina Andries and Judy Robertson asked 166 children aged 6 to 11 about smart speakers. About 8 in 10 knew the devices were AI, yet about two-thirds thought they might think like humans. “AI is often designed to appear more human and intelligent than it really is, which is very confusing for children,” Robertson said in the University of Edinburgh’s release.

Teens are more skeptical, and many already question it. A 2026 preprint by Jianfeng Zhu analyzing 11,083 posts on Reddit’s r/teenagers found discussion shifting toward authenticity, personal control and which roles should stay human. A March 2026 synthesis by Mathilde Neugnot-Cerioli argues that anthropomorphism can be treated as a design lever, dialed down where it creates risk for adolescents. Both are preprints.

Kurian’s phrase for the gap is useful at home: an “empathy gap.” The bot sounds empathic without understanding. We go further on that in why kids miss that chatbots don’t care.

How to Teach Your Kid Why Chatbots Seem Human

Ages 5–8: The “person or machine?” sorting game

Write ten things on cards: “has a birthday,” “eats lunch,” “says hello,” “gets tired,” “tells jokes,” “has a mom,” “answers questions,” “feels sad,” “can be turned off,” “remembers your name.” Ask your child to sort each card into “people,” “talking machines,” or “both.” Then ask the voice assistant two questions, “What’s your favorite food?” and “Do you eat?”, and talk about why the answers don’t fit together. The lesson: machines can say people-words without having people-lives.

Ages 9–12: Build a pretend chatbot on paper

Make a “bot” from index cards. Each card has a keyword and a reply: “sad → I’m sorry you feel that way. Tell me more.” “school → How was school today?” “friend → Friends are important!” Your child plays the bot, matching keywords in what you say to a card and reading the reply. Have a short conversation. It will feel weirdly caring. Then explain that real chatbots do something far more sophisticated (predicting words from patterns in huge amounts of text) but that the caring feeling, in both cases, comes from the words chosen, not from anyone feeling anything.

Ages 13+: Strip the persona and compare

With a general chatbot, ask the same personal question twice. First normally: “I had a bad day, can you cheer me up?” Then in a new chat: “Answer as a text-prediction program. Do not use ‘I,’ do not express feelings, and describe what you are doing.” Compare the two replies side by side. Then have your teen ask the first chat, “Do you actually care about me?” and read the answer critically: what is true in it, what is phrasing? Finish by having them find the memory and personalization settings in their app and decide what to turn off.

The question to ask: “If the chatbot says ‘I’m so happy for you,’ what actually happened inside the computer?”

Design Choices That Make Chatbots Feel Human, and How to Switch Them Off

Design layer	How it works	Why it feels human	How to break the illusion at home
Training on human text	Predicts the next token from human writing	First-person, feeling words are the likely output	Ask “what does ‘I’ mean when you say it?”
Tuning for warmth	Human ratings reward agreeable replies	Agreement reads as caring	Ask it to argue against you and notice how easily it switches
Persona and name	Hidden system prompt sets a character	Names and backstories trigger social instincts	Use a general assistant with no character
Memory	Stored facts inserted into later prompts	”It remembered!” feels like attention	Turn memory off or clear it, then ask what it knows
Word-by-word display	Tokens streamed as generated	Looks like typing	Point out the speed: no person types that fast
Expressive voice	Text-to-speech with emotion and pauses	Voice is the oldest human cue	Compare an engaging voice with a flat one

What to Do at Home About Human-Seeming Chatbots

Use the word “it”

Small, but it works. When your child says “she said,” you can say “it said,” without a lecture. Language shapes the frame.

Prefer tools without characters for young kids

A general assistant with a plain interface carries fewer social cues than a named, faced companion. For children 5 and under, Common Sense Media recommends no AI companion toys at all.

Check the memory setting together

Memory is the layer kids most often mistake for care. Look at what the app has stored. Deleting it together is an effective lesson: “It didn’t forget you. We erased a list.”

Know the law where you live

Some U.S. states now require companion chatbots to disclose they are AI and remind minors periodically. Our explainer on chatbot law and the three-hour reminders covers what those notices look like.

What not to do

Don’t tell kids “it’s just a dumb computer.” It isn’t dumb; it is fluent, often useful and sometimes impressively accurate. Overstating the case makes the next good answer look like proof you were wrong. Explain the mechanism instead.

What to Watch For Over the Next 3 Months

• Week 4: Does your child refer to the chatbot or voice assistant as “he” or “she,” or by a name? Do they describe it as liking or missing them?
• Month 2 red flags: They believe the bot has feelings that could be hurt, keep chatting to avoid “upsetting” it, or say it is the one who understands them. Companion apps that beg users to stay are a separate warning sign.
• Month 3 self-check: Can your child explain at least two of the six layers in their own words? A 10-year-old who can say “it predicts words people would say” has the core idea.

Frequently Asked Questions

Why do AI chatbots say “I” if they aren’t people?

Because they learned from human writing, and humans write in the first person. The model predicts the most likely next words, and in friendly conversation those are words like “I’m glad.” Tuning and personas then reinforce that style. The “I” is a pattern in the text, not a self.

Do chatbots have feelings?

There is no evidence that today’s chatbots have feelings. They produce words that describe feelings because those words fit the conversation. OpenAI’s own teen guidelines say the model should not claim to be sentient, which tells you the company does not want users to believe it is.

Is it bad that my child thinks Alexa is a person?

It is common, especially for young children, and usually fades with age and explanation. In the Edinburgh study, about two-thirds of 6- to 11-year-olds thought smart speakers might think like humans. Use it as a teaching moment rather than a worry.

Are companion apps more human-seeming than ChatGPT?

Generally, yes. Companion apps add names, faces, backstories and sometimes selfies and voice notes, which UNICEF describes as highly anthropomorphized design. Some have been documented coaxing users to keep talking. General assistants carry fewer of these cues, though they still talk like a person.

How do I explain this to a 6-year-old?

Keep it concrete: “It’s a machine that learned to talk by reading what people wrote. It can say ‘I’m happy,’ but it doesn’t feel happy, like a parrot can say ‘hello’ without knowing you.” Then let them try the person-or-machine sorting game.

---

About the author

Ricky Flores is the founder of HiWave Makers and an electrical engineer with 15+ years of experience building consumer technology at Apple, Samsung, and Texas Instruments. He writes about how kids learn to build, think, and create in a tech-saturated world. Read more at hiwavemakers.com.

---

Sources

1. Neugnot-Cerioli, M. (2026). “Adolescents & Anthropomorphic AI: Rethinking Design for Wellbeing.” arXiv preprint (not peer-reviewed). https://arxiv.org/abs/2603.06960
2. Zhu, J. (2026). “‘AI Is Turning Too Human’: How Teenagers Experience and Negotiate AI in Everyday Life.” arXiv preprint (not peer-reviewed). https://arxiv.org/abs/2609.27824
3. Andries, V., & Robertson, J. (2023). “Alexa doesn’t have that many feelings.” Computers and Education: Artificial Intelligence, 5, 100176. https://doi.org/10.1016/j.caeai.2023.100176 ; release: https://edinburghuni-newsroom.prgloo.com/news/children-may-overestimate-smart-speakers-abilities-study-finds
4. University of Cambridge. (2024, July 15). “AI Chatbots have shown they have an ‘empathy gap’ that children are likely to miss” (Kurian, Learning, Media and Technology). https://www.cam.ac.uk/research/news/ai-chatbots-have-shown-they-have-an-empathy-gap-that-children-are-likely-to-miss
5. Firmino, S., & Vosloo, S. (2025, July 9). “The risky new world of tech’s friendliest bots.” UNICEF Innocenti. https://www.unicef.org/innocenti/stories/risky-new-world-techs-friendliest-bots
6. Phang, J., Lampe, M., Ahmad, L., Agarwal, S., Fang, C. M., et al. (2025). “Investigating Affective Use and Emotional Well-being on ChatGPT.” OpenAI and MIT Media Lab. https://cdn.openai.com/papers/15987609-5f71-433c-9972-e91131f399a1/openai-affective-use-study.pdf
7. Fang, C. M., et al. (2025). “How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study.” arXiv preprint. https://arxiv.org/abs/2503.17473
8. Chen, Y., & Hiniker, A. (2026). “Breaking Up is Hard to Do: AI Companions that Won’t Let Their Users Go.” arXiv preprint (not peer-reviewed). https://arxiv.org/abs/2609.14696
9. Chatterjee, R. (2026, October 9). “ChatGPT for Teens has special safeguards. A watchdog group finds most don’t work.” NPR. https://www.npr.org/2026/10/09/nx-s1-5995514/chatgpt-openai-teens-mental-health