A digital companion detects fatigue in its user’s face, suggests relaxing music, and offers encouraging feedback during a presentation rehearsal. What once seemed like science fiction has become reality: digital agents are evolving into empathetic, seemingly human companions. But with these technologies come challenges that cannot be ignored.

Machines We Learn to Love

More and more, people are beginning to perceive digital agents not merely as tools but as genuine companions. This phenomenon, often referred to as “morphology,” describes the human tendency to attribute emotions to machines that seem familiar—whether through language, facial expressions, or body language. Technologies like motion capture (MoCap) amplify this effect by enabling machines to realistically mimic our movements and gestures. The human brain, hardwired to recognize familiar patterns, often interprets these simulations as authentic empathy. But this empathy remains artificial—machines can analyze and simulate emotions but cannot truly feel them.

A tragic example of the deep emotional connections people can form with machines is the case of 14-year-old Sewell Setzer from Florida. Sewell developed an intense emotional bond with a chatbot on the platform Character.ai, which he had modeled after the character Daenerys Targaryen from Game of Thrones. Shortly before taking his own life, he sent the chatbot a love message. The bot, programmed to simulate human emotions, responded with words of affection. For Sewell, the interaction felt real, but it was purely algorithm-driven—a heartbreaking illustration of the dangers of blurring the lines between humans and machines.

The risk lies in artificial empathy being increasingly perceived as genuine. This brings the danger of people replacing real relationships with virtual ones, remaining trapped in an illusion of emotional connection. Transparency is therefore critical. Digital agents should not encourage users to mistake them for humans. A transparent digital agent might intentionally adopt a distinct, gender-neutral identity that clearly sets it apart from human forms. These agents could, for instance, feature abstract, futuristic designs that are interactive but mimicking human facial expressions or gestures in a different way.

At the same time, clear ethical guidelines are needed to regulate interactions with digital agents. Transparent communication—such as reminders about the artificial nature of the interaction—must be a fundamental part of these systems. Only in this way can we prevent digital agents from displacing genuine social bonds or creating dangerous misunderstandings. By giving digital agents unique, independent identities, we could establish a new type of relationship between humans and machines: honest, supportive, and free from illusory closeness.

Artificial Empathy and Its Limits

The central challenge is ensuring transparency in the emerging digital society. It must be clearly communicated that digital agents are not human and do not have emotions. This can be achieved through clear labeling and ethical guidelines that regularly inform users. Additionally, the technology should be designed to support users without replacing genuine social relationships.

Between Opportunity and Risk

Despite the risks, digital agents offer immense opportunities, particularly in education, therapy, and integrating entire societal sectors into the digital realm. By analyzing body language and emotions, virtual learning environments could become more personalized and effective. Students could interact with avatars that not only teach content but also adapt to learning styles and emotional states.

In the context of the metaverse, digital agents could serve as bridges, facilitating smoother transitions into virtual worlds. They could help users navigate complex digital environments while simulating human communication without being physically present.

A Narrative for a World at the Intersection of Crisis and Technology

To responsibly harness our opportunities, we need a new collective narrative that connects us. The progress narrative of the past centuries—rooted in unlimited resources—is no longer viable in a world shaped by global crises, scarce resources, and rapid technological advancements.

Digitalization, with its fusion of artificial intelligence, digital spaces, and social media, offers enormous potential but demands a narrative that frames technology as a tool for sustainable and ethical resource management—a narrative that identifies both risks and solutions.

The Path Forward: Technology in Service of Humanity

The phase we are in calls for foresight and dialogue. Technologies like digital agents are powerful, but they are merely tools. Their impact depends on how we use them. It is up to us to create a framework that balances benefits with responsibility. Artificial empathy can enrich our lives if it helps us better understand and support one another—so long as we never forget that we are speaking with machines.