Special Issue: Artificial Intelligence Across the Communication Stack: Engineering, Human Interaction, and Governance in the 6G Era
Vol. 2 (2026)
Affective Dimensions of Trust in AI-Mediated Human Communication: Toward an Emotionally Intelligent Design Framework for Conversational Agents
Deputy Director, National Employment Service of Republic Serbia
Abstract
As large language model (LLM)-based conversational agents become embedded in everyday communication contexts, the affective dimensions of user-AI interaction have emerged as a critical engineering and governance concern. While cognitive trust is usually associated with perceived accuracy, reliability and transparency, affective trust refers to the emotionally mediated sense of comfort, warmth and relational security that users experience when interacting with an AI system. This paper examines the theoretical foundations of affective trust in human-AI communication and proposes the Affective Trust Engineering (ATE) framework as a structured design approach for emotionally intelligent conversational agents. In response to implementation-oriented gaps in the literature, the revised framework links affective trust dimensions to concrete AI communication system components, including affect detection, context modelling, prompt and policy orchestration, response generation, safety gating, audit logging and continuous evaluation. The paper also introduces a conceptual implementation diagram, a short research approach section, real-world application examples, and a completed reference base grounded in recent human-AI interaction, affective computing and AI governance literature. The central argument is that affective trust should be designed as a calibrated, bounded and measurable system output rather than treated as a diffuse by-product of pleasant interaction.
References
- Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for human-AI interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Paper 3. https://doi.org/10.1145/3290605.3300233
- Bickmore, T. W., & Picard, R. W. (2005). Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction, 12(2), 293-327. https://doi.org/10.1145/1067860.1067867
- Boine, C. (2023). Emotional attachment to AI companions and European law. MIT Schwarzman College of Computing, Social and Ethical Responsibilities of Computing. https://doi.org/10.21428/2c646de5.db67ec7f
- Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing the human: A three-factor theory of anthropomorphism. Psychological Review, 114(4), 864-886. https://doi.org/10.1037/0033-295X.114.4.864
- European Parliament and Council. (2024). Regulation (EU) 2024/1689 of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union.
- Feine, J., Gnewuch, U., Morana, S., & Maedche, A. (2019). A taxonomy of social cues for conversational agents. International Journal of Human-Computer Studies, 132, 138-161. https://doi.org/10.1016/j.ijhcs.2019.07.009
- Følstad, A., & Skjuve, M. (2019). Chatbots for customer service: User experience and motivation. Proceedings of the 1st International Conference on Conversational User Interfaces, Article 1. https://doi.org/10.1145/3342775.3342784
- Huang, M.-H., & Rust, R. T. (2024). The caring machine: Feeling AI for customer care. Journal of Marketing, 88(5), 1-23. https://doi.org/10.1177/00222429231224748
- Jakesch, M., Hancock, J. T., & Naaman, M. (2023). Human heuristics for AI-generated language are flawed. Proceedings of the National Academy of Sciences, 120(11), e2208839120. https://doi.org/10.1073/pnas.2208839120
- Johnson, D., & Grayson, K. (2005). Cognitive and affective trust in service relationships. Journal of Business Research, 58(4), 500-507. https://doi.org/10.1016/S0148-2963(03)00140-1
- Kasirzadeh, A., & Gabriel, I. (2023). In conversation with artificial intelligence: Aligning language models with human values. Philosophy & Technology, 36, 27. https://doi.org/10.1007/s13347-023-00606-x
- Laestadius, L., Bishop, A., Gonzalez, M., Illenčík, D., & Campos-Castillo, C. (2024). Too human and not human enough: A grounded theory analysis of mental health harms from emotional dependence on the social chatbot Replika. New Media & Society, 26(10), 5923-5941. https://doi.org/10.1177/14614448221142007
- Luger, E., & Sellen, A. (2016). Like having a really bad PA: The gulf between user expectation and experience of conversational agents. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5286-5297. https://doi.org/10.1145/2858036.2858288
- McAllister, D. J. (1995). Affect- and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal, 38(1), 24-59. https://doi.org/10.2307/256727
- Nass, C., & Moon, Y. (2000). Machines and mindlessness: Social responses to computers. Journal of Social Issues, 56(1), 81-103. https://doi.org/10.1111/0022-4537.00153
- National Institute of Standards and Technology. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1. U.S. Department of Commerce.
- Pentina, I., Hancock, T., & Xie, T. (2023). Exploring relationship development with social chatbots: A mixed-method study of Replika. Computers in Human Behavior, 140, 107600. https://doi.org/10.1016/j.chb.2022.107600
- Reeves, B., & Nass, C. (1996). The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press.
- Shanahan, M., McDonell, K., & Reynolds, L. (2023). Role play with large language models. Nature, 623, 493-498. https://doi.org/10.1038/s41586-023-06647-8
- Shum, H.-Y., He, X.-D., & Li, D. (2018). From Eliza to XiaoIce: Challenges and opportunities with social chatbots. Frontiers of Information Technology & Electronic Engineering, 19(1), 10-26. https://doi.org/10.1631/FITEE.1700826
- Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., Kenton, Z., Brown, S., Hawkins, W., Stepleton, T., Biles, C., Birhane, A., Haas, J., Rimell, L., Hendricks, L. A., Isaac, W., Legassick, S., Irving, G., & Gabriel, I. (2022). Taxonomy of risks posed by language models. Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, 214-229. https://doi.org/10.1145/3531146.3533088