When the World Reads the Body: Legible Machine Perception in Adaptive Games
Most games still model the player as an input operator: movement, posture and affect count only once translated into commands. Body sensing and AI-driven adaptation promise richer perception, but every system that reads bodies reads them selectively. It misclassifies, lags and loses track, and in most designs these limits surface only as unexplained failure. As machines increasingly infer people's states from their bodies, games offer a space where being read can be noticed, understood and questioned.
This research treats partial perception as design material rather than noise. Our premise is that the world's way of reading the player should be legible and part of the fiction. For example, in a world whose inhabitants perceive only what moves, stillness becomes invisibility, and a depth camera losing a motionless player becomes a rule the player can discover and play with. To design such worlds coherently, we adapt the World Flaw Approach (McClung, 2026) [1], a worldbuilding method in which a single flaw recurs across a world's rules, factions, and characters; here, that flaw is one of perception.
Building on controller-free, full-body games we have developed for a shared, headset-free immersive space (a CAVE) [2], we will build research-through-design prototypes and compare legible and opaque versions of the same perceptual flaw over repeated sessions, extending our earlier work on diegetic feedback [3] and productive discomfort [4]. Our central question is open: does legibility widen players' bodily expression, or narrow it toward what the sensor rewards?
Expected outcomes are a design framework, a narrative-derived method for adaptive sensing systems, open prototypes and guidelines for responsible body sensing. The work is at an early stage, and we welcome discussion on measuring expressive repertoire and on the ethics of body sensing.
Keywords: embodied interaction, body sensing, legibility, adaptive games, responsible AI
[1] Kurt McClung. 2026. The World Flaw Approach. Workshop at AB/BA 2026: Animation in Business Conference, Syros, Greece. Retrieved October 5, 2026 from https://abba.aegean.gr/DownloadFiles/transmedia-writing.docx
[2] Anastasios Theodoropoulos, Dimitra Stavropoulou, Panagiotis Papadopoulos, Nikos Platis, and George Lepouras. 2023. Developing an Interactive VR CAVE for Immersive Shared Gaming Experiences. Virtual Worlds 2, 2 (2023), 162–181.
[3] Vasilis Vasileiadis, Anastasios Theodoropoulos, and George Lepouras. 2026. Enhancing Multisensory Experience in CAVE Virtual Reality Through Olfactory Sensing. Sensors 26, 12 (2026), 3910. https://doi.org/10.3390/s26123910
[4] Anastasios Theodoropoulos, Vasilis Vasileiadis, Angeliki Antoniou, and George Lepouras. In press. Designing for Reflective Play: Critical Comfort and the MobiCAVE. In Proceedings of iLRN 2026. Springer LNCS.
We are excited to invite you to the ACM GreekCHI-CYCHI Symposium 2026, held on November 6-7, 2026 jointly in Athens, Thessaloniki, Nicosia and Online.