Intermediated Reality (IR) allows the simultaneous usage of entities that come to life in Augmented Reality enabling them to collaborate and have fun together remotely. This real-world object acts as an intermediary who reproduces recorded interactions made by the sender. Seamless appearance of the physical deformed object is preserved using texture deformation.
By augmenting the camera feed with our reconstructed appearance of the object in a deformed shape, we perform the illusion of movement for real-world static objects, remotely. This method achieves an illusion of movement from the real-world object through image retargeting techniques in real-time.
Shadow Retargeting maps real shadow appearance to virtual shadows given a corresponding deformation of scene geometry such that appearance is seamlessly maintained. By performing virtual shadow reconstruction from un-occluded real shadow samples observed in the camera frame, we recover the deformed shadow appearance efficiently.
L. Casas and K. Mitchell. "Intermediated Reality with an AI 3D Printed Character". SIGGRAPH '23: ACM SIGGRAPH 2023 Real-Time Live!. 2023. Association for Computing Machinery, New York, NY, USA, Article 5, 1–2.
L. Casas and K. Mitchell. "Intermediated Reality: A Framework for Communication through Tele-Puppetry". Frontiers in Robotics and Artificial Intelligence - Special issue "Collaboration in Mixed-Reality" 2019.
L. Casas, M. Fauconneau, M. Kosek, K. Mclister, and K. Mitchell, “Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses”, Computers, vol. 8, no. 2, p. 29, Apr. 2019.
L. Casas*, L. Ciccone*, G. Çimen, P. Wiedemann, M. Fauconneau, R. W. Sumner and K. Mitchell. "Multi-reality games: an experience across the entire reality-virtuality continuum". In Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI '18). Tokyo, Japan. 2018. Article 18, 1–4.
L. Casas, M. Fauconneau, M. Kosek, K. Mclister, and K. Mitchell, "Image Based Proximate Shadow Retargeting", In Proceedings of the Conference on Computer Graphics & Visual Computing (CGVC '18), Swansea, Wales, UK, 2018, Eurographics Association, pp. 43–50.
L. Casas, M. Kosek and K. Mitchell, "Props Alive: A Framework for Augmented Reality Stop Motion Animation", 2017 IEEE 10th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Los Angeles, CA, USA, 2017, pp. 1-4.
L. Casas and K. Mitchell. 2019. US20220068010A1 (Patent Pending).
Dr. Llogari Casas and Professor Kenny Mitchell co-founded 3FINERY LTD with a host of top notch advisors and partners. We are an independent spinout of Edinburgh Napier University in the context of more than 7 years of research on advanced audio and visual immersive avatar communication technologies. If you would like to find out more about how we can help you and your business, please get in touch with us.
