Haptic Cinematography

Haptic technology, stimulating the sense of touch, is used for years in virtual reality and teleoperation applications for enhancing the user immersion. Yet it is still underused in audiovisual systems such as movie theaters. The objective of this thesis was thus to exploit the potential of haptics for audiovisual content. In the first part of this Ph.D. thesis, we address the haptic rendering in videoviewing context. We first present a new device providing 6 degrees of freedom motion effects. Instead of moving the whole user’s body, as it is traditionally done with motion platform, only the head and hands are stimulated. This device allows thus to enrich the audiovisual experience. Then we focus on the haptic rendering of haptic-audiovisuals. The combination of haptic effects and video sequences yields new challenges for the haptic rendering. We introduce a new haptic rendering algorithm to tackle these issues.The second part of this Ph.D. is dedicated to the production of haptic effects. We first present of novel authoring tool. Three editing methods are proposed to createmotion effects and to synchronize them to a video. Besides, the tool allows to preview motion effects thanks to a force-feedback device. Then we study combinations of haptic feedback and audiovisual content. In a new approach, the Haptic Cinematography, we explore the potential of haptic effects to create new effects dedicated to movie makers.

Danieau, F. (2014). Contribution to the study of haptic feedback for improving the audiovisual experience [PhD thesis]. Rennes 1.

Papers

Danieau, F., Lécuyer, A., Guillotel, P., Fleureau, J., Mollet, N., & Christie, M. (2014). A Kinesthetic Washout Filter for Force-Feedback Rendering. IEEE Transactions on Haptics, 8(1), 114–118. https://doi.org/10.1109/TOH.2014.2381652

Danieau, F., Fleureau, J., Guillotel, P., Mollet, N., Christie, M., & Lécuyer, A. (2014). Toward haptic cinematography: enhancing movie experiences with camera-based haptic effects. IEEE MultiMedia, 21(2), 11–21. https://doi.org/ 10.1109/MMUL.2013.64

Danieau, F., Lécuyer, A., Guillotel, P., Fleureau, J., Mollet, N., & Christie, M. (2012). Enhancing audiovisual experience with haptic feedback: a survey on HAV. IEEE Transactions on Haptics, 6(2), 193–205. https://doi.org/ 10.1109/TOH.2012.70

Danieau, F., Fleureau, J., Cabec, A., Kerbiriou, P., Guillotel, P., Mollet, N., Christie, M., & Lécuyer, A. (2012). Framework for enhancing video viewing experience with haptic effects of motion. 2012 IEEE Haptics Symposium (HAPTICS), 541–546. https://doi.org/10.1109/HAPTIC.2012.6183844

Danieau, F., Fleureau, J., Guillotel, P., Mollet, N., Lécuyer, A., & Christie, M. (2012). HapSeat: producing motion sensation with multiple force-feedback devices embedded in a seat. Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, 69–76. https://doi.org/10.1145/2407336.2407350

Danieau, F., Bernon, J., Fleureau, J., Guillotel, P., Mollet, N., Christie, M., & Lécuyer, A. (2013). H-Studio: an authoring tool for adding haptic and motion effects to audiovisual content. Proceedings of the Adjunct Publication of the 26th Annual ACM Symposium on User Interface Software and Technology, 83–84. https://doi.org/10.1145/2508468.2514721

Guillotel, P., Danieau, F., Fleureau, J., Rouxel, I., Christie, M., Galvane, Q., Jhala, A., & Ronfard, R. (2016). Introducing Basic Principles of Haptic Cinematography and Editing. WICED, 15–21. https://doi.org/10.2312/wiced.20161096

Videos

Award

First Prize of the “Fondation Rennes 1” for my PhD thesis

Press

France Bleu. April 2015. Un siège haptique développé à Rennes pour le cinéma du futur (Fr)
Rennes Atalante. April 2015. Un doctorant d’inria rennes reçoit un prix (Fr)
Ouest-France. April 2015. Un jeune chercheur récompensé pour son siège haptique (Fr)
France 2. March 2015. Un doctorant d’Inria Rennes reçoit un prix pour sa thèse sur le cinéma haptique (Fr)
Technicolor. July 2013. Motion Sensations Simulator (En)
Inriality. April 2013. Cinéma : ça va bouger près de chez vous (Fr)
Clubic. April 2013. CHI 2013 : la technologie revisite les interfaces homme-machine (Fr)
Huffingtonpost. April 2013. Hapseat, le fauteuil de cinéma de demain présenté à CHI 2013 (Fr)
NewScientist. December 2012. Gaming chair mimics a full-motion simulator (En)