publications | Personal webpage

Journals

2023

FaceTuneGAN: Face autoencoder for convolutional expression transfer using neural generative adversarial networks

Olivier, Nicolas, Baert, Kelian, Danieau, Fabien and 2 more authors

Computers & Graphics 2023

Abs PDF

In this paper, we present FaceTuneGAN, a new 3D face model representation decomposing and encoding separately facial identity and facial expression. We propose a first adaptation of image-to-image translation networks, that have successfully been used in the 2D domain, to 3D face geometry. Leveraging recently released large face scan databases (FaceScape and CoMA), a neural network has been trained to decouple factors of variations with a better knowledge of the face, enabling facial expressions transfer and neutralization of expressive faces. Specifically, we design an adversarial architecture adapting the base architecture of FUNIT and using SpiralNet++ for our convolutional and sampling operations. Applied on these two datasets, FaceTuneGAN has a better identity decomposition and face neutralization than state-of-the-art techniques. It also outperforms classical deformation transfer approach by predicting blendshapes closer to ground-truth data and with less of undesired artifacts due to too different facial morphologies between source and target.

2021

Study on Automatic 3D Facial Caricaturization: from rules to Deep Learning.

Olivier, Nicolas, Kerbiriou, Glenn, Argelaguet, Ferran and 5 more authors

Frontiers on Virtual Reality 2021

Abs PDF

Facial caricature is the art of drawing faces in an exaggerated way to convey emotions such as humor or sarcasm. Automatic caricaturization has been explored both in the 2D and 3D domain. In this paper, we propose two novel approaches to automatically caricaturize input facial scans, filling gaps in the literature in terms of user-control, caricature style transfer, and exploring the use of deep learning for 3D mesh caricaturization. The first approach is a gradient-based differential deformation approach with data driven stylization. It is a combination of two deformation processes: facial curvature and proportions exaggeration. The second approach is a GAN for unpaired face-scan-to-3D-caricature translation. We leverage existing facial and caricature datasets, along with recent domain-to-domain translation methods and 3D convolutional operators, to learn to caricaturize 3D facial scans in an unsupervised way. To evaluate and compare these two novel approaches with the state of the art, we conducted the first user study of facial mesh caricaturization techniques, with 49 participants. It highlights the subjectivity of the caricature perception and the complementarity of the methods. Finally, we provide insights for automatically generating caricaturized 3D facial mesh.

2020

Towards Haptic Images: a Survey on Touchscreen-Based Surface Haptics.

Costes, Antoine, Danieau, Fabien, Argelaguet, Ferran and 2 more authors

IEEE Transactions on Haptics 2020

Abs PDF

The development of tactile screens opens new per-spectives for co-located image and haptic rendering, leading to theconcept of “haptic images”. They emerge from the combinationof image data, rendering hardware, and haptic perception. Thisenables one to perceive haptic feedback while manually exploringan image. This raises nevertheless two scientific challenges, whichserve as thematic axes of the state of the art in this survey.Firstly, the choice of appropriate haptic data raises a numberof issues about human perception, measurements, modelingand distribution. Secondly, the choice of appropriate renderingtechnology implies a difficult trade-off between expressivenessand usability.

2019

Touchy: A visual approach for simulating haptic effects on touchscreens

Costes, Antoine, Argelaguet, Ferran, Danieau, Fabien and 2 more authors

Frontiers in ICT 2019

Abs

Haptic enhancement of touchscreens usually involves vibrating motors producing limited sensations or custom mechanical actuators that are difficult to disseminate. In this paper, we propose an alternative approach called “Touchy,” where a symbolic cursor is introduced under the user’s finger, to evoke various haptic properties through changes in its shape and motion. This novel metaphor enables to address four different perceptual dimensions, namely: hardness, friction, fine roughness, and macro roughness. Our metaphor comes with a set of seven visual effects that we compared with real texture samples within a user study conducted with 14 participants. Taken together our results show that Touchy is able to elicit clear and distinct haptic properties: stiffness, roughness, reliefs, stickiness, and slipperiness.

2014

A Kinesthetic Washout Filter for Force-Feedback Rendering

Danieau, Fabien, Lécuyer, Anatole, Guillotel, Philippe and 3 more authors

IEEE transactions on haptics 2014

Abs PDF

Today haptic feedback can be designed and associated to audiovisual content (haptic-audiovisuals or HAV). Although there are multiple means to create individual haptic effects, the issue of how to properly adapt such effects on force-feedback devices has not been addressed and is mostly a manual endeavor. We propose a new approach for the haptic rendering of HAV, based on a washout filter for force-feedback devices. A body model and an inverse kinematics algorithm simulate the user’s kinesthetic perception. Then, the haptic rendering is adapted in order to handle transitions between haptic effects and to optimize the amplitude of effects regarding the device capabilities. Results of a user study show that this new haptic rendering can successfully improve the HAV experience.
Toward haptic cinematography: enhancing movie experiences with camera-based haptic effects

Danieau, Fabien, Fleureau, Julien, Guillotel, Philippe and 3 more authors

IEEE MultiMedia 2014

Abs PDF

Haptics, the technology which brings tactile or force-feedback to users, has a great potential for enhancing movies and could lead to new immersive experiences. This article introduces haptic cinematography, which presents haptics as a new component of the filmmaker’s toolkit. The authors propose a taxonomy of haptic effects and introduce new effects coupled with classical cinematographic motions to enhance the video-viewing experience. They propose two models to render haptic effects based on camera motions: the first model makes the audience feel the motion of the camera, and the second provides haptic metaphors related to the semantics of the camera effect. Results from a user study suggest that these new effects improve the quality of experience. Filmmakers can use this new way of creating haptic effects to propose new immersive audio-visual experiences.

2012

Enhancing audiovisual experience with haptic feedback: a survey on HAV

Danieau, Fabien, Lécuyer, Anatole, Guillotel, Philippe and 3 more authors

IEEE transactions on haptics 2012

Abs PDF

Haptic technology has been widely employed in applications ranging from teleoperation and medical simulation to art and design, including entertainment, flight simulation, and virtual reality. Today there is a growing interest among researchers in integrating haptic feedback into audiovisual systems. A new medium emerges from this effort: haptic-audiovisual (HAV) content. This paper presents the techniques, formalisms, and key results pertinent to this medium. We first review the three main stages of the HAV workflow: the production, distribution, and rendering of haptic effects. We then highlight the pressing necessity for evaluation techniques in this context and discuss the key challenges in the field. By building on existing technologies and tackling the specific challenges of the enhancement of audiovisual experience with haptics, we believe the field presents exciting research perspectives whose financial and societal stakes are significant.
The impact of human–robot interfaces on the learning of visual objects

Rouanet, Pierre, Oudeyer, Pierre-Yves, Danieau, Fabien and 1 more author

IEEE Transactions on Robotics 2012

Abs PDF

This paper studies the impact of interfaces, allowing nonexpert users to efficiently and intuitively teach a robot to recognize new visual objects. We present challenges that need to be addressed for real-world deployment of robots capable of learning new visual objects in interaction with everyday users. We argue that in addition to robust machine learning and computer vision methods, well-designed interfaces are crucial for learning efficiency. In particular, we argue that interfaces can be key in helping nonexpert users to collect good learning examples and, thus, improve the performance of the overall learning system. Then, we present four alternative human-robot interfaces: Three are based on the use of a mediating artifact (smartphone, wiimote, wiimote and laser), and one is based on natural human gestures (with a Wizard-of-Oz recognition system). These interfaces mainly vary in the kind of feedback provided to the user, allowing him to understand more or less easily what the robot is perceiving and, thus, guide his way of providing training examples differently. We then evaluate the impact of these interfaces, in terms of learning efficiency, usability, and user’s experience, through a real world and large-scale user study. In this experiment, we asked participants to teach a robot 12 different new visual objects in the context of a robotic game. This game happens in a home-like environment and was designed to motivate and engage users in an interaction where using the system was meaningful. We then discuss results that show significant differences among interfaces. In particular, we show that interfaces such as the smartphone interface allows nonexpert users to intuitively provide much better training examples to the robot, which is almost as good as expert users who are trained for this task and are aware of the different visual perception and machine learning issues. We also show that artifact-mediated teaching is significantly more efficient for robot learning, and equally good in terms of usability and user’s experience, than teaching thanks to a gesture-based human-like interaction.

Conferences

2022

Detailed Eye Region Capture and Animation

Kerbiriou, Glenn, Avril, Quentin, Danieau, Fabien and 1 more author

2022

Abs PDF

Even if the appearance and geometry of the human eye have been extensively studied during the last decade, the geometrical correlation between gaze direction, eyelids aperture and eyelids shape has not been empirically modeled. In this paper, we propose a data-driven approach for capturing and modeling the subtle features of the human eye region, such as the inner eye corner and the skin bulging effect due to globe orientation. Our approach consists of an original experimental setup to capture the eye region geometry variations combined with a 3D reconstruction method. Regarding the eye region capture, we scanned 55 participants doing 36 eyes poses. To animate a participant’s eye region, we register the different poses to a vertex wise correspondence before blending them in a trilinear fashion. We show that our 3D animation results are visually pleasant and realistic while bringing novel eye features compared to state of the art models.

2020

The Impact of Stylization on Face Recognition

Olivier, Nicolas, Hoyet, Ludovic, Danieau, Fabien and 5 more authors

In Symposium on Applied Perception (ACM-SAP) 2020

Abs PDF

While digital humans are key aspects of the rapidly evolving areas of virtual reality, gaming, and online communications, many applications would benefit from using digital personalized (stylized) representations of users, as they were shown to highly increase immersion, presence and emotional response. In particular, depending on the target application, one may want to look like a dwarf or an elf in a heroic fantasy world, or like an alien on another planet, in accordance with the style of the narrative. While creating such virtual replicas requires stylization of the user’s features on to the virtual character, no formal study has however been conducted to assess the ability to recognize stylized characters. In this paper, we therefore focus on the ability of recognizing a stylized actor’s face to explore the two following questions: Can we recognize the human face that has been stylized into virtual character? Is there a limit in the stylization that can be applied? To answer these questions, we conducted a perceptual study investigating the effect of the degree of stylization on the ability to recognize an actor, and the subjective acceptability of the stylization results. Results show that recognition rates decrease when the degree of stylization increases, while acceptability of the stylization increases. Overall, these results provide recommendations to achieve a good compromise between stylization levels and recognition, and pave the way to new stylization methods providing a tradeoff between stylization and recognition of the actor.
Fat Pad Cages for Facial Posing

Colas, Adèle, Guiotte, Florent, Danieau, Fabien and 2 more authors

arXiv preprint arXiv:2010.05528 2020

Abs PDF

We introduce Fat Pad cages for posing facial meshes. It combinescage representation and facial anatomical elements, and enablesusers with no artistic skill to quickly sketch realistic facial expres-sions. The model relies on one or several cage(s) that deform(s) themesh following the human fat pads map. We propose a new func-tion to filter Green Coordinates using geodesic distances preventingglobal deformation while ensuring smooth deformations at the bor-ders. Lips, nostrils and eyelids are processed slightly differently toallow folding up and opening. Cages are automatically created andfit any new unknown facial mesh. To validate our approach, wepresent a user study comparing our Fat Pad cages to regular GreenCoordinates. Results show that Fat Pad cages bring a significantimprovement in reproducing existing facial expressions.

2019

Automatic Generation and Stylization of 3D Facial Rigs

Danieau, Fabien, Gubins, IIja, Olivier, Nicolas and 6 more authors

In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) 2019

Abs PDF

In this paper, we present a fully automatic pipeline for generating and stylizing high geometric and textural quality facial rigs. They are automatically rigged with facial blendshapes for animation, and can be used across platforms for applications including virtual reality, augmented reality, remote collaboration, gaming and more. From a set of input facial photos, our approach is to be able to create a photorealistic, fully rigged character in less than seven minutes. The facial mesh reconstruction is based on state-of-the art photogrammetry approaches. Automatic landmarking coupled with ICP registration with regularization provide direct correspondence and registration from a given generic mesh to the acquired facial mesh. Then, using deformation transfer, existing blendshapes are transferred from the generic to the reconstructed facial mesh. The reconstructed face is then fit to the full body generic mesh. Extra geometry such as jaws, teeth and nostrils are retargeted and transferred to the character. An automatic iris color extraction algorithm is performed to colorize a separate eye texture, animated with dynamic UVs. Finally, an extra step applies a style to the photorealis-tic face to enable blending of personalized facial features into any other character. The user’s face can then be adapted to any human or non-human generic mesh. A pilot user study was performed to evaluate the utility of our approach. Up to 65% of the participants were successfully able to discern the presence of one’s unique facial features when the style was not too far from a humanoid shape.

2018

HFX studio: haptic editor for full-body immersive experiences

Danieau, Fabien, Guillotel, Philippe, Dumas, Olivier and 3 more authors

In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology 2018

Abs PDF

Current virtual reality systems enable users to explore virtual worlds, fully embodied in avatars. This new type of immersive experience requires specific authoring tools. The traditional ones used in the movie and the video games industries were modified to support immersive visual and audio content. However, few solutions exist to edit haptic content, especially when the whole user’s body is involved. To tackle this issue we propose HFX Studio, a haptic editor based on haptic perceptual models. Three models of pressure, vibration and temperature were defined to allow the spatialization of haptic effects on the user’s body. These effects can be designed directly on the body (egocentric approach), or specified as objects of the scene (allocentric approach). The perceptual models are also used to describe capabilities of haptic devices. This way the created content is generic, and haptic feedback is rendered on the available devices. The concept has been implemented with the Unity®game engine, a tool already used in VR production. A qualitative pilot user study was conducted to analyze the usability of our tool with expert users. Results shows that the edition of haptic feedback is intuitive for these users.
KinesTouch: 3D Force-Feedback Rendering for Tactile Surfaces

Costes, Antoine, Danieau, Fabien, Argelaguet-Sanz, Ferran and 2 more authors

In International Conference on Virtual Reality and Augmented Reality 2018

Abs PDF

In this paper, we introduce the KinesTouch, a novel approach for tactile screen enhancement providing four types of haptic feedback with a single force-feedback device: compliance, friction, fine roughness, and shape. We present the design and implementation of a corresponding set of haptic effects as well as a proof-of-concept setup. Regarding friction in particular, we propose a novel effect based on large lateral motion that increases or diminishes the sliding velocity between the finger and the screen. A user study was conducted on this effect to confirm its ability to produce distinct sliding sensations. Visual cues were confirmed to influence sliding judgments, but further studies would help clarifying the role of tactile cues. Finally, we showcase several use cases illustrating the possibilities offered by the KinesTouch to enhance 2D and 3D interactions on tactile screens in various contexts.
A Tangible Surface for Digital Sculpting in Virtual Environments

Callens, Edouard, Danieau, Fabien, Costes, Antoine and 1 more author

In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications 2018

Abs PDF

With the growth of virtual reality setups, digital sculpting tools become more and more immersive. It is now possible to create a piece of art within a virtual environment, directly with the controllers. However, these devices do not allow to touch the virtual material as a sculptor would do. To tackle this issue we investigate in this paper the use of a tangible surface that could be used in virtual reality setups. We designed a low-cost prototype composed of two layers of sensors in order to measure a wide range of pressure. We also propose two mapping techniques to fit our device to a virtual 3D mesh to be sculpted. Participants of an informal test were asked to reproduce a pattern on three meshes: a plane, a sphere and a teapot. They succeeded in this task, showing the potential of our approach.
Haptic material: A holistic approach for haptic texture mapping

Costes, Antoine, Danieau, Fabien, Argelaguet, Ferran and 2 more authors

In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications 2018

Abs PDF

In this paper, we propose a new format for haptic texture mapping which is not dependent on the haptic rendering setup hardware. Our “haptic material” format encodes ten elementary haptic features in dedicated maps, similarly to “materials” used in computer graphics. These ten different features enable the expression of compliance, surface geometry and friction attributes through vibratory, cutaneous and kinesthetic cues, as well as thermal rendering. The diversity of haptic data allows various hardware to share this single format, each of them selecting which features to render depending on its capabilities.

2017

Enabling embodiment and interaction in omnidirectional videos

Danieau, Fabien, Lopez, Thomas, Mollet, Nicolas and 3 more authors

In 2017 IEEE International Conference on Multimedia and Expo (ICME) 2017

Abs PDF

This paper investigates the role of the embodiment in an immersive video experience. A system allowing to play back omnidirectional videos enhanced with real-time 3D content is presented. It enables the user to be embodied in an avatar and to interact with 3D objects added to the video. A user study was conducted to understand the impact of this embodiment on the user experience. Four different avatars were compared (none, human, ghost and astronaut) as well as three levels of user control on the avatar, and also the possibility to interact with the content. Results show that being embodied has benefits on the user experience but requires the representation to be in line with the story and the avatar to be fully controllable. Indeed a misadapted embodiment may decrease the experience.
Attention guidance for immersive video content in head-mounted displays

Danieau, Fabien, Guillo, Antoine, and Doré, Renaud

In 2017 IEEE Virtual Reality (VR) 2017

Abs PDF

Immersive videos allow users to freely explore 4 π steradian scenes within head-mounted displays (HMD), leading to a strong feeling of immersion. However users may miss important elements of the narrative if not facing them. Hence, we propose four visual effects to guide the user’s attention. After an informal pilot study, two of the most efficient effects were evaluated through a user study. Results show that our approach has potential but it remains challenging to implicitly drive the user’s attention outside of the field of view.

2016

Texture rendering on a tactile surface using extended elastic images and example-based audio cues

Fleureau, Julien, Lefevre, Yoan, Danieau, Fabien and 2 more authors

In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications 2016

Abs PDF

A texture rendering system relying on pseudo-haptic and audio feedback is presented in this paper. While the user touches the texture displayed on a tactile screen, the associated image is deformed according to the contact area and the rubbing motion to simulate pressure. Additionally audio feedback is synthesized in real-time to simulate friction. A novel example-based scheme takes advantage of recorded audio samples of friction between actual textures and a finger at several speeds to synthesize the final output sound. This system can be implemented on any existing tactile screen without any extra mechanical device.

2012

HapSeat: producing motion sensation with multiple force-feedback devices embedded in a seat

Danieau, Fabien, Fleureau, Julien, Guillotel, Philippe and 3 more authors

In Proceedings of the 18th ACM symposium on Virtual reality software and technology 2012

Abs PDF

We introduce a novel way of simulating sensations of motion which does not require an expensive and cumbersome motion platform. Multiple force-feedbacks are applied to the seated user’s body to generate a sensation of motion experiencing passive navigation. A set of force-feedback devices such as mobile armrests or headrests are arranged around a seat so that they can apply forces to the user. We have dubbed this new approach HapSeat. A proof of concept has been designed which uses three low-cost force-feedback devices, and two control models have been implemented. Results from the first user study suggest that subjective sensations of motion are reliably generated using either model. Our results pave the way to a novel device to generate consumer motion effects based on our prototype.
Framework for enhancing video viewing experience with haptic effects of motion

Danieau, Fabien, Fleureau, Julien, Cabec, Audrey and 5 more authors

In 2012 IEEE Haptics Symposium (HAPTICS) 2012

Abs PDF

This work aims at enhancing a classical video viewing experience by introducing realistic haptic feelings in a consumer environment. More precisely, a complete framework to both produce and render the motion embedded in an audiovisual content is proposed to enhance a natural movie viewing session. We especially consider the case of a first-person point of view audiovisual content and we propose a general workflow to address this problem. This latter includes a novel approach to both capture the motion and video of the scene of interest, together with a haptic rendering system for generating a sensation of motion. A complete methodology to evaluate the relevance of our framework is finally proposed and demonstrates the interest of our approach.

2011

A robotic game to evaluate interfaces used to show and teach visual objects to a robot in real world condition

Rouanet, Pierre, Danieau, Fabien, and Oudeyer, Pierre-Yves

In Proceedings of the 6th international conference on Human-robot interaction 2011

Abs PDF

In this paper, we present a real world user study of 4 interfaces designed to teach new visual objects to a social robot. This study was designed as a robotic game in order to maintain the user’s motivation during the whole experiment. Among the 4 interfaces 3 were based on mediator objects such as an iPhone, a Wiimote and a laser pointer. They also provided the users with different kind of feedback of what the robot is perceiving. The fourth interface was a gesture based interface with a Wizard-of-Oz recognition system added to compare our mediator interfaces with a more natural interaction. Here, we specially studied the impact the interfaces have on the quality of the learning examples and the usability. We showed that providing non-expert users with a feedback of what the robot is perceiving is needed if one is interested in robust interaction. In particular, the iPhone interface allowed non-expert users to provide better learning examples due to its whole visual feedback. Furthermore, we also studied the user’s gaming experience and found that in spite of its lower usability, the gestures interface was stated as entertaining as the other interfaces and increases the user’s feeling of cooperating with the robot. Thus, we argue that this kind of interface could be well-suited for robotic game.

PhD Thesis

2014

Contribution to the study of haptic feedback for improving the audiovisual experience

Danieau, Fabien

2014

PDF

Workshops / Demonstrations / Posters

2021

Towards Haptic Images: a Survey on Touchscreen-Based Surface Haptics

Costes, Antoine, Danieau, Fabien, Argelaguet, Ferran and 2 more authors

In IEEE Trans. Haptics Poster 2021

Abs

The development of tactile screens opens new perspectives for co-located image and haptic rendering, leading to theconcept of “haptic images”. They emerge from the combination of image data, rendering hardware, and haptic perception. This enables one to perceive haptic feedback while manually exploring an image. This raises nevertheless two scientific challenges, which serve as thematic axes of the state of the art in this survey. Firstly, the choice of appropriate haptic data raises a number of issues about human perception, measurements, modeling and distribution. Secondly, the choice of appropriate rendering technology implies a difficult trade-off between expressiveness and usability.

2017

A playback tool for reviewing VR experiences

Lopez, Thomas, Dumas, Olivier, Danieau, Fabien and 3 more authors

In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology 2017

Abs PDF

Designing a VR content is a challenging task due to the complexity of the analysis of a user’s experience. We propose a tool allowing a reviewer to record a user’s movements when consuming a VR content, and to playback this experience. During the playback, the reviewer can visualize in real-time the visible objects to the user (within the field of view) or the interactive ones (within the workspace). Besides, the field of view and workspace of numerous devices can be simulated in order to predict how the content would fit. In the demonstration, a user is first invited to experience a VR scene. Then the recorded experience can be played back from a reviewer’s point of view.

2016

Introducing Basic Principles of Haptic Cinematography and Editing.

Guillotel, Philippe, Danieau, Fabien, Fleureau, Julien and 5 more authors

In WICED 2016

Abs PDF

Adding the sense of touch to hearing and seeing would be necessary for a true immersive experience. This is the promise of the growing "4D-cinema" based on motion platforms and others sensory effects (water spray, wind, scent, etc.). Touch provides a new dimension for filmmakers and leads to a new creative area, the haptic cinematography. However design rules are required to use this sensorial modality in the right way for increasing the user experience. This paper addresses this issue, by introducing principles of haptic cinematography editing. The proposed elements are based on early feedback from different creative works performed by the authors (including a student in cinema arts), anticipating the role of haptographers, the experts on haptic content creation. Three full short movies have been augmented with haptic feedback and tested by numerous users, in order to provide the inputs for this introductory paper.
Haptic cinematography: Authoring haptic feedback for movies.

Danieau, Fabien

In Haptics Symposium Workshop on Creative Haptic Expression: Trends and Tools 2016

PDF
Visualizing the emotional journey of a museum

Du, Shen, Shu, Edouard, Tong, Feifei and 7 more authors

In Proceedings of EmoVis 2016, ACM IUI 2016 Workshop on Emotion and Visualization, Sonoma, CA, USA, March 10, 2016 2016

Abs PDF

Wearable devices and new types of sensors make it possible to capture people behavior, activity and, potentially, cognitive state in their daily life. Today those devices are mainly used for well-being applications, by recording and displaying people’s activity. Some work have been published going a step further by inferring from the recorded signals the emotional state of individuals or group of people. However, the information provided and the way it is presented are still in their infancy, with time lined graphs showing calories, heart-rate, steps, temperature, and sometimes affective intensity. In this paper we present an experiment done during the visit of different people in a museum of arts to capture the emotional impact of the exposed paintings. We also propose an associated visualization of their emotional journey. The emotion is here measured as the affective response to the paintings observation, and the processing algorithm is based on an existing technique adapted to the particular case of different observation durations. The visualization is based on a 3D map of the museum with different colors associated to the different paintings to get the emotional heat-map of the museum (more precisely the arousal dimension). The validation has been done in the museum of arts at Lyon, France, with 46 visitors, for a total of 27 paintings, exposed in three different rooms.

2013

H-Studio: an authoring tool for adding haptic and motion effects to audiovisual content

Danieau, Fabien, Bernon, Jérémie, Fleureau, Julien and 4 more authors

In Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology 2013

Abs

Haptic and motion effects have been widely used for virtual reality applications in order to provide a physical feedback from the virtual world. Such feedback was recently studied to improve the user experience in audiovisual entertainment applications. But the creation of haptic and motion effects is a main issue and requires dedicated editing tool. This paper describes a user-friendly authoring tool to create and synchronize such effects with audiovisual content. More precisely we focus on the edition of motion effects. Authoring is simplified thanks to a dedicated graphical user interface, allowing either to import external data or to synthesize effects thanks to a force-feedback device. Another key feature of this editor is the playback function which enables to preview the motion effect. Hence this new tool allows non expert users to create immersive haptic-audiovisual experiences.
HapSeat: a novel approach to simulate motion in audiovisual experiences

Danieau, Fabien, Fleureau, Julien, Guillotel, Philippe and 3 more authors

2013

Abs

The HapSeat is a novel and inexpensive approach for simulating motion sensations in audiovisual experience. Multiple force-feedbacks are applied to the sitting users’ body to generate a 6DoF sensation of motion as users are experiencing passive navigation. A set of force-feedback devices (a headrest and mobile armrests) are arranged around a seat so that they can apply forces to the user. Several video sequences highlight the capabilities of the HapSeat. We propose SIGGRAPH attendees to experience these videos enhanced by haptic effects of motion.
HapSeat: a novel approach to simulate motion in a consumer environment

Danieau, Fabien, Fleureau, Julien, Guillotel, Philippe and 3 more authors

2013

Abs

The HapSeat is a novel approach for simulating motion sensations in a consumer environment. Multiple force-feedbacks are applied to the seated user’s body to generate a 6DoF sensation of motion while experiencing passive navigation. A set of force-feedback devices such as mobile armrests or headrests are arranged around a seat so that they can apply forces to the user. Several video sequences have been created to highlight the capabilities of the HapSeat. We propose to CHI attendees to experience these videos enhanced by haptic effects of motion.

Patents
More than 25 patents were filled. The list can be found here