Abstract
Humans need to accurately process the contact forces that arise as they perform everyday haptic interactions such as sliding the fingers along a surface to feel for bumps, sticky regions, or other irregularities. Several different mechanisms are possible for how the forces on the skin could be represented and integrated in such interactions. In this study, we used a force-controlled robotic platform and simultaneous ultrasonic modulation of the finger-surface friction to independently manipulate the normal and tangential forces during passive haptic stimulation by a flat surface. To assess whether the contact pressure on their finger had briefly increased or decreased during individual trials in this broad stimulus set, participants did not rely solely on either the normal force or the tangential force. Instead, they integrated tactile cues induced by both components. Support-vector-machine analysis classified physical trial data with up to 75% accuracy and suggested a linear perceptual mechanism. In addition, the change in the amplitude of the force vector predicted participants’ responses better than the change of the coefficient of dynamic friction, suggesting that intensive tactile cues are meaningful in this task. These results provide novel insights about how normal and tangential forces shape the perception of tactile contact.
Similar content being viewed by others
Introduction
Touching surfaces, grasping objects and manipulating tools are usual parts of daily life for most humans. During these interactions, we can effortlessly extract information about shape, material, and texture from almost every contact we make. When actively seeking particular haptic information, we are expert at using exploratory procedures to perform appropriate movements and maximize our perceptual performance 1. These movements enable us to gather the essential tactile cues required for fine perception of everyday objects 2, textures 3, or dexterous manipulation 4. The importance of tactile feedback is further highlighted by how challenging most daily tasks become when the sense of touch is lost 5 or when local anesthesia is applied 6.
Exploratory procedures necessarily generate forces and deformations on the skin; prior experiments have shown that these phenomena are essential sensory cues when active movements are performed 7,8. All types of afferents respond to slip events 9 and to frictional changes during passive sliding 10. Deformations that develop across the stratum corneum during these events create strain fields that depend on the intensity and direction of the applied force 11,12. When they are sufficiently large, the strains ultimately induce responses from mechanoreceptors 9,13. Furthermore, it has been shown that responses from a small population of afferents can accurately classify the exerted normal force and the frictional properties of textures 14. The signals from the activated sub-modalities then converge to the somatosensory cortex, where they activate several populations of cortical neurons that encode important perceptual dimensions of the tactile sense 15. Humans are therefore able to discriminate changes in force magnitude of 7–10% when the reference force is above 0.5 N and of 15–27% when it is under 0.5 N 16, as well as slips of less than 5 mm 17. Still, little is known about the cognitive mechanisms underlying these processes and how the physical attributes of contact force contribute to the perception of three-dimensional (3D) features through stereognosis.
Research on tactile perception of contact force has predominantly focused on understanding the role of frictional cues, which are related to tangential force. Humans have been shown to be extremely sensitive to changes in the tangential force 18, including nanoscale cues induced by molecular differences between materials 19,20. Moreover, finger-surface friction is known to modulate perception of surface roughness 21,22 and also mediate affective sensations such as the pleasantness of touch 23. Additional evidence of a possible predominant role of tangential force is provided by physiological and computational studies. Microneurographic recordings have demonstrated that the direction of the contact force vector affects the activity of all types of mechanoreceptors, which additionally exhibit a larger spiking response to the tangential component of the force 24. It was also shown that the finger-surface friction can be predicted by the geometry of the surface 25, and modelling of the interaction suggests that shear force is more informative than normal force for the recognition of shape during active tactile exploration 26. However, these studies analyzed solely contact mechanics measurements to assess the possible sensory relevance of these tactile cues; further psychophysical experiments are needed to understand whether the sense of touch relies on similar classification mechanisms.
Although human sensitivity to induced changes in the normal direction has been less studied than that for tangential force, scientists have shown that humans perceive normal force magnitude accurately 27,28. In a study that used the same experimental setup as this one, brief normal force changes were consistently detected with a just noticeable difference (JND) of 19% under both low and high surface friction 29. In that task, both tangential and normal cues were available, but the JND for tangential force varied across the conditions while normal force perception followed Weber’s law. Humans also accurately modulate normal force to optimally extract tactile features during a haptic task 30. Moreover, research on the perception of the 3D force applied on the fingertip has shown that humans accurately detect the direction of the force vector and discriminate differences in its tangential direction as small as 7.1° 31. Finally, sensory inputs from both force components may reinforce or disrupt each other during cognitive processes, as is the case for force, torque, and stiffness 32 despite being separately encoded in tactile afferents’ signals 14,33.
Thus, the extent to which the tactile sense relies on the normal and tangential force components for stereognosis is still unclear. In that context, it is especially important to investigate the sensory relevance of 3D force changes since forces have been shown to induce cues that can dominate the direct perception of surface topography 7. It is likely that sensory cues from both the tangential and normal force components are available to the tactile sense: the present study aims at investigating how these two tactile cues are integrated by humans within their perception of contact pressure during passive dynamic touch. To that end, we evaluate how humans perceive simultaneous changes of the normal and tangential force vectors when a flat, smooth surface is stroked across the stationary index finger. Passive stimulation was needed to control the forces experienced by participants with high enough precision. This type of stimulation removes the proprioceptive feedback related to the action 8,34 and prevents some adjustments that humans perform in active touch 35. However, several studies that delivered tactile cues on a moving surface have observed similar sensory thresholds for active and passive exploration 36,37.
To achieve independent normal and tangential stimulations, we use custom-built equipment (Fig. 1a) that combines ultrasonic reduction of the elicited tangential force with a robotic platform capable of sliding a surface along a human fingertip while controlling the amplitude of the normal force (Fig. 1b). This apparatus enabled us to modulate the contact force vector (Fig. 1c) by generating different combinations of three amplitudes of normal force change (Fig. 1d) and six amplitudes of tangential force change (Fig. 1e). Importantly, the combinations of these conditions disrupted the naturally occurring correlation between the changes of the normal and tangential forces 38 to create stimuli that have not previously been studied. Due to the limited stimulation range of the ultrasonic apparatus, conditions with an increase of tangential force started from 1.5 µm ultrasonic lubrication, and those with a decrease started from natural finger-surface friction, as also done in 10. The recorded force vectors and answers enabled us to perform an objective analysis of the decision boundary that best fits our psychophysical results. In addition, we studied two metrics that are commonly used in haptics research, the coefficient of dynamic friction 39,40 and the amplitude of the 3D force vector 41. We tested these metrics because they could plausibly convey contact pressure through the perceived stickiness and the total pressure on the skin, respectively. The results of this study are fundamental for understanding the computational mechanisms of touch and fostering the further development of haptic devices that provide force feedback.
Materials and methods
Participants
Data were collected from 11 healthy volunteers aged between 27 and 53 (4 females). Ten participants self-reported their right hand as dominant, and one self-reported as ambidextrous. All participants performed the experiment with the index finger of their right hand. The ethics committee on human research of UCLouvain approved the study under reference 2019/03AVR/158. All participants gave written informed consent to David Gueorguiev, who conducted the human studies. The investigation conformed to the principles of the Declaration of Helsinki, and experiments were performed in accordance with relevant guidelines and regulations.
Experimental setup
We used a custom robotic platform designed to apply controlled stimuli to the participant’s fingertip during passive dynamic touch. This platform is based on an industrial robot (four-axis SCARA Denso HS-4535G) that is able to translate in three orthogonal directions. Its position is servo-controlled with a position resolution of 15 µm by a factory controller at a frequency of 1 kHz, which enables exact control of the instantaneous speed of the sliding. The subject's index finger was fixed in a support that maintains a constant angle between the finger and the stimulating plate (Fig. 1a). A Mini40 load cell (ATI, USA) is mounted on the robot to measure the contact force vector; the force sensor’s single measurement resolution is 0.01 N in Fx and Fy (TF) and 0.02 N in Fz (NF). The normal force is controlled by a proportional-integral (PI) controller and was commanded to the baseline value of 1.0 N.
In addition to the control of the normal force by the robotic platform, the tangential force is modulated with an ultrasonic tactile display integrated with the acquisition and control chain of the robot. The display is based on a modified version of the STIMTAC 42. The full body of the stimulator is mounted to the force sensor of the robot, and the vibration amplitude of the device is controlled in closed loop. The implemented control ensures the stability of vibration amplitude with a resolution of 50 nm. The skin-plate interface was a polypropylene (PP) sheet, which was glued on the ultrasonically vibrating screen of the device. The baseline tangential force was either the natural finger-surface friction force or the friction force induced by a 1.5 µm ultrasonic vibration.
Simultaneous modulation of tangential and normal force
For the three commanded force changes (− 0.3 N, 0 N, + 0.3 N), the robotic platform was able to achieve normal force changes of − 0.30 ± 0.02 N, − 0.01 ± 0.03 N, and 0.35 ± 0.03 N (mean ± SD), respectively. The changes exhibited a constant latency due to the inertia of the robotic platform but were reproducible and synchronized with the change in tangential force. In addition to the change in the applied normal force, the ultrasonic signal of the STIMTAC was commanded to change the tangential force in synchrony with the normal force modulation. Six conditions of ultrasonic stimulation were implemented. Three conditions started from a 1.5 µm ultrasonic vibration, which was then decreased during the modulation phase by 1.5 µm, 0.75 µm or 0 µm. Diminishing the vibration amplitude reduced ultrasonic lubrication and therefore increased the finger-surface friction. The other three conditions started without ultrasonic vibration, which then increased during the modulation phase by 1.5 µm, 0.75 µm or 0 µm, in order to decrease the finger-surface tangential force.
Experimental procedure
The experiment combined the two techniques described above to achieve simultaneous and independent modulation of the two orthogonal components of the finger-surface contact force: the normal force and the tangential force. In a pre-modulation interval at the start of the trial, the robot slid the ultrasonic interface across the participant’s finger with a constant speed of 2 cm/s and a constant normal force of 1.0 N until 2.5 s after the start of the motion. This speed and force allowed for accurate control by the robotic platform and prevented artifacts such as stick–slip, which occur more often at higher speeds. This level of normal force is consistent with those observed in unrestrained roughness perception tasks 43. The exploration speed is at the low end of the range humans spontaneously use to explore a surface 44 and is consistent with values used in other studies 10,18,43,45. During the 0.5-s interval (modulated interval) following the initial 2.5 s of constant interaction, the normal contact force on the finger either decreased (− 0.3 N), increased (+ 0.3 N), or remained at the same value. After the brief change, the commanded normal force was set again to 1.0 N during the last interval of the platform’s motion.
The ultrasonic vibration could be moderately or greatly increased, moderately or greatly decreased or kept constant at the low or high starting value in synchrony with the change of the normal force. All combinations of the three normal force conditions and six ultrasonic conditions, which we selected to produce a large range of changes in NF and TF, were presented ten times in a randomized order for a total of 180 trials per participant, which took approximately 50 min. Participants started the experiment by performing six randomly chosen training trials to familiarize themselves with the stimuli. A one-minute break was provided in the middle of the experiment for stretching the hand. A few participants took one additional break of around 30 s when they felt tired in either the first or second half of the experiment.
After each trial, the participant had to report whether the contact pressure applied by the platform briefly increased or decreased around the middle of the trial. Answering that the pressure did not change was not allowed. The wording of the question relating to ‘contact pressure’ was chosen to avoid explicit reference to normal and tangential force while favoring the sensation related to the vertical action on the finger.
Analysis of the force signals
The Mini40 six-axis force/torque sensor mounted between the robot and the ultrasonic plate was also used for the contact force measurements. The normal force component in z as well as the tangential force components in x and y were filtered by a low-pass (40 Hz) second-order Butterworth filter to remove the mechanical and electrical noise caused by the robotic platform; our sign convention for the study trials yields positive values for both NF and TF. We then used these filtered force signals to compute the relative changes in normal force and tangential force during the modulation period, compared to pre-modulation. We also calculate the amplitude (A) of the contact force vector,
and the coefficient of dynamic friction (µ), which is defined as the ratio between the finger-surface tangential force TF and the normal force NF,
For each parameter, the pre-modulation measure was computed by averaging its values across the 200-ms interval prior to the start of the modulation, and the modulated measure was computed by averaging the values over the 200-ms interval in the middle of the modulated phase. The 150 ms during which the normal force is evolving toward its peak value and the 150 ms during which the normal force is returning to 1.0 N were excluded from the computation. For both metrics, we define the relative change as the ratio between the modulated measure and the pre-modulation measure.
Statistical analysis
The decision to use parametric or non-parametric statistical methods on a given data sample was motivated by the Shapiro–Wilk normality test and the alignment of the Q-Q normality plot. The relevance of two-way analysis of variance (ANOVA) was probed by checking the normality of the unstandardized residuals from the independent variables. The statistical analyses of the study were performed with Graphpad Prism and IBM SPSS software. The support-vector-machine (SVM) analysis was performed with the Scikit-learn 1.0.2 Python library 46.
Results
Contact pressure perception
Experiment participants were asked to report whether the contact pressure on their index finger had briefly increased or decreased during the interval in which the modulation of the force components occurred. Due to the limitations of the ultrasonic device, two pre-modulation conditions were used: one starting with natural finger-surface tangential force of 0.98 ± 0.25 N (mean ± SD) that was briefly decreased by ultrasonic lubrication, and one starting with maximum ultrasonic amplitude, hence a lower tangential force of 0.67 ± 0.27 N that was briefly increased during the modulated interval (see Fig. 2a). A statistical test confirmed that the difference between the TF of the two pre-modulation conditions was significant (paired t-test: n = 11, t = 14.21, df = 10, p < 0.0001). In contrast, the capacity of the robot to maintain a constant normal force of 1 N was not affected by the ultrasonic vibration (paired t-test: n = 11, t = 1.73, df = 10, p = 0.11).
Unlike NF, which was directly controlled by the robot with proportional and integral feedback, TF was indirectly modified by applying a pre-defined increase or decrease to the ultrasonic vibration amplitude; the effect of each change depends somewhat on the state of the skin, thereby producing slightly different frictional changes across trials. The variations of ultrasonic vibration were chosen to be large enough to produce different changes in TF. To verify that the levels of TF change were indeed statistically different from each other, we performed repeated measures ANOVA analyses with Greenhouse–Geisser correction on all six combinations (two baselines and three NF changes) that were modulated by three levels of ultrasonic vibration. We found all ANOVA analyses to be strongly significant with p < 0.0001 (Fig. 2b). In addition, post-hoc Tukey tests showed that the TF change was significant with p < 0.05 between all levels of ultrasonic modulation. These results show that participants experienced distinct TF change for each level of ultrasonic modulation.
Therefore, we further investigated how the perception of contact pressure is affected by simultaneous changes of normal force (NF) and tangential force (TF) by performing two two-way ANOVAs, which were separately implemented for the conditions in which TF decreased from its natural level and for those in which TF increased from a reduced level. The two ANOVA statistical tests were validated for the two types of conditions by a Q-Q plot of the unstandardized residuals as well as the Shapiro–Wilk normality test. The dependent variable in the analysis was the reported percentage of increased pressure, and two independent categorical variables were tested: the change of NF and the change of TF (See Fig. 2c). In the conditions starting with low friction, we found that both the change in NF (f(2) = 22.597, p < 0.001) and the change in TF (f(2) = 4.299, p = 0.016) had a statistically significant effect on the likelihood of the subject reporting a brief increase in contact pressure. In the condition starting with natural friction that briefly decreased, we also found a statistically significant effect on reporting a brief increase in contact pressure by both the change in NF (f(2) = 42.002, p < 0.001) and the change in TF (f(2) = 16.061, p < 0.001). The interaction between the two terms was not significant in either condition. Overall, the results show that a larger increase in TF or NF made participants more likely to report an increase of the contact pressure. Conversely, they more often reported a decrease of the contact pressure when TF or NF decreased during the modulated interval.
Perception of simultaneous changes of the force components
Since the ANOVA statistical analysis showed significant effects of both TF and NF, we used linear and non-linear classification techniques to investigate the relative importance of the normal and tangential forces for human perception of contact pressure during dynamic tactile stimulation. In these analyses, the dependent variable was the perception of a decrease or increase, and the independent variables were the NF and TF changes generated in all trials of the study. At first, we performed a binary logistic regression because it is well suited for classification of binary answers and for modelling psychometric data. The analysis of the two independent variables with 20 iterations of the model showed a significant contribution of both variables (W = 55.7 and p < 0.001 for NF; W = 178.5 and p < 0.001 for TF). It achieved a 0.71 ratio of correctly classified answers (See Table 1 and Fig. 3a) with an area under the receiver operator characteristic (ROC) curve of 0.77 ± 0.01 (mean ± SD).
We explored further by performing an SVM analysis of the data with several kernels: linear, Gaussian, and third-degree polynomial. We implemented the classifications with a constant initial random state (42) to obtain repeatable results. 80% of the data were used to train the algorithm, and 20% were used as the test set. SVM slightly improved the classification rate compared to the binary logistic regression, especially the classification of the reported decreases. We also computed the boundary decision line and the 95% confidence interval for all kernels types (Fig. 3b–d); the boundaries for the Gaussian kernel approach suggest overfitting of the data. The areas under the curve also improved compared to the binary logistic regression (Fig. 3e). Overall, the third-degree polynomial fit performed best, and the contour line suggests that it improved classification by drawing a non-linear contour around the small changes to classify them as decreases. Here, the algorithm models a slightly higher reporting of decreases when changes in NF and TF are close to zero. In general, a relatively good classification performance could be achieved on the basis of NF and TF changes, and classification results mainly suggest linear perceptual mechanisms.
The amplitude of the contact force and the coefficient of dynamic friction
In addition to the objective results from the classification algorithms, we surveyed two metrics that are often used in haptics studies and are plausible for this task: the amplitude of the 3D contact force (A) and the coefficient of dynamic friction (µ), which is essentially inversely proportional to the angular change of the contact force vector. First, we tested whether these metrics showed significant variation when TF and NF changed. One-way repeated measures ANOVA with Greenhouse–Geisser correction on conditions in which TF was made to vary showed that changes in the metrics were significant between conditions with p < 0.0001 (Fig. 4a). The same statistical analysis was performed between the levels of NF change for the two metrics, and differences were also significant with p < 0.0001 for all comparisons (Fig. 4b). All post-hoc Tukey tests between conditions also showed p < 0.0001 significance. Overall, these results indicate that the changes induced by NF and TF are modifying these the metrics in a consistent manner.
To test whether these metrics could be relevant to the perception of contact pressure, we performed binary logistic regressions in which participants’ answers were the dependent variable and the investigated metrics were probed as independent variables. For each metric, we computed the histogram of participants’ answers and the ROC curve across all trials of the study (Fig. 5). Histograms of the data from all trials show no excessive polarization, and their peaks are close to zero; thus, we did not observe significant distortions in the input spaces. For A (Fig. 5a), the histogram plot showed that the distribution of ‘increased’ answers mainly included positive changes in the amplitude of the force vector and the ‘decreased’ answer distribution mainly included negative ones. Moreover, the two distributions did not show a large overlap. On the other hand, the overlap between the reported increases and decreases was larger for the change in µ (Fig. 5b).
A binary logistic regression that computed ROC curves found an area under the curve of 0.76 ± 0.01 (mean ± SD) for the change in A (Fig. 5c) and 0.63 ± 0.01 for the change in µ (Fig. 5d). The average classification ratios (see Table 2) obtained with the one-dimensional binary logistic regression were respectively 0.70 and 0.63 for the changes in A and µ. Thus, the change of the coefficient of dynamic friction did not match well with participants’ answers, while performance with force vector amplitude is close to the classification achieved by objective analysis. These results suggest that intensive cues related to the amplitude change of the 3D force vector could have been used by participants to perform the task. Therefore, changes of the contact force amplitude probably elicit haptic cues that can contribute to the perception of contact pressure.
Discussion
The study results show that participants used both normal and tangential force components to assess changes in the contact pressure on the finger. Although the answer reported by a participant certainly depended on their particular interpretation of the term “contact pressure”, the feeling of contact pressure during dynamic stimulation seems to be conveyed not only by the normal indentation of the skin but also by its tangential stretch. A possible mechanical explanation of the important perceptual role of TF could be that, since the gross contact area is reduced when tangential force increases 47,48, the average pressure on the afferents in the contact area is increased. In addition, it seems that compressive strains induced by an increase in TF are larger than tensile ones 12, which could explain how an increase in TF would be perceived as a compression and hence an increase in contact pressure. A biomechanical explanation could also be that changes in tangential force induce rolling of the soft fingertip tissue, which then pushes toward the nail close to the normal direction. Moreover, our study considered the particular case of a surface that is perpendicular to gravity, but humans most often haptically explore objects like clothes, tools, and smartphones in complex orientations. Experience with such diverse facets of tactile contact might have shaped a more complex representation of contact pressure.
Thus, perception of the contact pressure during dynamic passive haptic stimulation is not mediated only by normal indentation or frictional cues but probably by the integration of all tactile cues induced by the force change. A unique aspect of this study was to use independent modulation of the tangential and normal force components to thoroughly investigate the mechanisms underlying the perceptual integration of the contact force exerted on the skin. The change in the coefficient of dynamic friction provided overlapping answering patterns and was subsequently a poor classifier of participants’ responses, which is surprising since it relates to the sensation of stickiness during dynamic touch 49. Participants probably mostly used intensive cues, which are not straightforwardly captured by computations relying on a ratio. Indeed, it is possible for the overall force to increase while the ratio between TF and NF decreases, and vice versa. In contrast, the contact force amplitude is an intensive cue that has rarely been examined in prior studies but was rather good at classifying participant answers. Overall, the best classification performance (75%) was achieved by the SVM with a polynomial kernel. It seems that the decision boundary is almost linear when changes are prominent but non-linear for very small changes. However, the limited classification improvement over SVM with a linear kernel (73%) makes it unclear whether this non-linearity stems from a sensory mechanism related to near-threshold intensities or from overfitting the dataset. Therefore, linear integration is the most plausible candidate for modeling the mechanisms underlying the perception of simultaneous changes in TF and NF.
Still, classification was not excellent, which is probably due to differences in the perceptual criteria between participants or even changes in decision-making strategy during the experiment. The comprehension of the task might also have had an influence on the perceptual strategy of participants. A task with a clear focus on either friction or normal force would likely have impacted the psychophysical results. The actual tactile mechanisms triggered by a force vector applied on the skin are unknown and might be either peripheral or central. On one hand, humans are quite accurate at perceiving the 3D contact force magnitude on their static fingerpad 41, and peripheral tactile afferents seem to encode the force vector 14,24. On the other hand, it has been observed that slowly adapting (SA) tactile afferents predominantly discharge when the skin is indented by an object 50. Humans can scale tangential force independently of the applied normal force 51, supporting the possibility of separate pathways in the peripheral nervous system. A possible candidate for this integrative process is the somatosensory cortex, in which other important tactile features such as speed and direction are encoded 15. Other alternatives also exist, such as integration by the cuneate nucleus, which has been shown to encode strain distributions 52.
A limitation of this study is the control of the patterns of ultrasonic vibration rather than the tangential force itself. Although the ultrasonic modulation was carefully controlled and identical across trials from the same condition, the actual change in TF slightly varied both across the trials of each participant and especially across participants, since the effect of ultrasonic vibration on TF depends on the physiology of the finger 53 and on phenomena such as stick–slip 54. Despite these variations, the differences between conditions were consistent and robust, which enabled new insights into the perception of independent NF and TF changes. Generating TF changes with exact values in force units could become possible with direct control of the finger-surface tangential force, for which promising preliminary results exist 55. Another limitation was the friction range of the ultrasonic device, which caused us to implement different baseline values of TF for the conditions in which TF increased and for those in which it decreased. Finally, our task featured stimuli that lasted 0.5 s in the middle of a passive stroke and required participants to consciously process the tactile cues. Since humans sense frictional cues within milliseconds of starting to press on a surface 56, the perceptual mechanisms mediating the results of our study might be different from the mechanisms underlying grasp. In future studies, we believe it will also be interesting to investigate a broad range of contact conditions and tactile tasks in order to confirm and quantify the perceptual mechanisms at work. Better knowledge of the interplay between tangential and normal force components will result in the definition of novel metrics and benefit the development of more realistic haptic feedback in tactile applications.
Data availability
All the datasets and scripts used within this study are accessible in the following Edmond repository: https://doi.org/10.17617/3.OVAO6R.
References
Lederman, S. J. & Klatzky, R. L. Hand movements: a window into haptic object recognition. Cogn. Psychol. 19(3), 342–368 (1987).
Klatzky, R. L., Lederman, S. J. & Metzger, V. A. Identifying objects by touch: An “expert system”. Percept. Psychophys. 37(4), 299–302 (1985).
Weber, A. I. et al. Spatial and temporal codes mediate the tactile perception of natural textures. Proc. Natl. Acad. Sci. U. S. A. 110(42), 17107–17112 (2013).
Westling, G. & Johansson, R. S. Factors influencing the force control during precision grip. Exp. Brain Res. 53(2), 277–284 (1984).
Robles-De-La-Torre, G. The Importance of the sense of touch in virtual and real environments. IEEE Multimed. 13(3), 24–30 (2006).
Augurelle, A.-S., Smith, A. M., Lejeune, T. & Thonnard, J.-L. Importance of cutaneous feedback in maintaining a secure grip during manipulation of hand-held objects. J. Neurophysiol. 89(2), 665–671 (2003).
Robles-De-La-Torre, G. & Hayward, V. Force can overcome object geometry in the perception of shape through active touch. Nature 412(6845), 445–448 (2001).
Smith, A. M., Chapman, C. E., Donati, F., Fortier-Poisson, P. & Hayward, V. Perception of simulated local shapes using active and passive touch. J Neurophysiol. 102(6), 3519–3529 (2009).
Delhaye, B. et al. High-resolution imaging of skin deformation shows that afferents from human fingertips signal slip onset. Elife 10, e64679 (2021).
Dione, M., Watkins, R. H., Vezzoli, E., Lemaire-Semail, B. & Wessberg, J. Human low-threshold mechanoafferent responses to pure changes in friction controlled using an ultrasonic haptic device. Sci Rep. 11(1), 1–12 (2021).
André, T., Lévesque, V., Hayward, V., Lefèvre, P. & Thonnard, J.-L. Effect of skin hydration on the dynamics of fingertip gripping contact. J. R. Soc. Interface 8(64), 1574–1583 (2011).
Delhaye, B., Barrea, A., Edin, B. B., Lefèvre, P. & Thonnard, J.-L. Surface strain measurements of fingertip skin under shearing. J. R. Soc. Interface 13(115), 20150874 (2016).
Birznieks, I., Macefield, V. G., Westling, G. & Johansson, R. S. Slowly adapting mechanoreceptors in the borders of the human fingernail encode fingertip forces. J. Neurosci. 29(29), 9370–9379 (2009).
Khamis, H., Redmond, S. J., Macefield, V., & Birznieks, I. Classification of texture and frictional condition at initial contact by tactile afferent responses. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, 460–468 (Springer, 2014).
Saal, H. P. & Bensmaia, S. J. Touch is a team effort : interplay of submodalities in cutaneous sensibility. Trends Neurosci. 37(12), 689–697 (2014).
Jones, L. A. Kinesthetic sensing. In Human and Machine Haptics (MIT Press, 2000)
Barrea, A., Delhaye, B. P., Lefèvre, P. & Thonnard, J.-L. Perception of partial slips under tangential loading of the fingertip. Sci. Rep. 8(1), 7032 (2018).
Gueorguiev, D., Vezzoli, E., Mouraux, A., Lemaire-Semail, B. & Thonnard, J.-L. The tactile perception of transient changes in friction. J. R. Soc. Interface 14(137), 20170641 (2017).
Gueorguiev, D., Bochereau, S., Mouraux, A., Hayward, V. & Thonnard, J.-L. Touch uses frictional cues to discriminate flat materials. Sci. Rep. 6, 25553 (2016).
Skedung, L. et al. Feeling small: exploring the tactile perception limits. Sci. Rep. 3, 2617 (2013).
Arvidsson, M., Ringstad, L., Skedung, L., Duvefelt, K. & Rutland, M. W. Feeling fine - the effect of topography and friction on perceived roughness and slipperiness. Biotribology. 11, 92–101 (2017).
Smith, A. M. et al. Roughness of simulated surfaces examined with a haptic tool: effects of spatial period, friction, and resistance amplitude. Exp. Brain Res. 202(1), 33–43 (2010).
Klöcker, A., Wiertlewski, M., Théate, V., Hayward, V. & Thonnard, J.-L. Physical factors influencing pleasant touch during tactile exploration. PLoS ONE 8(11), e79085 (2013).
Birznieks, I., Jenmalm, P., Goodwin, A. W. & Johansson, R. S. Encoding of direction of fingertip forces by human tactile afferents. J. Neurosci. 21(20), 8222–8237 (2001).
Janko, M., Wiertlewski, M. & Visell, Y. Contact geometry and mechanics predict friction forces during tactile surface exploration. Sci. Rep. 8(1), 4868 (2018).
Platkiewicz, J., Lipson, H. & Hayward, V. Haptic edge detection through shear. Sci. Rep. 6, 23551 (2016).
Goodwin, A. W. & Wheat, H. E. Magnitude estimation of contact force when objects with different shapes are applied passively to the fingerpad. Somatosens Mot. Res. 9(4), 339–344 (1992).
Wheat, H. E., Salo, L. M. & Goodwin, A. W. Human ability to scale and discriminate forces typical of those occurring during grasp and manipulation. J. Neurosci. 24(13), 3394–3401 (2004).
Gueorguiev, D., Lambert, J., Thonnard, J-L. & Kuchenbecker, K. J. Changes in Normal Force During Passive Dynamic Touch: Contact Mechanics and Perception. IEEE Haptics Symposium (HAPTICS), 746–752 (2020)
Smith, A. M., Gosselin, G. & Houde, B. Deployment of fingertip forces in tactile exploration. Exp. Brain Res. 147(2), 209–218 (2002).
Panarese, A. & Edin, B. B. Human ability to discriminate direction of three-dimensional force stimuli applied to the finger pad. J. Neurophysiol. 105(2), 541–547 (2011).
Wu, B., Klatzky, R. L. & Hollis, R. L. Force, torque, and stiffness: Interactions in perceptual discrimination. IEEE Trans. Haptics 4(3), 221–228 (2011).
Khamis, H., Birznieks, I. & Redmond, S. J. Decoding tactile afferent activity to obtain an estimate of instantaneous force and torque applied to the fingerpad. J. Neurophysiol. 114(1), 474–484 (2015).
Yoshioka, T., Craig, J. C., Beck, G. C. & Hsiao, S. S. Perceptual constancy of texture roughness in the tactile system. J. Neurosci. 31(48), 17603–17611 (2011).
Lezkan, A. & Drewing, K. Processing of haptic texture information over sequential exploration movements. Atten. Percept. Psychophys. 80(1), 177–192 (2018).
Lamb, G. D. Tactile discrimination of textured surfaces: psychophysical performance measurements in humans. J. Physiol. 338(1), 551–565 (1983).
Lederman, S. J. The perception of surface roughness by active and passive touch. Bull. Psychon. Soc. 18(5), 253–255 (1981).
Tomlinson, S. E., Lewis, R., Liu, X., Texier, C. & Carré, M. J. Understanding the friction mechanisms between the human finger and flat contacting surfaces in moist conditions. Tribol. Lett. 41(1), 283–294 (2011).
Dinç, O. S., Ettles, C. M., Calabrese, S. J. & Scarton, H. A. Some parameters affecting tactile friction. J. Tribol. 113(3), 512–517 (1991).
Adams, M. J. et al. Finger pad friction and its role in grip and touch. J. R. Soc. Interface 10(80), 20120467 (2013).
Pongrac, H., Hinterseer, P., Kammerl, J., Steinbach, E. & Färber, B. Limitations of human 3D force discrimination. Human-Centered Robot. Syst. 2006 Oct 7 (2006)
Amberg, M. et al. STIMTAC: A Tactile Input Device with Programmable Friction. Proceedings of the 24th Annual ACM Symposium Adjunct on User Interface Software and Technology. 7–8. (ACM, New York, 2011)
Lederman, S. J. Tactile roughness of grooved surfaces: The touching process and effects of macro- and microsurface structure. Percept Psychophys. 16(2), 385–395 (1974).
Callier, T., Saal, H. P., Davis-Berg, E. C. & Bensmaia, S. J. Kinematics of unconstrained tactile texture exploration. J. Neurophysiol. 113, 3013–3020 (2015).
Connor, C. E., Hsiao, S. S., Phillips, J. R. & Johnson, K. O. Tactile roughness: neural codes that account for psychophysical magnitude estimates. J Neurosci. 10(12), 3823–3836 (1990).
Pedregosa, F. et al. Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011).
Ozdamar, I., Alipour, M. R., Delhaye, B. P., Lefevre, P. & Basdogan, C. Step-change in friction under electrovibration. IEEE Trans. Haptics. 13(1), 137–143 (2020).
Sahli, R. et al. Evolution of real contact area under shear and the value of static friction of soft materials. Proc. Natl. Acad. Sci. 115(3), 471–476 (2018).
Smith, A. M. & Scott, S. H. Subjective scaling of smooth surface friction. J. Neurophysiol. 75(5), 1957–1962 (1996).
Johansson, R. S. & Flanagan, J. R. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat. Rev. Neurosci. 10(5), 345–359 (2009).
Paré, M., Carnahan, H. & Smith, A. M. Magnitude estimation of tangential force applied to the fingerpad. Exp. Brain Res. 142(3), 342–348 (2002).
Hayward, V. et al. Spatio-temporal skin strain distributions evoke low variability spike responses in cuneate neurons. J. R. Soc. Interface 11(93), 20131015 (2014).
Pasumarty, S. M., Johnson, S. A., Watson, S. A. & Adams, M. J. Friction of the human finger pad: Influence of moisture, occlusion and velocity. Tribol Lett. 44(2), 117–137 (2011).
Derler, S. & Rotaru, G. M. Stick-slip phenomena in the friction of human skin. Wear 301(1–2), 324–329 (2013).
Huloux, N., Monnoyer, J., Boyron, M. & Wiertlewski, M. Overcoming the variability of fingertip friction with surface-haptic force-feedback. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, 326–337 (Springer, Cham, 2018)
Willemet, L., Kanzari, K., Monnoyer, J., Birznieks, I., & Wiertlewski, M. Initial contact shapes the perception of friction. Proc. Natl. Acad. Sci. 118(49)e2109109118 (2021)
Acknowledgements
This work was supported by the Max Planck Society and by the European Space Agency, Prodex, IAP VII/19 DYSCO (BELSPO, Belgian Federal Government). We would like to thank Dr. Céline Bugli for her contribution to the statistical analyses of this study.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
D.G., J.L., J-L.T., and K.J.K. designed research; D.G. and J.L. performed research; D.G., J.L., J-L.T., and K.J.K. analyzed data; D.G., J.L., J-L.T., and K.J.K. wrote the paper.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Gueorguiev, D., Lambert, J., Thonnard, JL. et al. Normal and tangential forces combine to convey contact pressure during dynamic tactile stimulation. Sci Rep 12, 8215 (2022). https://doi.org/10.1038/s41598-022-12010-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-12010-0