ST-SIM: Spectral Temporal SIMilarity Measure for Vibrotactile Quality Assessment

HAPTIC

 Kinethestic Force-Feedback Signals Quality Assessment

PVC-SLP: Perceptual Vibrotactile Codec

Humans vibrotactile sensitivity varies with different vibratory stimuli. The frequency response reaches maximum sensitivity in the region of 200-300 Hz. This sensitivity-frequency characteristics has been extensively studied in a series of psychophysical experiments on human glabrous skin. To this end, we design a perceptual codec for vibrotactile signals that models the tactile human sensitivity characteristics which employed to remove perceptually irrelevant infromation in vibrotactile signals. The codec is based on sparse linear prediction (SLP) coding. PVC-SLP has been selected as the IEEE tactile codec standard by IEEE P1918.1.1 Haptic Codecs for the Tactile Intern working group.

Finding ways to automatically and accurately predict the tactile content quality as perceived by end-users can largely impact advances in Tactile Internet and haptic telecommunication systems. We focus our attention here to vibrotactile signals which pertain to the roughness submodality of tactile perception. VibroTactile Quality Assessment (VTQA); unlike speech, image, video; is hampered by various hurdles including the plethora of vibrotactile acquisition/display systems that are used in recording and delivering the tactile test materials, as well as aspects related to limited humans sensitivity to high-frequency vibrations of tactile stimuli. That said,  we proposed an objective vibrotactile quality assessment measure called Spectral Temporal SIMilarity (ST-SIM) and a novel subjective test procedure. Together serve as a holistic framework for benchmarking Tactile Codecs (TC) in terms of efficiency and transparency.

Teleoperation systems use haptic interface, like the Force Dimension Omega.6 in the figure, to transmit force feedback and velocity (haptic data) generated by the physical interaction with objects in remote real or virtual environments. This technology enables a wide variety of applications including remote operations in dangerous environments, long distance medical diagnostics and surgeries, and interactive games. However, haptic data demands real-time processing with strict delay constraints and high update rates up to the sampling rate (1kHz or more). Hence limit the use of any signal processing and compression algorithms that introduce algorithmic delay. In this context, an important question arises : How can one judge and compare the quality of compressed haptic signals for haptic communication? 

To this end, a virtual environment application was built and implemented using C++ and the CHAI 3D software library for computer haptics as shown in the Figure. The resulting force, during the interaction with virtual objects, is computed by modelling a virtual spring between the position of the haptic device end-effector and a virtual proxy using the finger-proxy model in CHAI 3D. The force-feedback test sequences were distorted using the perceptual deadband compression technique. The proposed HSSIM, that contains a ”perceptual model” block and a method to quantify the distortion between reference and test force feedback represented by the SSIM, is used to assess force signal quality. More details can be found in:

 

 

  • Rania Hassen and Eckehard Steinbach.  "HSSIM: An Objective Haptic Quality Assessment Measure for Force-Feedback Signals". IEEE Quality  of Multimedia Experience QoMEX ' 18, Cagliari, Italy, May 26-28, 2018.

 

VISUAL

Sharpness is an important determinant in visual assessment of image quality. The human visual system is able to effortlessly detect blur and evaluate sharpness of visual images, but it still yet a challenging task for computers. Existing blur/sharpness evaluation algorithms are mostly based on edge width, local gradient, or energy reduction of global/local high frequency content. In this work, a no-reference sharpness assessment algorithm is developed based on the identification of sharpness from a different perspective as strong local phase coherence (LPC) near distinctive image features evaluated in the complex wavelet transform domain.

    Image Sharpness Assessment Based on Local Phase Coherence

    Detailed description is given in the following paper:

    • R. Hassen, Z. Wang, M. Salama, "Image Sharpness Assessment Based on Local Phase Coherence", IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2798-2810, July 2013.
    • R. Hassen, Z. Wang, M. Salama, "No-Reference Image Sharpness Assessment Based On Local Phase Coherence Measurement", IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'10), Dallas, Texas, U.S.A, March 15-19, 2010.
    • Rania Hassen, Gülecyüz, Basak; Steinbach Eckehard: PVC-SLP: Perceptual Vibrotactile-Signal Compression based-on Sparse Linear Prediction. IEEE Transactions on Multimedia 22 (12), 2020.
    • Rania Hassen, Eckehard Steinbach.  "Vibrotactile Signal Compression Based on Sparse Linear Prediction and Human Tactile Sensitivity Function", IEEE (WHC ' 19), Japan, July 9-12, 2019.
    • Rania Hassen, Eckehard Steinbach.  "Subjective Evaluation of the Spectral Temporal SIMilarity (ST-SIM) Measure for Vibrotactile Quality Assessment", IEEE Transaction on Haptics, in press, 2019.
    • Rania Hassen, Eckehard Steinbach.  "Vibrotactile Signal Compression Based on Sparse Linear Prediction and Human Tactile Sensitivity Function", IEEE World Haptics Conference (WHC ' 19), Japan, July 9-12, 2019.

    A Tactile Computer Mouse for the Display of Surface Material Properties

    Rich tactile feedback that guides your interaction with objects in your surrounding environment requires the omnipresence of the tactile 5 dimensions. That said, we designed and built a novel haptic display device on the basis of a computer mouse. The tactile computer mouse enables the simoultauous perception of all tactile dimensions.

     

    A series of subjective experiments were conducted to determine how precisely TCM users match the real materials to corresponding virtual material representations in the absence of any visual/audible clues. Experimental results show that the TCM successfully displays the five tactile dimensions and that study participants were able to perceive the created tactile sensation of all 10 different virtual surface materials with a recognition rate of 89.6%.

    • Matti Stesse, Rania Hassen, Andreas Noll, Eckehard Steinbach. "A Tactile Computer Mouse for the Display of Surface Material Properties," in IEEE Transactions on Haptics, vol. 12, no. 1, pp. 18-33,  2019.

    In the shown Figure, an exmaple of a natural image and its corresponding LPC map are depicted. The image has been blurred using Gaussian blur filter with various sigma values. The LPC-SI gives a very good estimation of the sharpness quality of each degraded image. The code is avalibe to test.