Saccade Landing Position Prediction for Gaze-Contingent Rendering

Elena Arabadzhiyska1,3 Okan Tarhan Tursun2Karol Myszkowski2 Hans-Peter Seidel2Piotr Didyk1,2
1Saarland University, MMCI 2MPI Informatik 3Intel Visual Computing Institute
Standard gaze-contingent rendering (top row) updates the image according to the current gaze prediction. Due to the system latency, during a saccade, there is a significant mismatch between the rendering and the actual gaze position (b, c). The method moves the foveated region to the actual gaze position only after a delay equal to the system latency (d). Our technique (bottom row) predicts the ending position of the saccade at its early stage and updates the image according to the new prediction as soon as it is available (b). Due to the saccadic suppression the user cannot observe the image manipulations during the saccade (b). When the saccade ends and the suppression is deactivated (c), the observer sees the correct image at the new gaze position with our method.

Abstract

Gaze-contingent rendering shows promise in improving perceived quality by providing a better match between image quality and the human visual system requirements. For example, information about fixation allows rendering quality to be reduced in peripheral vision, and the additional resources can be used to improve the quality in the foveal region. Gaze-contingent rendering can also be used to compensate for certain limitations of display devices, such as reduced dynamic range or lack of accommodation cues. Despite this potential and the recent drop in the prices of eye trackers, the adoption of such solutions is hampered by system latency which leads to a mismatch between image quality and the actual gaze location. This is especially apparent during fast saccadic movements when the information about gaze location is significantly delayed, and the quality mismatch can be noticed. To address this problem, we suggest a new way of updating images in gaze-contingent rendering during saccades. Instead of rendering according to the current gaze position, our technique predicts where the saccade is likely to end and provides an image for the new fixation location as soon as the prediction is available. While the quality mismatch during the saccade remains unnoticed due to saccadic suppression, a correct image for the new fixation is provided before the fixation is established. This paper describes the derivation of a model for predicting saccade landing positions and demonstrates how it can be used in the context of gaze-contingent rendering to reduce the influence of system latency on the perceived quality. The technique is validated in a series of experiments for various combinations of display frame rate and eye-tracker sampling rate.

Video

Downloads

Paper [PDF ~11MB]
Supplementary Material [ZIP ~147MB]

Citation

Elena Arabadzhiyska, Okan Tarhan Tursun, Karol Myszkowski, Hans-Peter Seidel, Piotr Didyk
Saccade Landing Position Prediction for Gaze-Contingent Rendering
To appear in: ACM Transactions on Graphics 36(4) (Proc. SIGGRAPH 2017, Los Angeles, California, USA)

@article{Arabadzhiyska2017,
author = { 
	Elena Arabadzhiyska and
	Okan Tarhan Tursun and
	Karol Myszkowski and  
	Hans-Peter Seidel and 
	Piotr Didyk},
  title = {Saccade Landing Position Prediction for Gaze-Contingent Rendering},
  journal = {ACM Transactions on Graphics (Proc. SIGGRAPH)},
  year = {2017},
  volume = {36},
  number = {4},
  doi = {10.1145/3072959.3073642},
  url = {http://dx.doi.org/10.1145/3072959.3073642}
}
Imprint | Data Protection