TY - GEN
T1 - Hierarchical rendering system based on viewpoint prediction in virtual reality
AU - Lu, Ping
AU - Zhu, Fang
AU - Li, Ping
AU - Kim, Jinman
AU - Sheng, Bin
AU - Mao, Lijuan
N1 - Funding Information:
Acknowledgement. This work was supported in part by the National Key Research and Development Program of China under Grant 2018YFF0300903, in part by the National Natural Science Foundation of China under Grant 61872241 and Grant 61572316, and in part by the Science and Technology Commission of Shanghai Municipality under Grant 15490503200, Grant 18410750700, Grant 17411952600, and Grant 16DZ0501100.
Publisher Copyright:
© 2020, Springer Nature Switzerland AG.
Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2020/10
Y1 - 2020/10
N2 - Virtual reality (VR) systems use multi-modal interfaces to explore three-dimensional virtual worlds. During exploration, the user may look at different objects of interest or in different directions. The field of view of human vision is 135∘× 160∘, but the one requiring the highest resolution is only in 1.5∘× 2∘. It is estimated that in modern VR, only 4% of the pixel resources of the head-mounted display are mapped to the visual center. Therefore, allocating more computing resources to the visual center and allocating fewer viewpoint prediction rendering techniques elsewhere can greatly speed up the rendering of the scene, especially for VR devices equipped with eye trackers. However, eye trackers as additional equipment may be relatively expensive and be harder to use, at the same time, there is considerable work to be done in the development of eye trackers and their integration with commercial head-mounted equipment. Therefore, this article uses an eye-head coordination model combined with the saliencey of the scene to predict the gaze position, and then uses a hybrid method of Level of Detail (LOD) and grid degeneration to reduce rendering time as much as possible without losing the perceived details and required calculations.
AB - Virtual reality (VR) systems use multi-modal interfaces to explore three-dimensional virtual worlds. During exploration, the user may look at different objects of interest or in different directions. The field of view of human vision is 135∘× 160∘, but the one requiring the highest resolution is only in 1.5∘× 2∘. It is estimated that in modern VR, only 4% of the pixel resources of the head-mounted display are mapped to the visual center. Therefore, allocating more computing resources to the visual center and allocating fewer viewpoint prediction rendering techniques elsewhere can greatly speed up the rendering of the scene, especially for VR devices equipped with eye trackers. However, eye trackers as additional equipment may be relatively expensive and be harder to use, at the same time, there is considerable work to be done in the development of eye trackers and their integration with commercial head-mounted equipment. Therefore, this article uses an eye-head coordination model combined with the saliencey of the scene to predict the gaze position, and then uses a hybrid method of Level of Detail (LOD) and grid degeneration to reduce rendering time as much as possible without losing the perceived details and required calculations.
KW - Eye-head coordination
KW - Hand track
KW - Hierarchical rendering
KW - LOD
KW - VR
UR - http://www.scopus.com/inward/record.url?scp=85096514776&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-61864-3_3
DO - 10.1007/978-3-030-61864-3_3
M3 - Conference article published in proceeding or book
AN - SCOPUS:85096514776
SN - 9783030618636
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 24
EP - 32
BT - Advances in Computer Graphics - 37th Computer Graphics International Conference, CGI 2020, Proceedings
A2 - Magnenat-Thalmann, Nadia
A2 - Stephanidis, Constantine
A2 - Papagiannakis, George
A2 - Wu, Enhua
A2 - Thalmann, Daniel
A2 - Sheng, Bin
A2 - Kim, Jinman
A2 - Gavrilova, Marina
PB - Springer Science and Business Media Deutschland GmbH
T2 - 37th Computer Graphics International Conference, CGI 2020
Y2 - 20 October 2020 through 23 October 2020
ER -