Scholarly record
PERCEPTION AND DESCRIPTION OF PAINTINGS
Abstract
The aim of our study was to reveal the relationship between visual perception of the painting during free viewing and the following verbalization of the perceived information. Eye movements were recorded while 30 subjects were looking at the classic painting of a genre scene, and then they were asked to compose coherent verbal description of this painting. Comparative analysis revealed strong correlation between distribution and duration of the gaze fixations during free viewing and the following narration. The more and the longer the gaze was directed to the certain region of the picture, the more words were dedicated to it in the verbal description. The greatest effect was notably demonstrated in relationship between fixations count and words count. Also, a relevant correlation between the ordinal sequence of first gaze fixations on depicted objects and the order these objects mentioned in the narrations was found. On the whole, our results showed that the way humans perceive visual information forms the way they express it in natural language.
Publication Impact Profile
Publication details
References13
Cooper R., The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing, Cognitive Psychology, vol. 6(1), pp. 84–107, 1974.
Allopenna P. D., Magnuson J. S., Tanenhaus M. K., Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models, Journal of Memory & Language, vol. 38(4), pp. 419–439, 1998.
Eberhand K. M., Spivey-Knowlton M. J., Sedivy J. C., Tanenhaus M. K., Eye movements as a window into real-time spoken language comprehension in natural contexts, Journal of Psycholinguistic Research, vol. 24, pp. 409–436, 1995.
Tanenhaus M. K., Spivey-Knowlton M. J., Eberhard K. M., Sedivy J. C., Integration of visual & linguistic information in spoken language comprehension, Science, vol. 268(5217), p. 1632, 1995.
Meyer A. S., Belke E., Early activation of object names in visual search, Psychonomic Bulletin & Review, vol. 14(4), pp. 710–716, 2007.
Griffin Z. M., Bock J. K., What the eyes say about speaking, Psychological Science, vol. 11(4), pp. 274–279, 2000.
Buswell G.T., How People Look at Pictures, Chicago, IL: University of Chicago Press, 1935.
Fischer T., Graupner S. T., Velichkovsky B. M., Pannasch S., Attentional dynamics during free picture viewing: Evidence from oculomotor behavior and electrocortical activity, Frontiers in Systems Neuroscience, vol. 7(17), pp. 8–16, 2014.
Slive S., Rosenberg J., Dutch Painting 1600-1800, New Haven: Yale University Press, 1995.
Reingold E.M., Charness N., Pomplun M., Stampe D. M., Visual span in expert chess players: Evidence from eye movements, Psychological Science, vol. 12 (1), pp. 48–55, 2001.
Loftus G. R.,Eye fixations and recognition memory for pictures, Cognitive Psychology, vol. 3, pp. 525–551, 1972.
Hsiao J. H., Cottrell G., Two fixations suffice in face recognition, Psychological Science, vol. 19, pp. 998–1006, 2008.
Herzog G., Wazinski P., VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions, Artificial Intelligence Review, vol. 8, pp. 175–187, 1994.
View or Download full articleAccess options
SWS access login
Login as SWS Scientific CommitteeLogin as SWS Scientific PartnerLogin as SWS AuthorAuthors and approved SWS contributors will read and export their own linked papers after identity matching by SWS profile, email and SGEM GlobalID.
For librarian assistance: [email protected]
Purchase Instant Access
- Article can be downloaded after successful payment.
- Article may be used according to SWS library access terms.
- Article cannot be redistributed.
