Please enable JavaScript.
Coggle requires JavaScript to display documents.
Topic: How people comprehend visual narratives (picture stories, comics,…
Topic: How people comprehend visual narratives (picture stories, comics, film)
Document info
Who take this note: Yi-Chun Chen (
YCC, Rimi
)
Paper info
Journal: Topics in Cognitive Science (2020)
The Scene Perception & Event Comprehension Theory (SPECT) Applied to Visual Narratives
Paper authors:
Adam M. Larson
Tim J. Smith
Lester C. Loschky
Joseph P. Magliano
Date: 2021/02/21
Previously
Theories
initial sensory
perceptual processing of complex visual scene
perception of event over time
comprehension of narratives
piecemeal approaches
Fail to capture the levels of processing
SPECT
front-end
eye
attentional selection
information extraction
back-end
event model construction
what is happen now in narrative
In working memory
entire narrative
in long-tern episodic memory
relationships between the front- and back-end
Medium-specific differences
research questions derived from SPECT
over multiple images / durable mental model of narrative
comprehension process (narrative comprehension)
understand the narrative
infer the goal
in text
Long
et al., 1992
in picture story
two extra fixations on details
Hutson et al., 2018
process be supported by representations of prior narrative context in working memory and episodic memory
Graesser, Millis,
& Zwaan, 1997
inferring the causal relationship between it and the prior narrative
context
establishing the relationship in implications
at the level of narrative event model
perceptual (visual perception)
basic perceptual building blocks of the scene
recognized very rapidly
smaller item need further fixation
Glanemann, 2008; Larson, Hendry, &
Loschky, 2012
Nelson & Loftus, 1980
within a single eye fixation
Fei-Fei, Iyer, Koch, & Perona, 2007
each additional fixation
attentionally select part of image
further processing
Deubel & Schneider, 1996
preconsciously
Belopolsky, Kramer, & Theeuwes, 2008; Memmert, 2006
research areas are seemingly disparate
a theoretical framework
how the processes are coordinated to support perception and understanding
integrative theoretical framework
SPECT
build on previous general cognition and their sub systems
scene perception
Henderson & Hollingworth, 1999; Irwin, 1996
event cognition
Radvansky
& Zacks, 2011, 2014
narrative comprehension
Gernsbacher, 1990; Zwaan
& Radvansky, 1998
pertains only to processing visual content
visual event and narrative cognition
stimulus features
front-end
back-end
stimulus
all visual narrative
different medium
varying degrees of complexity and realism
1 more item...
medium-agonistic mechanisms
2 more items...
front-end
extracting content
information extraction
broad (whole scene)
1 more item...
narrow (entities)
1 more item...
attentional selection
determines what information to process during single fixations
1 more item...
Where to eye be sent for next fixation
1 more item...
occur during single eye fixation
sent to working memory
activated semantic representations
earliest perceptual process
back-end
use output from front-end
event model in WM
particular type of mental model
1 more item...
occur in memory across multiple eye fixations
working memory (WM)
long-term memory (LTM)