TY - JOUR
T1 - A taxonomy of the discourse relations between words and visual
AU - Kong, Kenneth
N1 - Funding Information:
* I would like to thank the Research Grant Committee of Hong Kong SAR for their generous support to the project on which this paper is based (RGC research project # HKBU2162/ 03H). Every attempt has been made to obtain permission to reproduce copyright material. If any proper acknowledgement has not been made, or permission not received, I would be glad to hear from the copyright holders.
PY - 2006
Y1 - 2006
N2 - A document is mainly composed of words and images, but the complex relationship that binds these two completely different semiotic resources is usually taken for granted as transparent. The simple relations between words and images-'anchorage' and 'relay', identified by Barthes almost 30 years ago-are unable to deal with the complexity of their bond, made even more complex by current printing and computer technology. This paper aims to identify the potential relations that bind texts and images together by arguing for a multilevel description of their logico-semantic relationships. The multiple, evaluative and metaphorical functions of the relations will also be discussed. The data generated from the proposed framework can form an empirical corpus for quantitative analysis. Examples from a variety of sources will be used as examples to show how the framework can be operationalized.
AB - A document is mainly composed of words and images, but the complex relationship that binds these two completely different semiotic resources is usually taken for granted as transparent. The simple relations between words and images-'anchorage' and 'relay', identified by Barthes almost 30 years ago-are unable to deal with the complexity of their bond, made even more complex by current printing and computer technology. This paper aims to identify the potential relations that bind texts and images together by arguing for a multilevel description of their logico-semantic relationships. The multiple, evaluative and metaphorical functions of the relations will also be discussed. The data generated from the proposed framework can form an empirical corpus for quantitative analysis. Examples from a variety of sources will be used as examples to show how the framework can be operationalized.
KW - Multimodality
KW - Rhetorical structure
KW - Systemic-functional linguistics
KW - Visual analysis
KW - Word-image interface
UR - http://www.scopus.com/inward/record.url?scp=43249149796&partnerID=8YFLogxK
U2 - 10.1075/idj.14.3.04kon
DO - 10.1075/idj.14.3.04kon
M3 - Review article
AN - SCOPUS:43249149796
SN - 0142-5471
VL - 14
SP - 207
EP - 230
JO - Information Design Journal
JF - Information Design Journal
IS - 3
ER -