A taxonomy of the discourse relations between words and visual

Kenneth C C KONG*

*Corresponding author for this work

    Research output: Contribution to journalReview articlepeer-review

    38 Citations (Scopus)

    Abstract

    A document is mainly composed of words and images, but the complex relationship that binds these two completely different semiotic resources is usually taken for granted as transparent. The simple relations between words and images-'anchorage' and 'relay', identified by Barthes almost 30 years ago-are unable to deal with the complexity of their bond, made even more complex by current printing and computer technology. This paper aims to identify the potential relations that bind texts and images together by arguing for a multilevel description of their logico-semantic relationships. The multiple, evaluative and metaphorical functions of the relations will also be discussed. The data generated from the proposed framework can form an empirical corpus for quantitative analysis. Examples from a variety of sources will be used as examples to show how the framework can be operationalized.

    Original languageEnglish
    Pages (from-to)207-230
    Number of pages24
    JournalInformation Design Journal
    Volume14
    Issue number3
    DOIs
    Publication statusPublished - 2006

    Scopus Subject Areas

    • Library and Information Sciences

    User-Defined Keywords

    • Multimodality
    • Rhetorical structure
    • Systemic-functional linguistics
    • Visual analysis
    • Word-image interface

    Fingerprint

    Dive into the research topics of 'A taxonomy of the discourse relations between words and visual'. Together they form a unique fingerprint.

    Cite this