This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

Table of contents

Introduction Eija Ventola and Martin Kaltenbacher 1-6 Part I - Multimodal Issues In between Modes: Language and Image in Printed Media Hartmut Stöckl 9-30

Modelling Multiple Semiotic Systems: The Case of Gesture and Speech Peter Muntigl 31-50

Problematising 'Semiotic Resource' Victor Lim Fei 51-62

Multimodality and Empiricism: Preparing for a Corpus-based Approach to the Study of Multimodal Meaning-making John Bateman, Judy Delin and Renate Henschel 65-87

Part II - Analyses and Applications

On the Effectiveness of Mathematics Kay O'Halloran 91-117

Multimodality in Language Teaching CD-ROMs Martin Kaltenbacher 119-136

The Multiple Modes of Dirty Dancing: A Cultural Studies Approach to Multimodal Discourse Analysis Markus Rheindorf 137-152

Multimodal Text Analysis and Subtitling Christopher Taylor 153-172

Multimodality in the Translation of Humour in Comics Klaus Kaindl 173-192

Multimodality in Operation: Language and Picture in a Museum Andrea Hofinger and Eija Ventola 193-209

Drawing on Theories of Inter-semiotic Layering to Analyse Multimodality in Medical Self-Counselling Texts and Hypertexts Eva Martha Eckkrammer 211-226

On the Multimodality of Interpreting in Medical Briefings for Informed Consent: Using Diagrams to Impart Knowledge Kristin Bührig 227-241

Index 243-248