ATLAS OF LANGUAGE

AT-DEP5-0015 · ATLAS 260

Multimodal communication

Communication in which language, voice, gaze, gesture, image, space or writing jointly produce meaning.

Part of the subject path Pragmatics and Conversation

Why is this entry in the Atlas?

G · Foundational concept R2 · Necessary foundation

Multimodal communication supplies the framework required to explain how coordinated modes jointly produce meaning within a communicative event. Several media can be present without evidence that their modes jointly organise meaning.

Colours and admission grounds

The rectangular label identifies the entry function: F – linguistic figure or procedure; A – analytical concept; G – foundational concept; E – selected concrete case. The rounded badge indicates the admission ground: R1 – distinctive contribution; R2 – necessary foundation; R3 – justified illustrative case. This editorial rationale explains the current selection rather than claiming an undocumented original selection history.

Explanation

Multimodal communication arises when language, voice, gaze, gesture, posture, image, writing, space, or technical design jointly produce meaning. Modes are not merely parallel decoration; they may complement, contradict, specify, or replace one another. Which resource becomes relevant depends on situation, accessibility, and cultural convention. Analysis first separates observable modes, describes each contribution, and then examines their coordination. It also asks what is lost when one channel fails and whether the arrangement remains accessible to people with different sensory conditions.

Movement of thought

1. All perceptible communicative modes are inventoried without privileging speech or writing in advance. 2. The distinct contribution of voice, gaze, gesture, image, space, and text is described separately. 3. Temporal and spatial coordination reveals complement, reinforcement, contradiction, substitution, or repair. 4. Removing individual channels exposes redundancy, dependence, and potential barriers to access. 5. Participant responses test which multimodal interpretation is actually achieved in common.

Scientific use case

Multimodality research, conversation analysis, media studies, semiotics, education, and accessibility research examine modal coordination through video annotation, eye tracking, and user tests. Analysis must include technological and sensory exclusions.

Example

During a safety briefing, a person points to the exit, speaks the route, marks it on a plan, and waits for confirming eye contact. Their coordinated combination makes direction and urgency unambiguous.

Counterexample

The mere presence of an image beside text is not analytically significant multimodal communication. Multiple modes must participate in meaning or action; decorative coexistence alone is insufficient.

Distinction

Distinguish multimodal communication from multimedia, nonverbal communication, transmediality, and illustration alone. Multimodality is coordinated meaning-making across modes in a situation; multimedia initially names the presence of several media forms.

Effect on thought and perception

Multimodal communication can secure understanding, specify spatial or emotional information, and open multiple routes of access. Poorly coordinated modes may contradict, overload, or exclude users.

Resonance

Meaning travels among voice, body, image, writing, and space. The modes answer one another, making the communicative current more than a sum of separate signals.

Cite this entry

Reich, Michael (Hrsg./ed.): „Multimodal communication“. Atlas der Sprache, AT-DEP5-0015. ATLAS 260, data model 1.6.0. https://atlasoflanguage.com/concept/AT-DEP5-0015

https://atlasoflanguage.com/concept/AT-DEP5-0015

The address remains stable; editorial content may evolve. Editorial reading state: 2026-10-15. Include your access date for precise references.

Historical background

Darwin considers voice, gestures and articulate language together as means of expression and communication. Communication is consequently not confined to spoken words in this account. The passage does not introduce the modern term multimodal communication or establish a theory of how modes are coordinated. His proposed inheritance mechanisms remain historical hypotheses rather than current findings.

How conceptual history changes the analysis

Test whether voice, gesture and wording reinforce, modify or contradict one another. Simultaneous availability alone does not prove coordinated meaning.

References for the historical section

Historical source evidence and Atlas applications remain separate; this import does not assert new first attestations or a fresh exhaustive source verification.