ISO/IEC 14496-23:2008

Overview

ISO/IEC 14496-23:2008 - Part 23 of the ISO/IEC 14496 (MPEG-4) series - defines Symbolic Music Representation (SMR) for encoding musical scores and their relationships to other audiovisual elements. SMR provides a logical, machine-readable structure of symbolic music events, their relationships, and rendering/synchronization instructions. The standard enables both visual rendering (music notation) and audible playback, and supports synchronization with other media types for rich multimedia applications.

Key Topics and Requirements

• SM-XF (Symbolic Music Extensible Format): An XML-based language specified for encoding musical content including main scores, individual parts, and associated lyrics.
• SM-FL (Symbolic Music Formatting Language): An XML-based formatting language that defines rendering rules applied to SM-XF for visual or audible presentation.
• SM-SI (Symbolic Music Synchronization Information): A binary format that describes synchronization between SMR elements and other audiovisual streams.
• Bitstream syntax and semantics: The standard defines the syntax and semantics of the SMR bitstream, ensuring consistent encoding and decoding across implementations.
• Support for diverse notations: SMR accommodates a wide range of symbolic music types and styles (e.g., chant, Renaissance, classical, modern, Korean notation, simplified children’s notation, Braille).
• Separation of content, formatting, and synchronization: Clear modularization between score data, formatting rules, and sync information for flexible rendering and reuse.

Practical Applications

• Interactive multimedia and broadcast: synchronize scores with video/audio in set-top boxes, interactive TV, and streaming platforms.
• Education and edutainment: distance learning tools, music tutoring, score annotation and practice applications.
• Music production and rehearsal: digital score libraries, part extraction for rehearsal, and accompaniment synchronization.
• Accessibility: representation of Braille and alternative notations for visually impaired users.
• Consumer devices and mobile apps: portable practice tools, notation viewers, and mobile music education apps.

Who Uses This Standard

• Software developers building music notation editors, score renderers, and playback engines
• Multimedia integrators and broadcasters implementing synchronized audiovisual experiences
• Educational technology vendors and distance-learning platforms
• Consumer electronics manufacturers (set-top boxes, mobile device makers)
• Musicologists, archivists, and accessibility solution providers

Related Standards

• ISO/IEC 14496 (MPEG-4) family - SMR is Part 23 of this series
• Common music interchange formats (for context): MusicXML, MIDI - used in the broader ecosystem of symbolic music encoding and interchange

ISO/IEC 14496-23:2008 is essential where precise, interoperable encoding of symbolic music, its formatted rendering, and synchronization with other media are required.