ISO/IEC 14496-1:2010

Overview

ISO/IEC 14496-1:2010 (MPEG‑4 Systems) specifies the system‑level framework for coding and communicating interactive audio‑visual scenes. It defines how encoded elementary streams (audio, video, text, fonts, scene description, interaction) are identified, synchronized, multiplexed and delivered so that a receiver (terminal or player) can reconstruct, compose and present interactive audio‑visual content. The standard focuses on metadata, timing and buffer models, synchronization, object descriptors and the interfaces to delivery and protection systems.

Key topics and technical requirements

• Systems Decoder Model: abstract terminal behavior including a timing model (clock references and time stamps) and a buffer model for predictable decoding and synchronization.
• Synchronization (Sync Layer – SL): packetized representation (SL‑packetized streams) that carries timing, fragmentation and random access information to keep elementary streams synchronized.
• Object Description Framework: object descriptors and elementary stream descriptors that identify, describe and associate streams with audio‑visual objects; includes object content information (OCI).
• Delivery Layer Interface (DMIF): a generic interface to diverse transport/storage mechanisms; enables session setup and abstracts the underlying transport (defined in Part 6).
• Multiplexing (M4Mux): a lightweight multiplexing tool for low‑delay, low‑overhead multiplexed streams when delivery mechanisms are insufficient.
• IPMP Interface: a generic interface to Intellectual Property Management and Protection systems.
• Syntactic Description and Profiles: definition of a syntactic description language, profiles and normative/ informative annexes (timing reconstruction, registration procedures, QoS model, mappings to AVC, etc.).

Applications and who uses it

ISO/IEC 14496-1:2010 is essential for:

• Media platform and streaming developers implementing synchronized delivery of audio, video, captions, fonts and interactive elements.
• Player and device manufacturers ensuring correct buffer management, timing and scene composition across streams.
• Codec and container implementers that need standardized metadata, sync layers and multiplexing behavior (e.g., implementations interoperating with MP4 files and streaming systems).
• Content providers and broadcasters packaging interactive presentations for storage or delivery over IP, broadcast or file systems.
• Standards engineers and conformance testers validating timing, descriptors and synchronization against the systems decoder model.

Related standards

ISO/IEC 14496 is a multipart standard. Relevant parts include:

• Part 2: Visual
• Part 3: Audio
• Part 6: Delivery Multimedia Integration Framework (DMIF)
• Part 10: Advanced Video Coding (AVC)
• Part 11: Scene description and application engine
• Part 12 / Part 14: ISO base media file format / MP4 file format (see the Foreword of ISO/IEC 14496‑1:2010 for the full list)

Keywords: ISO/IEC 14496-1:2010, MPEG‑4 Systems, audio‑visual objects, sync layer, object descriptors, M4Mux, DMIF, synchronization, MP4, systems decoder model.