ISO/IEC 23002-3:2007 PDF

Overview

ISO/IEC 23002-3:2007 - "Information technology - MPEG video technologies - Part 3: Representation of auxiliary video and supplemental information" defines a standardized way to represent auxiliary video streams and associated supplemental information (SI) that supplements a primary video sequence. The standard introduces syntax and semantics for SI message streams used to describe how auxiliary video (for example, depth maps and parallax maps) should be interpreted alongside primary MPEG video content. Extensibility is built into the SI format so new types of auxiliary data can be accommodated in future extensions.

Key topics and requirements

• Auxiliary video streams: Data coded as video sequences that supplement a primary video sequence (first specified types: depth maps and parallax maps for stereoscopic content).
• SI message stream: A defined stream syntax for conveying metadata and interpretation information; multiple SI messages can be concatenated in one SI stream.
• AVSI (auxiliary video SI): The currently specified SI message type that characterizes how an auxiliary video sequence should be interpreted (e.g., flags indicating the auxiliary stream is a depth map and parameters required for correct rendering).
• Syntax and semantics: Rules for structuring SI messages so decoders and post‑processing systems can reliably interpret auxiliary video.
• Extensibility: The SI message format is generic and designed to support future SI types beyond AVSI. Reserved message types exist for later ISO/IEC specification.
• Scope limitation: Identification and linking of primary and auxiliary video streams at the system level is explicitly outside the standard’s scope.

Applications

ISO/IEC 23002-3:2007 is applicable wherever auxiliary video metadata must be carried and interpreted alongside primary MPEG video. Typical use cases include:

• Stereoscopic and 3D video workflows - conveying depth maps or parallax maps to enable stereo rendering, depth-aware processing, or view synthesis.
• Post-production and visual effects - providing machine‑readable auxiliary frames to guide compositing, depth-based effects, or depth-of-field simulation.
• Playback and decoder implementations - enabling decoders and rendering engines to correctly interpret auxiliary streams for correct display or conversion.
• Research and prototyping - transporting experimental auxiliary data in a standardized SI message stream for algorithm testing.

Primary users: systems and software engineers working on MPEG video encoders/decoders, 3D/stereo video producers, post-production tool vendors, and standards engineers integrating auxiliary-video workflows.

Related standards

• Other parts of the ISO/IEC 23002 family (MPEG video technologies) and broader MPEG video standards that define primary video coding, transport, and system-level linking are relevant when implementing complete solutions.