ISO/IEC 14496-11:2015

Overview

ISO/IEC 14496-11:2015 (MPEG‑4 Part 11) defines the scene description and application engine for MPEG‑4 systems. It standardizes how audio‑visual objects are positioned, composed and made interactive in time and space (the scene description), provides the Extensible MPEG‑4 Textual (XMT) XML-based representation for authoring and interchange, and specifies the system-level model for an application engine (MPEG‑J) that delivers and manages downloadable Java bytecode applications. Key building blocks include the Binary Format for Scenes (BIFS), node semantics for scene graphs, the textual XMT formats, and MPEG‑J APIs and lifecycle rules.

Key Topics and Requirements

• Spatio‑temporal positioning: Syntax and semantics for locating 2D/3D audio‑visual objects, local coordinate systems and hierarchical scene graphs.
• Scene behavior and interaction: Mechanisms to describe object attributes, animations and client‑side interactive behaviors so scenes respond deterministically to user events.
• BIFS (Binary Format for Scenes): Binary bitstream format that encodes scene graphs, node semantics, animation (BIFS‑Anim), quantization and decoder data structures.
• XMT (Extensible MPEG‑4 Textual format): XML representations (e.g., XMT‑A, XMT‑Ω) to author, interchange and map MPEG‑4 scene descriptions to related web standards (X3D, SMIL).
• MPEG‑J application engine: System‑level description for delivery, lifecycle, security and behavior of downloadable Java byte code applications used within MPEG‑4 scenes.
• Profiles, font metrics and implementation notes: Normative and informative annexes covering implementation guidance (e.g., font metrics, texture algorithms, procedural animation).
• Interoperability: Compatibility guidance with VRML/X3D and integration points for synchronized multimedia.

Applications and Who Uses It

ISO/IEC 14496-11 is used by:

• Multimedia system implementers (players, set‑top boxes, mobile platforms) to support object‑based rendering and interaction.
• Authoring tool vendors and content creators for producing editable, exchangeable scene descriptions using XMT.
• Application developers leveraging MPEG‑J to deploy downloadable Java apps that augment scenes (UI, interactivity, logic).
• Streaming and OTT services and smart device manufacturers that need standardized scene composition, interactive overlays and synchronized audio‑visual presentation.

Practical use cases include interactive 2D/3D presentations, synchronized media playback with clickable/animated objects, avatar and facial animation pipelines, and multimedia applications requiring downloadable behavior (Java) executed at the client.

Related Standards

• ISO/IEC 14496 (MPEG‑4) family - Parts 1 (Systems), 2 (Visual), 3 (Audio), 12 (ISO base media file format), 14 (MP4 file format), and others.
• Compatibility references: VRML / X3D and W3C SMIL for textual and web‑oriented representations.

Keywords: ISO/IEC 14496-11:2015, MPEG‑4 Part 11, scene description, BIFS, XMT, MPEG‑J, scene graph, spatio‑temporal positioning, interactive multimedia.