Overview
ISO/IEC 23090-14:2023/Amd 1:2023 is an amendment to the international standard for the coded representation of immersive media, specifically targeting Part 14: Scene Description. This amendment enhances the scene description framework by adding comprehensive support for immersive media codecs, enabling more efficient and standardized encoding, decoding, and presentation of immersive multimedia scenes. The standard is developed by the ISO/IEC Joint Technical Committee JTC 1, Subcommittee SC 29, which focuses on coding of audio, picture, multimedia, and hypermedia information.
Key Topics
This amendment focuses on enriching scene descriptions within immersive media through the integration of support for cutting-edge codecs, particularly those defined in MPEG-I standards. Key areas covered include:
- MPEG-I Codec Integration: Adds extensions to support Volumetric Video-based Coding (V3C) and Video-based Point Cloud Compression (V-PCC), enabling highly efficient representation of 3D volumetric video data.
- Scene Description Extensions: Defines new scene description elements such as the
MPEG_primitive_V3C extension to represent V3C compressed mesh data, facilitating 3D reconstruction in rendering engines.
- Buffer Formats: Specifies binary buffer formats for configuration and atlas data crucial for decoding and rendering V3C content, including baseline, extended, and MPEG Immersive Video (MIV) atlas data formats.
- Video Texture Formats: Expands supported pixel formats for video textures, introducing YCbCr alongside RGB variants, improving flexibility for multimedia developers.
- Track and Codec Management: Standardizes referencing of media tracks within various container formats (e.g., DASH, ISOBMFF, SDP) and clarifies codec signaling for mixed codec streams.
- Attribute Registries: Establishes attribute names and semantics related to volumetric point cloud properties, like reflectance and transparency, enhancing description fidelity.
- Normative Annexes: Includes comprehensive annexes detailing use cases, property definitions, and example implementations to aid adoption and interoperability.
Applications
This amendment plays a critical role in advancing technologies related to immersive media across a variety of applications:
- Virtual Reality (VR) and Augmented Reality (AR): Standardized scene description supports realistic 3D reconstruction of immersive environments, enabling immersive experiences with high-quality volumetric content.
- 3D Video Streaming and Broadcasting: Enables efficient delivery of immersive volumetric video streams in adaptive streaming environments by specifying codec support and track referencing.
- Gaming and Simulation: Provides developers with precise control over 3D scene elements and textures, improving performance and visual quality of volumetric assets in real-time applications.
- Media Production and Post-Production: Facilitates interoperability between content creation, encoding, and playback tools by standardizing scene descriptions and codec interactions.
- Immersive Media Platforms: Supports enhanced metadata and attribute descriptions necessary for advanced rendering engines to optimize playback of volumetric media.
Related Standards
ISO/IEC 23090-14:2023/Amd 1:2023 references and extends other important standards within the MPEG-I immersive media suite and related areas:
- ISO/IEC 23090-5: Visual Volumetric Video-based Coding (V3C) and Video-based Point Cloud Compression (V-PCC) codec specification.
- ISO/IEC 23090-12: Further relevant immersive media coding standards.
- ISO/IEC 23009-1:2019: Dynamic Adaptive Streaming over HTTP (DASH) standard used for segmented media delivery.
- ISO/IEC 14496-12:2020: ISO Base Media File Format (ISOBMFF), utilized for multiplexing and track referencing.
- OpenGL & Vulkan Specifications: Referenced for pixel format semantics and GPU shader interfacing, ensuring compatibility with modern graphics pipelines.
This amendment to ISO/IEC 23090-14 ensures future-proof scene description capabilities that embrace immersive media codecs-paving the way for innovative immersive experiences with improved interoperability, efficiency, and quality in multimedia applications.