ISO/IEC 23090-15:2022

Overview

ISO/IEC 23090-15:2022 - Information technology - Coded representation of immersive media - Part 15: Conformance testing for versatile video coding - specifies a normative set of tests and procedures to determine whether encoder or decoder implementations meet the requirements of Rec. ITU‑T H.266 | ISO/IEC 23090-3 (Versatile Video Coding, VVC). The standard defines how to use test bitstreams, the reference software decoder, and associated artifacts to verify bitstream conformance and decoder conformance for VVC profiles, tiers, and levels.

Key Topics and Requirements

• Scope and purpose: Provides procedures and test suites that indicate conformance of encoders and decoders to Rec. ITU‑T H.266 / ISO/IEC 23090-3.
• Bitstream conformance: Test a bitstream by decoding with the reference software decoder (see Rec. ITU‑T H.266.2 / ISO/IEC 23090-16). The bitstream must not cause errors or non-conformance messages; decoded picture hash SEI values (when present) must match the reference output.
• Decoder conformance: Defines tests for two classes of decoder behavior:
  • Output order conformance - decoded pictures must be output in the specified order.
  • Output timing conformance - decoded output timing must meet constraints defined in the VVC specification.
• Test artifacts and packaging: Conformance bitstreams are provided as electronic attachments (zip files) and include: *.bit (bitstream), *.txt (description), *.yuv.md5 (decoded YUV checksum), *.md5 (bitstream checksum), *.opl (output picture log), and sometimes *.cfg (encoder config).
• Test types: Static tests (output order), dynamic tests (timing), and targeted suites for profiles such as Main 10, Main 10 4:4:4, multilayer and still-picture profiles.
• Reference software: Use of the reference software decoder is specified; additional or complementary verifiers (including HRD checks) may be used for deeper validation.
• Parsing requirement: Conformance checking requires parsing the entire bitstream and verifying syntax elements used by the decoding process. Bitstream verifiers may perform checks at various stages of decoding.

Practical Applications

• Validate encoder outputs to ensure generated bitstreams conform to VVC syntax and semantics.
• Verify decoder implementations (software, firmware, hardware) for interoperability and compliance with specified profiles, tiers, and levels.
• QA and certification testing for chipsets, media players, streaming encoders, OTT platforms, and broadcast equipment.
• Regression testing and CI integration using the provided test suites and reference decoder to catch non-conformant behavior early.
• Compliance reporting for product documentation and procurement requirements.

Who should use this standard

• Codec implementers (encoder/decoder developers)
• Test labs and certification bodies
• SoC and chipset manufacturers
• OTT/broadcast QA teams and system integrators
• Standards bodies and interoperability test organizers

Related Standards

• Rec. ITU‑T H.266 | ISO/IEC 23090-3 - Versatile Video Coding (VVC) specification
• Rec. ITU‑T H.266.2 | ISO/IEC 23090-16 - Reference software for VVC

Keywords: ISO/IEC 23090-15:2022, conformance testing, versatile video coding, VVC, Rec. ITU‑T H.266, bitstream conformance, decoder conformance, reference software decoder, conformance test suites.