ISO/IEC 20741:2017 PDF

Overview

ISO/IEC 20741:2017 - "Systems and software engineering - Guideline for the evaluation and selection of software engineering tools" provides a generic, adaptable framework for objectively evaluating and selecting software engineering tools that support portions or the full software life cycle. The standard defines processes, activities and measurable characteristics to compare candidate tools and recommend the most appropriate option. It is intentionally focused on evaluation and selection (not implementation), and can be applied to COTS/FOSS tool choices as an alternative to new development.

Key technical topics and requirements

• Evaluation & selection processes: Defines a sequence of generic processes (Preparation, Structuring, Evaluation, Selection) with associated activities and tasks to produce repeatable, impartial results.
• Goal setting and selection criteria: Guidance for identifying organizational requirements and mapping them into measurable selection criteria (characteristics to be evaluated).
• Requirements definition and candidate identification: Methods for collecting tool information and narrowing final candidates for detailed assessment.
• Measurement-based evaluation: Emphasis on quantitative, comparable measurements of defined characteristics and use of selection algorithms to rank candidates.
• Tool characteristics: Aligns with ISO/IEC 25010 quality model; covers functionality, performance efficiency, compatibility, usability, reliability, security, maintainability, portability, plus acquisition, implementation and support indicators.
• Reporting and validation: Templates and content for evaluation reports and recommendations, and steps to validate the selection decision.
• Scope limitations: Not intended for general-purpose office tools, extremely narrow-purpose tools (e.g., a single compiler), software engineering frameworks focused on integration, nor for planning tool implementation. The standard does not guarantee successful implementation - it supports best-practice selection.

Practical applications and intended users

• Primary users: Organizations planning to adopt or replace software engineering tools (e.g., requirements, testing, configuration management, CI/CD).
• Secondary users: Tool suppliers preparing objective descriptions of tool characteristics for procurement and comparison.
• Common use cases:
  • Selecting a requirements management or configuration management tool using a repeatable, auditable process.
  • Comparing multiple COTS/FOSS solutions against organizational quality and integration criteria.
  • Establishing organizational minimum processes for procurement or trade specifications.
• Benefits: Reduces selection risk and cost, supports objective vendor comparisons, and helps integrate tool choices into broader technology adoption workflows.

Related standards

• ISO/IEC 25010 (software product quality model) - quality characteristics mapping
• ISO/IEC 25041 (product evaluation model) - evaluation guidance
• Tool-area standards (examples): ISO/IEC 30130 (software testing tools), ISO/IEC TR 24766 (requirements engineering tools), ISO/IEC TR 18018 (configuration management tools)
• ISO/IEC 15940 - guidance on defining tool-area services

Keywords: ISO/IEC 20741:2017, software engineering tools, tool evaluation, tool selection, selection process, tool characteristics, COTS, FOSS, software lifecycle.