DIN SPEC
DIN SPEC 91527
Ziele, Methoden und Metriken für die automatisierte/teilautomatisierte Laufzeitüberwachung von KI-Systemen gegenüber nicht-adversarialer Leistungseinbußen; Text Englisch
Goals, Methods and Metrics for Automated/Semi-Automated Runtime Monitoring of AI Systems for Non-Adversarial Performance Degradations; Text in English
Verfahren
PAS
Einführungsbeitrag
This document defines methods and metrics that allow to measure the degradations in performance and health of AI-based systems and to detect their operational anomalies, including guidance regarding the following topics: - applicability of the method or metric for a given AI component of a system; - suitability of the method or metric given a type of expected degradation; - reference implementations of the methods and metrics for the exemplary use cases; - factual background information on statistical measures and their characteristics. Cyber security-related monitoring is excluded from the scope of this specification and left for future work. This document is intended for "AI developers", "AI testers", and "AI auditors".
