Skip to main content
AI Risk Score
Updated over a year ago

Introduction

In our system, the AI Risk Score is a crucial metric that quantifies the potential risks associated with each interaction. This formal explanation outlines the step-by-step process utilized to calculate the AI Risk Score, ensuring transparency and clarity for our valued customers.

Process

  1. Counting Violations: Firstly, we systematically count the number of violations observed during the interaction. These violations are categorized into two types: prohibited violations and mandatory violations.

  2. Assigning Weights: Each violation type is assigned a specific weight based on its severity. The weights are categorized as Low, Medium, or High, reflecting the relative importance of the violation in terms of risk assessment.

  3. Calculating Weighted Violations: We then proceed to calculate the weighted value of each violation type. To achieve this, we multiply the number of occurrences of each violation type by its corresponding weight. This process ensures that more critical violations carry greater significance in the final AI Risk Score.

  4. Determining Sum of Products: Next, we sum the products obtained from the previous step. The resulting value represents the sum_weight, which serves as an intermediate parameter in the AI Risk Score calculation.

  5. Utilizing the Sigmoid Function: To derive the final AI Risk Score, we employ a variation of the sigmoid function. The sigmoid function is a mathematical formula commonly used to map input values to a range between 0 and 1 for a diminishing returns behaviour. It is defined by the formula f(x) = 1 / (1 + e^(-x)).
    ​

    The sigmoid function (a.k.a. the logistic function) and its derivative


    In our context, the input value x corresponds to the sum_weight obtained from the weighted violations. The sigmoid function's application ensures that the AI Risk Score is bounded between 0 (indicating minimal risk) and 1 (indicating high risk). By using this mathematical transformation, we provide a normalized and interpretable risk score for each interaction.

Conclusion

The AI Risk Score is an essential tool in evaluating potential risks associated with AI interactions. By meticulously counting and weighing violations and employing the sigmoid function, we can accurately quantify and express the risk level of each interaction on a scale from 0 to 1. This transparent and standardized approach empowers our customers with valuable insights into the safety and reliability of our AI systems, ensuring an enhanced user experience and trust in our services.

Did this answer your question?