LLM Guardrails

Edited

LLM processing is subject to:

  • Timeout limits

  • Retry logic

  • Safety override triggers

  • Transfer safeguards

If the LLM:

  • Fails to respond within the configured time

  • Encounters provider issues

ANET may:

  • Retry processing

  • Transfer via safeguard

  • Classify as agent_failure


How to Evaluate LLM Issues in Review

When reviewing a call:

  1. Open timeline view.

  2. Identify pauses between caller input and system response.

  3. Confirm whether:

    • The thinking indicator was used

    • Timeout occurred

    • Retry event logged

  4. Check if the transfer reason indicates agent_failure.

Do not assume every delay is an LLM failure.
Evaluate against configured timeout thresholds.