›

Thinking (LLM)

›

LLM

LLM

Large Language Model

WHAT IT MEANS

The “brain” of the voice agent. It understands what the caller said and decides what to say next. Examples: GPT, Gemini, Claude, Llama.

Real example

Customer: “I lost my job, can I pay later?” The LLM works out the intent and responds with care.

What’s normal

Faster, smaller models are often used for voice, because big models can be too slow.

The India angle

Indian models like Sarvam may do better on Indian languages and context, and help with data-location concerns.

Questions to ask your vendor

  1. Which LLM do you use, and why?

  2. Can we switch the model later?

  3. Where is the model hosted?

Was this helpful?