A WhatsApp assistant that tells policyholders what their insurance actually covers, built for an insurtech startup and serving 200K+ insurance clients.
- Role
- Technical lead and client lead. The startup brought the problem; I designed the original architecture, built the baseline and shipped the first version. From there I led a team of five (three engineers, a PM and me), owned the technical decisions and the client relationship, and set priorities with the client. Hands-on in the LangGraph agent code.
- Stack
- LangGraph, Gemini Flash (Vertex AI), Gemini embeddings, Postgres + pgvector, Redis (conversation memory), Twilio WhatsApp API, Google Cloud Platform
- Outcome
- Still in production and still improving. Brokers answer coverage questions faster and better, and the company serves a broader population with fewer people.
The problem was information asymmetry. People didn’t know what
their insurance covered, and agents couldn’t answer them fast
enough. Questions like “does my policy cover this?” or “which
hospitals can I go to?” waited in a queue for a human.
The assistant lives in WhatsApp. A user can ask about coverage,
find in-network hospitals, or ask for a copy of their policy and
get the PDF back in the chat.
Under the hood, a LangGraph agent routes each question. It
decides whether the question is about the general conditions, which
apply to everyone, or about the user’s specific policy. The general
conditions were chunked, embedded with Gemini and indexed in Postgres
with pgvector. Individual policies were processed and passed in as
context. Both were cross-referenced with a structured database of
hospitals and providers.
The system runs as several services. A Twilio client receives
and sends messages. A backend runs the agent and the LLM calls. A
database sits alongside, and side containers handle asynchronous work
such as summarizing a conversation once it ends and fetching policy
PDFs. Conversation memory lives in Redis; we built our own memory layer
before frameworks offered one. Part of the job was designing the GCP
architecture itself so the whole thing would hold up in production.