AI voice agent
Lily
An AI voice agent that calls residents and listens
A voice-agent product for elder-care residences that captures how residents are really doing.
- Role
- Full-Stack
- Engagement
- Client work
Stack
- Next.js
- Node.js
- PostgreSQL
- Prisma
- BullMQ
- Gemini Live
- Twilio
- GCP
The problem
Care homes want to know how residents are actually feeling — whether anything is wrong before it becomes a crisis. Ask manually, through a form, and people stay quiet or give a polite non-answer. The honest picture never makes it to the people who could act on it.
What I built
Lily is an AI voice agent that calls each resident, talks with them in a friendly tone, and turns the conversation into structured, reviewable feedback.
- Forms and sequences
- Admins compose question sets and chain them into sequences.
- Custom call scheduling
- One-off or repeating, to a chosen group, at a chosen time.
- Tunable conversation
- Tone, wording and emphasis are configurable per sequence.
- Real phone calls
- Residents get a phone call — not an app to install or a form to fill in.
- Reviewable records
- The transcript, the answers and the recording, stored together.
How it is built
A scheduled call becomes a conversation, then a transcript, then answers you can read — with the recording kept alongside.
- How the calls work
- Gemini Live runs the conversation; Twilio places the call.
- Every call has a path
- Scheduled, spoken, transcribed, then turned into answers — each step recorded as it completes.
- Replies become answers
- However a resident phrases it, the reply is filed against the question that was asked.
The hard part
Making a machine sound like it cares
Designing prompts and pacing so an elderly resident keeps talking and gives honest answers.
What shipped
- An AI voice agent that calls residents and holds a natural conversation
- Admin-defined forms, sequences and call schedules
- Transcripts, structured answers and audio stored for review
- Version one built and deployed
Gallery
Have a problem like this?
Tell me about your business and I will tell you how I would approach it.
