Skip to main content

Talk to Gladys from the dashboard with the voice assistant

The Voice assistant widget lets you talk to Gladys directly from your dashboard: speak a question, read the live transcription and AI response, and hear the answer read aloud on your device.

It uses Gladys Plus for speech-to-text, AI agent responses (open-weight models), and text-to-speech playback.

Prerequisites

  • A Gladys Plus subscription with your instance connected to the gateway.
  • A browser that supports microphone recording (Chrome, Firefox, Edge, Safari on recent versions).
  • A secure connection (HTTPS) to use the microphone. If you access Gladys remotely, open it via plus.gladysassistant.com.
  • Microphone permission granted in your browser (on Safari: Settings > Safari > Microphone).
note

Without Gladys Plus, the widget is displayed but the microphone stays disabled. A message invites you to connect your instance to Gladys Plus.

Add the widget to your dashboard

Go to the dashboard and click Edit.

Add a Voice assistant widget, then click Save.

No additional configuration is required: the widget is ready to use once Gladys Plus is connected.

Use the voice assistant

  1. Click the microphone button in the widget.
  2. Speak your question. Recording stops automatically when you stop talking.
  3. Gladys displays what you said and the AI response in the widget.
  4. The answer is played aloud on your device (text-to-speech).

The assistant takes into account your recent exchanges with Gladys to provide more contextual answers.

Widget states

StateMeaning
SpeakReady. Click the microphone to start.
Listening...Recording in progress. Speak now.
Processing...Gladys is transcribing your message and generating a response.
Speaking...The response is being read aloud.

Troubleshooting

ProblemWhat to do
Microphone disabledCheck that Gladys Plus is connected in Settings > Gladys Plus.
"The microphone requires a secure connection"Open Gladys via HTTPS, ideally at plus.gladysassistant.com.
Microphone blocked on SafariAllow microphone access in Settings > Safari > Microphone.
"Voice recording is not available in this browser"Try a recent version of Chrome, Firefox, Edge, or Safari.
Generic errorVerify your Gladys Plus connection and that your instance can reach the gateway.

Join the community, and get the latest news about the project!

Emails are sent by Pierre-Gilles Leymarie, founder of the project. You can unsubscribe at any time 🙂