How to Replace Alexa With a Private Local Voice Assistant

Replace Alexa with Home Assistant Voice: the hardware, the local speech engines, setup steps, what you lose, and a 30-day test before you unplug the Echo.

Disclosure: this post contains affiliate links. If you buy through one, this site earns a commission at no extra cost to you. See the privacy policy.

As an Amazon Associate I earn from qualifying purchases.

AI Life / Voice & Assistants / Smart Speakers

Short answer: to replace Alexa with a private voice assistant, run Home Assistant on a small box at home, add a Home Assistant Voice Preview Edition speaker, and pick local speech engines: Speech-to-Phrase or Whisper to hear you and Piper to answer. Your commands never leave the house. It’s excellent for lights, locks and timers, and weaker at trivia and music than Alexa.

What do you need to replace Alexa?

PickPartWho it’s forMain tradeoffAmazon
Our pickHome Assistant Voice Preview EditionThe official, open voice speakerSmall speaker, not for musicAmazon
Budget pickYour phone with the Home Assistant appTrying local voice before buying hardwareNo always-listening wake word in the roomFree app
Upgrade pickA mini PC with a GPU or recent CPU running Home AssistantWhisper plus a local AI model for open questionsMore setup, more power drawSearch your preferred maker
Also greatHome Assistant GreenA plug-and-play server for Speech-to-PhraseToo slow for Whisper or a local AI modelHome Assistant store

I haven’t run this setup myself. This guide is built from Home Assistant’s own documentation, linked throughout, and independent write-ups.

Home Assistant Voice Preview Edition: our pick

Who it’s for: anyone who wants a speaker that talks only to their own Home Assistant. Why: it’s the official open hardware satellite from the Open Home Foundation, with a wake word, a mute switch, a dial and good microphones (Home Assistant). It works with local engines or with Home Assistant Cloud. Flaws: “Preview” is honest. The speaker is fine for answers and timers, not for music. Plug it into a better speaker through its audio out, or play music on a Sonos.

Your phone: budget pick

Who it’s for: anyone not sure yet. Why: the Home Assistant app on Android and iOS can talk to the same Assist pipeline, so you can test the whole setup before you buy a speaker. Flaws: you have to pick up the phone. It’s a trial, not a replacement.

A faster server: upgrade pick

Who it’s for: people who want the local assistant to handle open-ended questions. Why: Whisper and a local AI model need real compute. Home Assistant notes Whisper takes around 8 seconds per command on a Raspberry Pi 4 and under a second on an Intel NUC (Home Assistant). Flaws: more cost up front, more power draw and more to maintain.

How do you set up a local voice assistant?

Follow Home Assistant’s official guide; here’s the short path (Home Assistant docs):

  1. Install Home Assistant on a Green, a Raspberry Pi or a small PC, and add your lights, locks, thermostat and sensors.
  2. Install the speech apps. Choose Speech-to-Phrase or Whisper for speech-to-text, and Piper for text-to-speech. Start them. The Wyoming integration discovers them under Settings > Devices & services. Add each one.
  3. Create the assistant. In Settings > Voice assistants, add an assistant. Set the conversation agent to Home Assistant, speech-to-text to your engine and text-to-speech to Piper.
  4. Expose your devices. Assist can only control what you expose to it. Start with lights and the thermostat. Hold off on locks and the garage door.
  5. Pair the Voice Preview Edition and choose your new assistant.
  6. Add aliases. Name devices the way your family talks: “kitchen lights,” not “Hue Ambiance 3.”
  7. Test simple commands: “turn off the kitchen lights,” “set a timer for ten minutes,” “what’s the temperature inside.”

Speech-to-Phrase or Whisper: which should you use?

Use Speech-to-Phrase for home control on modest hardware; use Whisper if you have a fast server and want open questions.

Speech-to-PhraseWhisper
How it worksRecognizes only phrases it knowsTries to transcribe everything
Speed on a Pi 4 or GreenUnder one secondAround eight seconds
Best forLights, climate, timersPairing with an AI model for open requests
LimitsNo shopping lists or named timers out of the boxNeeds strong hardware

Source: Home Assistant.

Can a local assistant answer questions like Alexa?

Only if you add an AI model. Home Assistant’s own agent handles device commands. For “how long do I roast a turkey,” you can add a local model through Ollama as the conversation agent, and Home Assistant tries its own commands first and sends the rest to the model (Home Assistant blog). Or you can use a cloud AI model, which brings back the privacy question you started with. Many people split it: local for the house, a phone assistant for the internet.

What do you lose by leaving Alexa?

Be honest with yourself about these before you unplug the Echo:

  • Music. Alexa plays Amazon Music, Spotify and Apple Music by voice. Home Assistant can do it through Music Assistant, but it takes setup.
  • Shopping and Amazon orders. Gone, which many people count as a win.
  • Drop In and calling. No equivalent.
  • Skills. Third-party Alexa skills don’t come with you.
  • Polish. Alexa handles accents, mumbles and fuzzy phrasing better than a local engine.

What you gain: your voice stays in your house, commands work when the internet is down, and nothing is advertising to you.

Can an AI agent use your local assistant?

Yes, and on your terms. Home Assistant ships an MCP server, so an agent like Claude can read sensors and control the devices you expose, with the same exposure list as Assist. That’s the opposite of Alexa+, where Amazon’s cloud decides what its assistant does. Keep locks, alarms and garage doors off the exposed list, or behind confirmation, for any agent.

What happens if the project goes away?

Home Assistant is open source and run by the Open Home Foundation, a nonprofit. The software runs on your hardware, so a shutdown wouldn’t brick it. That’s the key difference from Alexa, where devices depend on Amazon’s servers and policies. Amazon ended the option to process Echo voice requests on the device in 2025, which is the kind of change you can’t opt out of.

What does this cost to own over two years?

No prices here. Count the server, the Voice speaker for each room, and electricity for a box that runs all day. Home Assistant Cloud is an optional subscription if you want its cloud voices and remote access without setting up your own. Compare that with Alexa+, which is free with Prime and paid without it.

Who should skip this?

  • Anyone who wants it to just work out of the box. This is a weekend project and ongoing upkeep.
  • Music-first households. A Sonos or HomePod with its built-in assistant is easier. See best smart speaker for privacy.
  • Homes without a person who enjoys tinkering. If you’re the only one who can fix it, you’re the help desk.

A 30-day test plan

  1. Week 1: run Assist on your phone only. Log ten real commands a day and how many worked.
  2. Week 2: add one Voice Preview Edition in the kitchen, next to the Echo. Use both for the same requests.
  3. Week 3: unplug the Echo in that room. Note what you miss.
  4. Week 4: check your success rate. Above about nine in ten for home control, move the next room. Below that, add aliases or try Whisper.

Buyer checklist

  1. What hardware will run Home Assistant?
  2. Speech-to-Phrase or Whisper?
  3. Which devices will you expose, and which stay off-limits?
  4. Do you need music by voice?
  5. One speaker per room, or a few key rooms?
  6. Will you add a local AI model, a cloud model or neither?
  7. Who maintains it when updates break something?
  8. What will you do with the old Echos?

How we picked

From Home Assistant’s documentation and blog, the Voice Preview Edition product page and independent reviews. More comparisons: Sonos vs HomePod vs Echo vs Nest, Alexa+ vs Gemini for Home and the Smart Speakers hub.

Listening on a smart speaker? Amazon offers an Audible free trial for audiobooks; check Amazon for the current terms.

FAQ

Is Home Assistant Voice fully offline?

It can be. With Speech-to-Phrase or Whisper for speech-to-text and Piper for speech output, commands are processed on your own hardware. Home Assistant Cloud is an optional alternative.

Can I keep my Echo and add Home Assistant?

Yes. Many people start that way. Home Assistant can also expose devices to Alexa, so you can move rooms one at a time.

What languages does Home Assistant voice support?

Many. Support and quality vary by language and engine, so check the Home Assistant docs for yours before you buy hardware.

Do I need a Raspberry Pi?

No. A Home Assistant Green, a Raspberry Pi or any small PC works. Faster hardware gives faster replies, especially with Whisper.

Frequently asked questions

Is Home Assistant Voice fully offline?

It can be. With Speech-to-Phrase or Whisper for speech-to-text and Piper for speech output, commands are processed on your own hardware. Home Assistant Cloud is an optional alternative.

Can I keep my Echo and add Home Assistant?

Yes. Many people start that way. Home Assistant can also expose devices to Alexa, so you can move rooms one at a time.

What languages does Home Assistant voice support?

Many. Support and quality vary by language and engine, so check the Home Assistant docs for yours before you buy hardware.

Do I need a Raspberry Pi?

No. A Home Assistant Green, a Raspberry Pi or any small PC works. Faster hardware gives faster replies, especially with Whisper.