Blog ·
A smart home run by an AI agent: connecting CapyAgent to Home Assistant
One of our clients built his home on Home Assistant, and every device lives in its own app. He wanted to write to a chat and get an answer or an action. Here is how it works.
A house with a lot going on
One of our clients built his home on Home Assistant: cameras, Zigbee sensors, heating, air conditioning, two robot vacuums, over two hundred integrations, each with its own screen and its own notifications. He wanted one thing: to write to a chat and get an answer or an action instead of hunting for the right app.
How it works
The CapyAgent agent runs on a separate server, and Home Assistant runs at home. The server reaches the home system over a secure connection and uses its API. The access token lives in the service environment and never appears in the chat.
The agent has 12 tools in three groups.
- Look. List devices, read a device state, list available services, read history and the event log.
- Act. Call a Home Assistant service, for example turn on a light, change the heating mode or start a cleaning run.
- Troubleshoot. Check that integrations work, reload an integration entry, validate the configuration, read and save an automation.
You talk to the agent in plain sentences in a chat, the same way as with any other CapyAgent assistant.
Confirmations
In this installation, action confirmations are off at the home owner's request. For the public version we plan a different rule: locks, alarms, gates and heating above a threshold must always ask for confirmation.
The public plugin
We plan to publish a Home Assistant plugin for CapyAgent as open source. It is not released yet. The design is read-only by default, control as a separate mode, dangerous services blocked, and a log entry for every call.
Frequently asked questions
Does the agent control the house on its own?
Only within the tools it was given. For the public version we plan confirmation for locks, alarms, gates and heating.
Can I download the plugin?
Not yet. It is in development and not released.
Do I need Home Assistant for this?
Yes. The agent works through its interface and does not talk to devices directly.
How to start with your own home or business
The principle is not tied to smart homes. Pick a task you repeat every day, tell the agent what you need, and keep the final word for yourself.
- Download CapyAgent: a free app for Windows, macOS and Linux. On a server it installs with one command.
- Cloud for a company: 2,490 RUB per month (half an hour of support a month is included) plus about 2,000 RUB for the model. The agent keeps working even when your computer is off.
- The AI assistant in Telegram: how to connect the agent to a chat and what it can do.
Related
- Capabilities - the agent in your chat, with confirmation before any action.
- AI agent for business - the other tasks: mail, calls, advertising, purchasing.
- Cloud - keeps the agent running even when your computer is off.
Tell us what you are losing
Three lines, half a minute. We reply within one working day.