There are some experimental models made specifically for use with Home Assistant, for example home-llm.

Even though they are tiny 1-3B I’ve found them to work much better than even 14B general purpose models. Obviously they suck for general purpose questions just by their size alone.

That being said they’re still LLMs. I like to keep the “prefer handling commands locally” option turned on and only use the LLM as a fallback.

Thats what I’ve been using as well. On some of my cards it has some weird layout bugs (only on some viewing devices) which annoy me.

What card are you using for your room overviews?