• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

What LLM/Model you using?

FrgMstr

FrgMstr

Just Plain Mean
Staff member
2FA
Joined
May 18, 1997
Messages
58,192
Figure this would be a good thread to share information on what you are using locally for AI. I am running the Strix 395+ 128GB machine as my "Home AI Server." Using LM Studio on my desktop to connect to the server over the network using LM Link. I am using Hermes Desktop exclusively now, and finally really understanding it and how to get it dialed in for specific profiles/tasks.

I have used a lot of variants of Qwen and Gemini lately, but started using unsloth's laguna-s-2.1@q4_k_s in the last couple of days. I have having MUCH better workflow results with this Laguna than I was with Qwen/Gemini/etc. Did have some issues getting it to fit in the memory footprint, along with microsoft/phi-4-mini-reasoning as my Aux LLM for specific tasks.

Laguna S 2.1 is a 118B total parameter Mixture-of-Experts model with 8B activated parameters per token, designed for agentic coding and long-horizon work.

1785620176391.png

1785620215614.png
 
Also have a Strix 395+ 128GB machine (GMKtec Evo 2), but been too busy with home automation shenanigans and getting everything setup infrastructure wise with a new house build to be able to really dive in and mess around with it yet.

So, can't really contribute anything just yet, but looking forward to gleaning some good ideas/info off this thread. :D
 
I have a mi50 that can run 8b and 14b models. I havent really got it good enough for a coding agent. Have been using codex 20$ and have been making some pretty good progress in python and fpga development.
 
Supercharged_Z06 said:
Also have a Strix 395+ 128GB machine (GMKtec Evo 2), but been too busy with home automation shenanigans and getting everything setup infrastructure wise with a new house build to be able to really dive in and mess around with it yet.

So, can't really contribute anything just yet, but looking forward to gleaning some good ideas/info off this thread. :D
Click to expand...
You using Hermes?
 
FrgMstr said:
You using Hermes?
Click to expand...
Not yet - been just manually brute forcing YAML within Home Assistant (with very little AI help) on some pretty basic automations - mostly just modifying/tinkering with stuff to get basic automations up and running.

Want to eventually build out an AI agent to assist with more complex logic focused on automation coding tasks within Home Assistant. Have read that lots of folks have really liked using Claude Code locally to assist in HA automation.
 
Supercharged_Z06 said:
Not yet - been just manually brute forcing YAML within Home Assistant (with very little AI help) on some pretty basic automations - mostly just modifying/tinkering with stuff to get basic automations up and running.

Want to eventually build out an AI agent to assist with more complex logic focused on automation coding tasks within Home Assistant. Have read that lots of folks have really liked using Claude Code locally to assist in HA automation.
Click to expand...
Hermes has full skills built for Home Assistant. Don't fight it, use your hardware. :)

https://hermes-agent.nousresearch.com/docs/user-guide/messaging/homeassistant
 
Supercharged_Z06 said:
Not yet - been just manually brute forcing YAML within Home Assistant (with very little AI help) on some pretty basic automations - mostly just modifying/tinkering with stuff to get basic automations up and running.

Want to eventually build out an AI agent to assist with more complex logic focused on automation coding tasks within Home Assistant. Have read that lots of folks have really liked using Claude Code locally to assist in HA automation.
Click to expand...
Worth noting on moving forward with Hermes. It is extremely important to build a profile that is specific to the tasks you are trying to do and give it the needed skills and tools to be successful.
 
You must log in or register to reply here.
Back
Top