Love the post and have a similar setup. But I have questions about how you handle sensitive personal info with Codex and Claude with this setup given Hermes has no boundaries on its own with its integrations with Codex for example. It can leak memory and tool calls and context through.
At home I have Hermes on a VPS with matrix and mnemosyne and it is largely for personal use. While I was excited to try out the seamless Codex wrapper, this leakage was unacceptable compared to a ZDR OpenRouter provider like fireworks.
Where I struggle is now in architecting a clean way to have Hermes separate out personal stuff from coding stuff, and then orchestrate coding through Codex as that seems to be the only way to use it headlessly on my phone since they have no way of doing that in the ChatGPT app right now on Linux.
Does Buzz let you neatly silo that?
I'm struggling between:
"I want to use Hermes with frontier models with a seamless wrapper on my $20 ChatGPT pro subscription so I can go through my Hermes setup for everything including coding"
And
"OpenAI and Anthropic are not ZDR and I am not comfortable sending sensitive personal and family data to them. But I at least want a mobile-friendly remote coding experience with them on my phone and VPS"
It depends on what you mean by sensitive personal data. I actually don't give any agents access to my main email boxes instead they access a business google workspace that is spinning up.
I do separate the agents duties somewhat to try and give them the least privileges they need to do a job, and talk to all of them through buzz, and they talk to each other (occasionally) when they need something they don't have access to.
As mentioned in the post I still do a majority of my coding at my local terminal with just bits and pieces sent to my "dev-agent" through Buzz. This is a next experiment for me - (that's a hyphen!) to offload more coding to agents.
At home I have Hermes on a VPS with matrix and mnemosyne and it is largely for personal use. While I was excited to try out the seamless Codex wrapper, this leakage was unacceptable compared to a ZDR OpenRouter provider like fireworks.
Where I struggle is now in architecting a clean way to have Hermes separate out personal stuff from coding stuff, and then orchestrate coding through Codex as that seems to be the only way to use it headlessly on my phone since they have no way of doing that in the ChatGPT app right now on Linux.
Does Buzz let you neatly silo that?
I'm struggling between: "I want to use Hermes with frontier models with a seamless wrapper on my $20 ChatGPT pro subscription so I can go through my Hermes setup for everything including coding"
And
"OpenAI and Anthropic are not ZDR and I am not comfortable sending sensitive personal and family data to them. But I at least want a mobile-friendly remote coding experience with them on my phone and VPS"