To be honest this project is solving the easy part, i.e. the compute where to run the agent. The part where the agent does something useful is like 99% of the value that unsolved for most organisations.
Excited to show you a new project I have been working on: the K8s Agent Orchestration Framework (KAOS) which helps you deploy and manage distributed multi-agent systems at scale If you want to support, do try it out, add an issue or give it a star!
The KAOS Framework addresses some of the pains of taking multi-agent / multi-tool / multi-model systems to hundreds or thousands of services. It started as an experiment to build agentic copilots, and has progressed as a fun endevour building distributed systems for A2A, MCP Servers, and model inference!
The initial release comes with a few key features including:
1) Golang control plane to manage Agentic CRDs; 2) Python data plane that implements a2a, memory, tool / model mgmt; 3) React UI for CRUD+debugging, and; 4) CI/CD setup with KIND/pytest/ginko/etc.
Links & Resources:
Docs: https://axsaucedo.github.io/kaos/ Repo: https://github.com/axsaucedo/kaos UI: https://axsaucedo.github.io/kaos-ui/
Kunernetes leads the way in “tools that make it possible to work with Kunernetes” spawns.
It insists upon itself.
Can I inject params to prompts?
Not to be confused with KaOS, an Arch-based distro that focuses on a KDE Plasma-only desktop.
Do you mind adding more color and details to your closing thought? I’m curious if you know if projects that exist to help with this.