Funny, i did this myself some months ago - its actually not that tricky to run a llm in your browser. Tho, the problem is that the models fitting in there are well relativly "tiny" in my opinion.
Cool idea tho to make it as accessible (:
One click agent run on browser, What can go wrong :)
What models have you been able to run with this?
[flagged]