Apologies for the tangent, but isn't this like saying "sliced tomato featuring BLT sandwich"?
This is awesome. I'm going to have to spend some time digging over this.
I got one of these GB10s, but the ASUS variety. So far fairly happy with it. Most days I don't remember I'm on ARM.
It's pretty performant, snappy, about the same speed as my other mini PC, a Ryzen 9 7940HS Minisforum UM 790 Pro, but with double the amount of cores and many times the amount of RAM.
Have you tried running any local LLMs via llama.cpp? I am curious if that high RAM is effectively usable as unified memory for larger models. I wonder if the memory bandwidth is sufficient to get decent performance on something like a 70b model or if it bottlenecks.
I would love to see a comparison between the A725 and X925 cores.
Not quite in the same depth, but there are some more general benchmarks across all cores and latencies here: https://github.com/geerlingguy/sbc-reviews/issues/92
Wow, this repo and the ai-benchmarks repo are the ones I wanted https://github.com/geerlingguy/ai-benchmarks/issues/34
Thank you for doing these. Earned a star and a watch from me on both! Minor sponsor donation as gratitude.
Would be sick to have an RSS feed for your data releases.
No. It's trying to analyze the CPU core but clarifies the device under test as that may have performance implications. There is cooling and possibly manufactured configured power limits.
I get what they're doing. I've never seen that phrasing before.