Ah ok that’s too bad. Super computers typically don’t have tensor cores though, and most LLM use is presumably client use on ready trained models which desktop or mobile cpus can manage now so it will be impossible to know then
These days, they’re usually racks and racks and racks of specialized rackmount servers with all kinds of hardware, hilarious amounts of ram, networked storage, tensor cores, etc stuffed inside, all networked together via fiber optics to run in parallel as one big PC with many CPUs.
Ah ok that’s too bad. Super computers typically don’t have tensor cores though, and most LLM use is presumably client use on ready trained models which desktop or mobile cpus can manage now so it will be impossible to know then
yyyyes they do have tensor cores? Where did you get such an absurd idea from?
Superconputers to me refer to the mainfrane room sized monstrosities that are focused on stuff like calculating ballistic trajecories in the cold war
These days, they’re usually racks and racks and racks of specialized rackmount servers with all kinds of hardware, hilarious amounts of ram, networked storage, tensor cores, etc stuffed inside, all networked together via fiber optics to run in parallel as one big PC with many CPUs.