Biological lamas have a rather limited range, of nature: the Andes, and that’s it. Humans were not content to let the soft and friendly creatures stay in their natural habitat, and they can now be found on all continents except Antarctic. The model of large Llama2 language is like that: although it may have started on a GPU somewhere, thanks to enterprising hackers like (Caio Madeira), which brought Llama2 to the portable Playstation (PSP), the most soft LLM can be found almost anywhere.
In the end, this project has its roots in llama2.c by (Karpathy), a project that we saw on Pentium II under Windows 98, back machines running 486 processors, and even the venerable commodore 64, of all the impossible things. Now it’s the Tour of the PSP. This implementation uses the same model of 260K tinystories as Port C64, on which it is based. Of course, the RAM of the PSP has room for a much larger model, but (CIAO) apparently prefers to execute the tiny model faster on this less ancient game material.
It happens to the point that it is more difficult to find systems that will not have LLM execution than those who do it. Since Llama2 seems to be the new LOSSIt is probably only a matter of time before their virtual fur is everywhere in all our old equipment. Fortunately for people with allergies, virtual fur cannot trigger a histamine response.
If you know another system obtaining LLM (adjacent alpaca or other), send a tip.