HN Reader

Here is the repo:

https://github.com/ytmytm/llama2.c64

It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.

I've read the criticisms here, but well, as someone whose first computer was a C64, this is cool as hell.

Like, what?!

On an 8-bit, 64Kb, ~1MHz CPU!

Amazing.

Sure, there are too many caveats, but this isn't really about making this a viable modern alternative.

It's just about, well, being very cool? Nostalgic!

And in that, I think it succeeds.

If anyone wants to try it with an esp32:

https://github.com/DaveBben/esp32-llm

needs a board with PSRAM but they are surprisingly plenty these days - almost standard. I tried it a few months back.

Imagine where we would be today if this was where we were on the C64 in 1982. If we had the concept and ability to create these models and run them on machines and how much that would have evolved by now.

Amazing.