I started experimenting with local llms recently. I made this little tool that you can use to ask questions to a model. You have a daemon that it connects to so it can answer fast.
It's very recent. I want to add memory and shell executing capabilities soon. It's for my game :P
3
1