Uillem – an offline, containerized LLM interface(github.com)

Uillem – an offline, containerized LLM interface

https://github.com/paolo-g/uillem

7 comments

uillem3 anni fa

I noticed that offline LLM builds running on personal computers are now possible, but it seemed like all the solutions required the installation of dependencies, so I created a containerized solution that makes it easy to swap out the model in use: https://github.com/paolo-g/uillem

verelo3 anni fa

Nice, love seeing Paolo post this! He is a great guy, we used to work together, and I’m excited to see where he takes this.

yannickt3 anni fa

Paolo indeed is a great guy. Can’t wait to hang out with him next.

aganore3 anni fa

This is pretty neat! Now I just need a good library of models to plug in haha

uillem3 anni fa

Check out Hugging Face. It's cool to be able to try out different models to see how they perform. RAM requirements can get steep for the larger models.

netlag3 anni fa

Very impressive, can't wait to give it a try!

darkwata3 anni fa

Cool