My Private LLM Setup at Home, Confidentially Accessible on Mobilethin.computer4 points·by thethindev·2 tahun yang lalu·3 comments
Running My IPv6 Only Home Email Server with IPv6rs' IPv4 Reverse Proxythin.computer1 points·by thethindev·2 tahun yang lalu·0 comments
thethindev·2 tahun yang lalu·discuss> This is exactly the type of setup I'm interested on replicating on my end. Thanks a lot for the post!!My pleasure!> Are you planning on fine-tunning the LLM further for your own needs? Have you thought about that?Initially, I wasn't thinking about it but it looks easy enough [1][2]![1] https://iwasnothing.medium.com/llm-fine-tuning-with-macbook-...[2] https://github.com/ml-explore
thethindev·2 tahun yang lalu·discussI setup a simple homelab on a macbook air and added ollama + open webui. Now I have an LLM I can talk to whenever I'm out.I'm using llama2 and llama2-uncensored, but I'm going to download llava and mixtral later. Either way, it's been a great experience
thethindev·2 tahun yang lalu·discussThere's an online meetup for people in PST [1] scheduled for tonight. I didn't RSVP but I hope to be able to attend so I can show my home lab.[1] https://events.indieweb.org/2024/03/homebrew-website-club-pa...
thethindev·2 tahun yang lalu·discussI actually did just that and setup my homelab with my "old" laptop [1].[1] https://thin.computer/index.php/2024/03/08/self-hosting-my-s...