Show HN: An LLM chat app using Apple's FoundationModels(apps.apple.com)

4 pointsby alariccole10 เดือนที่ผ่านมา4 comments

apps.apple.com

Show HN: An LLM chat app using Apple's FoundationModels

https://apps.apple.com/us/app/hal%C5%8D/id6748263839

Despite Apple’s fairly clear warnings that their 3B 4K model is not for use as a chat app, I had to try anyway. There’s definitely plenty of work to do but it’s starting to become useful.

Happy to answer any questions about limitations, what it’s good at, and how to coax it. The safety guardrails and forced disneyfication make this especially challenging.

4 comments

ndgold10 เดือนที่ผ่านมา

Thanks for your work, tried it, it works, it is mostly not useful for me, but I love where this is going and the experience is super streamlined

alariccole10 เดือนที่ผ่านมา

Thanks for checking it out. Thinking to do a more file/notes focused version esp on mac because it’s blazing fast there.

bchris410 เดือนที่ผ่านมา

Interesting to get a vibe check on the Apple model via chat.

Any plans for RAG across Notes/Email/Calendar?

alariccole10 เดือนที่ผ่านมา

Yeah, when I started I actually had no intention of doing a chat app, but it was a good way to learn how it works. Eventual goal with this is a sort of hybrid notes app. Not an llm bolted into Notes, either, but kind of a mix. Find myself using the llm app as a knowledge repo and it’s just not built for that. I’ll post a TestFlight link later if you want to try it out.