Show HN: NotesOllama – I added local LLM support to Apple Notes (through Ollama)(smallest.app)
smallest.app
Show HN: NotesOllama – I added local LLM support to Apple Notes (through Ollama)
https://smallest.app/notesollama/
33 comments
have you considered using Services for this? Services already support taking selected text and doing transformations on it, and allow user-configurable keyboard shortcuts. Plus it will work in any app, not just Notes.
That feature is so well hidden I kind of forgot it exist. I'll check out the selection/transformation stuff!
It is well hidden. It’s also amazing. Services are available system-wide, work in any application and can be as sophisticated as you want, if only because you can put as many shell scripts as you’d like in them and then Bob’s your uncle. It’s one of the key features I miss when I use Linux.
Yeah, Apple services are one of a bunch of semi-forgotten features of macOS that are real gems
Echoing this. Services and other types of macOS system plugins (e.g. color palette plugins) are great with how they enable app-agnostic functionality but are unfortunately underused.
For those of you who want services, I went and hacked this together in 5 minutes:
https://gist.github.com/rcarmo/f96c659f149e357e1091cbfe352af...
You can drop the Python script into Automator and use that to publish a Service without tweaking anything else (but of course a proper solution would do some sort of API key management, maybe use the keychain module to retrieve that, etc.)
Still, it was a fun quick hack. Thanks rexec for the inspiration, I'm now looking into doing the same with a simple Lua/Obj-C app to publish the services directly.
https://gist.github.com/rcarmo/f96c659f149e357e1091cbfe352af...
You can drop the Python script into Automator and use that to publish a Service without tweaking anything else (but of course a proper solution would do some sort of API key management, maybe use the keychain module to retrieve that, etc.)
Still, it was a fun quick hack. Thanks rexec for the inspiration, I'm now looking into doing the same with a simple Lua/Obj-C app to publish the services directly.
I'm a big fan of this space and have been hacking on it too.
With a few tricks you can use LLMs or anything else you can call from a script, from anywhere in your OS via input capture and simulation, and clipboard. And it can be cross platform!
Here's the project, if it might interest anyone.
https://github.com/jasonjmcghee/plock
With a few tricks you can use LLMs or anything else you can call from a script, from anywhere in your OS via input capture and simulation, and clipboard. And it can be cross platform!
Here's the project, if it might interest anyone.
https://github.com/jasonjmcghee/plock
This is a very clever stunt. I do want to echo other people's mentions of Services, which I use for many things and will span multiple apps.
I highly recommend MindMac (https://mindmac.app) which adds os-wide support for Ollama (and "Open"AI et el) along with optional clipboard access and text entry. Unfortunately it isn't open source.
I can't wait for higher-quality built-in proofreader on os x. I don't love real-time spell checkers, I'd prefer to just dump an email with no error highlighting, hit a keystroke and have it re-written proofed (with dyslexia often the only way I can find my own errors is by reading the text backwards). I built a GPT in the "built your own GPT" thinger ChatGPT has now, and I copy/paste stuff in, hit enter and it sends back a corrected version and underneath a list of the corrections it made. So far it's batting 1.000. I'm going to see if I can use this for that.
FWIW I just ran a bunch of tests with GPT 4 and it’s remarkably bad at spelling and grammar correction.
On this topic (using local LLM for analyzing local text on an iDevice) -
I highly suspect that the recent Journal app from Apple, which auto-installed via an iOS update, is intended to incentivize users to journal and write about their daily lives, so that when Apple inevitably ships a local LLM on iDevices, there is already a corpus of data for the model to RAG over and use to "understand" the user.
I highly suspect that the recent Journal app from Apple, which auto-installed via an iOS update, is intended to incentivize users to journal and write about their daily lives, so that when Apple inevitably ships a local LLM on iDevices, there is already a corpus of data for the model to RAG over and use to "understand" the user.
this looks cool. I have a request: I've been using the Notes app for my todo lists since mid-2020. I have one note per day, and I then break them up by quarter and year. e.g.:
1. Right now, I have to go back through all of my notes from the past week for engineering sync meetings to assemble a list of completed tasks, then I group them by functional area, and then I write out a little bullet-pointed synopsis that I share with my peers.
2. I use my completed todo lists from the previous year to help fill in my annual performance evaluation. I look back through the entire year for major projects I worked on.
I'd love to speed up both of these processes by pointing an LLM at all of these documents and having it auto-summarize either on a weekly, monthly, quarterly, or yearly basis.
2024
Q1
Monday, January 1, 2024:
- [x] [XYZ] - Review pull request from [Person]
- [x] Investigate error rates for [XYZ] in Sentry
1. Right now, I have to go back through all of my notes from the past week for engineering sync meetings to assemble a list of completed tasks, then I group them by functional area, and then I write out a little bullet-pointed synopsis that I share with my peers.
2. I use my completed todo lists from the previous year to help fill in my annual performance evaluation. I look back through the entire year for major projects I worked on.
I'd love to speed up both of these processes by pointing an LLM at all of these documents and having it auto-summarize either on a weekly, monthly, quarterly, or yearly basis.
Thanks! There's a "Summarize selection" prompt in there, so if you try it with a good model like Mixtral you might already get good results for (1). For (2) I'm guessing you'd want to be able to write a custom prompt?
Can "Summarize selection" work across multiple documents, or is it limited to only a single document at a time?
Also, the Notes app on macOS has a reasonably comprehensive AppleScript Dictionary associated with it for scripting; have you considered using osascript with either AppleScript (ugh) or JavaScript to expand your cross-document capabilities?
Also, the Notes app on macOS has a reasonably comprehensive AppleScript Dictionary associated with it for scripting; have you considered using osascript with either AppleScript (ugh) or JavaScript to expand your cross-document capabilities?
Ah yes it's limited to single documents.
Using AppleScript/JavaScript to pull multiple notes is a good idea!
Using AppleScript/JavaScript to pull multiple notes is a good idea!
I love to read about this type of stuff. Have you blogged about or written about it in more detail here on HN?
Edit: I reworded my question because it was a bit vague.
Edit: I reworded my question because it was a bit vague.
I wrote up a bit more information on the subject: https://www.brethorsting.com/blog/2024/02/how-i-manage-my-to...
My todo list method? No, I've never written about it anywhere. It had never occurred to me that other people would find it interesting. I'll add it to the section of my todo list for future blog posts ;) (but seriously, that's where they go.)
Another option for hacking something like this together could be HammerSpoon. I’ve spent some time with it, but haven’t tried integrating with Apple Notes, I mostly did stuff at the file system level to keep it easy.
https://www.hammerspoon.org/
https://www.hammerspoon.org/
I used a macos shortcut to do the same thing. I'm running llamacpp locally on the mac and I just hit a keyboard shortcut to get the menu.
https://streamable.com/aou6rb?src=player-page-share
https://streamable.com/aou6rb?src=player-page-share
What is the intended use for this ?
Notes app seem like an odd place to ask Google like questions.
Is it supposed to help me with writing long for text? Am I supposed to use it as a spell/grammar checker ?
This is not directly a question for your integration, but more of a general question for using local LLMs for long form text.
Notes app seem like an odd place to ask Google like questions.
Is it supposed to help me with writing long for text? Am I supposed to use it as a spell/grammar checker ?
This is not directly a question for your integration, but more of a general question for using local LLMs for long form text.
Some people have years (or decades!) of text notes that would benefit greatly from summarization and LLM query.
Asking generic questions is probably a poor demo choice, but it shows the link to the LLM in context.
Asking generic questions is probably a poor demo choice, but it shows the link to the LLM in context.
I just watched this Tiago Forte video [1] on the new Google tool called NotebookLM. In the video he basically aswers the "what" of your question. Lots one can do with a boatload of notes you've kept locally, and your own sources that aren't scraped by a LLM.
[1] https://www.youtube.com/watch?v=iWPjBwXy_Io
[1] https://www.youtube.com/watch?v=iWPjBwXy_Io
[deleted]
I compiled from source, works nicely. You need to change the settings to "run locally" by default, rather than build an app.
Seems hugged. Look forward to looking at it when the site is back up - I want this exact sort of thing.
Should be up now (it's a static site behind Cloudflare)
Love that workaround, extremely clever
This is dope!
Notes doesn't really support plugins so I'm using the macOS accessibility API for reading selections and then stream responses using the clipboard (not ideal but it works).