A look at Apple’s predictive text model(jackcook.com)
jackcook.com
A look at Apple’s predictive text model
https://jackcook.com/2023/09/08/predictive-text.html
3 comments
Apple is including a predictive text model which offers suggestions while you type, which they’ve said to be a "transformer model". I managed to find some details about this model
The emoji interest me. I start almost everything I post on Mastodon with an emoji. I used to look these up in emojipedia but my iPad has a lot of memory pressure and I'll loose what I'm working on in my YOShInOn window if I switch between two many tabs so now I have a dropdown list of all the emoji I've actually used and only need to cut-n-paste something that isn't in the list.
Early on I thought the emoji would be associated with a clean classification (say a ringed planet for astronomy) but I found I wasn't really doing that (I used two people holding hands for a post about a possible companion for a black hole) From the very beginning I thought about making something that automatically suggests an emoji but I've yet to do anything about it: the existing models I have would treat it as a many-shot problem based on emoji I've used before but I've also thought about making something trained on definitions or plain text descriptions of the emoji and related concepts.
Early on I thought the emoji would be associated with a clean classification (say a ringed planet for astronomy) but I found I wasn't really doing that (I used two people holding hands for a post about a possible companion for a black hole) From the very beginning I thought about making something that automatically suggests an emoji but I've yet to do anything about it: the existing models I have would treat it as a many-shot problem based on emoji I've used before but I've also thought about making something trained on definitions or plain text descriptions of the emoji and related concepts.
[deleted]