Isn’t it also destroying the internet with low-quality content and affecting content creation in general? Can LLMs still rely on data from the open internet for training?
32GB is the maximum memory configuration for the 14-inch laptop, which isn’t sufficient for running local LLMs. I think a Mac Studio or Mac Mini with higher memory would be more useful.
Just curious, are there any techniques other than using embeddings, computing cosine similarity, and sorting the results based on that? RRF could be used but again its very simple as well.
The one unintended effect is that the apps may charge extra for supporting this! For example, Disney+ or the NBA may charge extra $$ for supporting this device!
Also, everyone is assuming that it's powerful enough to run the development environment. We need to wait until Apple releases the specs.