Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade 3 SBC with 32GB RAM(taoofmac.com)
taoofmac.com
Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade 3 SBC with 32GB RAM
https://taoofmac.com/space/links/2024/03/01/0116
10 comments
This unfortunately is a red herring. Jetson Orin with 32GB is a more reasonable option. Yes it is expensive (950€ on arrow.de), but it is a niche product in the first place.
I wonder how stable those libraries mentioned are, and how much RAM is needed, because I cannot run LLMs at all on my Pis.
Title should be "Not Testing..."
This is just 5 paras of excuses for not testing squat.
The blog post is discussing another article that actually does contain test results: https://www.cnx-software.com/2024/02/27/testing-ai-and-llm-o...
Thanks. Oh wow, the title is the link to the discussed article.
That's being fixed now. And the screenshot will automatically link there as well. Apologies for the inconvenience.
Cool, thanks for the feedback.
[deleted]