this just validates why building multi-model routing is the future. if even microsoft couldn't lock down openai with $13b, enterprise customers definitely shouldn't lock themselves into a single ecosystem. the orchestration layer is about to get so valuable.
tried doing exactly this with ollama on a cross-country flight last month. my macbook basically turned into a jet engine and the battery died in under an hour.
curious if you had to heavily throttle the cpu or stick to super small quants (like 4 bit phi3) to actually make it through 10 hours without a power outlet?
fascinating experiment. i've been building some local multi-agent setups recently, and the biggest headache is always when agents silently fail on edge cases or get stuck in weird loops.
trusting an agent with actual marketplace transactions still feels a bit terrifying tbh. did they detail how they built the fallback guardrails if claude confidently decides to do something completely irrational with the pricing?