literally don't use any of the three parties involved in the drama (judge me all you want!).
however, i am glad this blog post exists, even though this is coming from reading the edited version. it might be down to ignorance, but the writeup contradicts the clarification in the bottom. it does seem like the series of events have had a personal impact to the writer. i am happy people can express themselves at their own leisure, and choose how to do so.
to those virtue signalling on language features or personal beliefs, go on a hike! the vast majority of projects that touch our lives are run by opinionated people, whether community-driven or from a for-profit. the more that is shared here about this, the more this seems like a byproduct of this reality.
the title is doing the heavy lifting here. the paper discusses how they apply an existing standard (CXL), to provide an intermediate memory tier in a niche use case:
> Each MemServer combines 768 GB of DDR5 memory alongside 256 GB of DDR4 connected through Vistara ASICs.
while the ratio above would be nice the other way around, this approach surely adds enough latency to make it comparable to intel optane than system memory at face value.
this should not take away ddr4 supply for those who would like to run it at home.
> I really wish there was just an easy guide on when to use Sol vs Terra vs Luna
Their dev guide has the following:
> Use gpt-5.6-sol for frontier capability, gpt-5.6-terra for a balance of intelligence and cost, or gpt-5.6-luna for efficient, high-volume workloads. The gpt-5.6 alias routes requests to gpt-5.6-sol
it is amazing that meta continues to burn money and keep afloat. ads DO really make money, especially when they are going to overtake google in this [1].
to all the critics, i would suggest letting him/them cook. the snowden-era privacy concerns was exactly around ai getting trained or using personal data, and they have a treasure trove of it.
their money dump do sometimes also spend money on r&d unrelated to the current mindhive topics. we never know what the scatterbrain approach may give birth to tomorrow.
do be critical and vocal on how they squeeze money out of other areas or how they increase their revenue by ruining our lives instead.
how funny things work - from Napoleon serving his special guests on aluminium utensils [1] to everyone taking it for granted, even treating it as if it is toxic!
cost and availability somehow has a negative correlation to how we treat something.
xbox is not a startup and neither m$ a vc. the board is not in love with gaming to continue sponsoring it. but if the solution is to make it even worse to game in their platform, then i hope this crashes and burns for good.
this product really deserves the "halo" in the name. very difficult to gauge its fit in the current market.
if you want inference, go mac with much higher memory bandwidth. given the price premium here, or the little there is, you might as well.
if you want to finetune and experiment, cuda still has the moat and the kit is not much cheaper, if at all, than dgx spark.
from personal experience, i had access to amd developer cloud with a fair bit of credits. however, even doing inference outside of their supported use cases (which are often dated btw) using vllm was a pain. in the end, despite great computing potential on paper, i decided to not spend more time than its worth on it. if their enterprise cloud continue to have these grievances, i am not optimistic about this kit.
it might be down to skill issue on my end. perhaps if these sell and it gives amd enough motivation to add more software staff in-house, more power to them.
otherwise, good article from labs as usual. nice to know that other kits based on this soc are more or less the same (unsurprisingly).
i lived in an interesting time and place combo where i'd see more apes around than vespas. primarily because we have local alternatives for vespas, which were also levied a lot of import duties to begin with.
while vespas came earlier and had the advantage of interchangeably calling scooters "vespas". however, did not figure out that they both shared the same parent company.
being true or not is irrelevant for decisions such as this. has been done on both sides, whether at software level or "hardware".
from Teslas not allowed parked around sensitive areas in the city, to blocking a (very famous and quite well-made) Russian antivirus, or Huawei communication stack.
Anthropic is not doing itself any favours with their recent (?) antics [1], so it is completely well-founded to do this imho. regardless, harness as a moat is not quite as established as the underlying models to the same extent.
the part selection is appropriate for the current steam machine pricing, but i wonder if having this resource can help someone salvage eink displays from old kindles to achieve the same result.
no matter your luck with hardware or your sysadmin skills, doing local inference for just yourself and/or to emulate typical usage (e.g. your coding workflow and deep research, etc.) is just very inefficient in current model architecture.
to me, this is a "truck" approach to city driving as a single person who does not do furniture hauling every weekend. the sense of privacy and freedom is nice but online inference is more "economical" as multi-user load is more effectively served than going solo.
maybe new architectures would make it effective to do text inference locally [1], till then great on you if you can spend car money on your setup. hope it is a great learning experience as well.
all this talk, and the student pack's access to copilot (and i can imagine the free tier) is completely neutered.
you still cannot choose any models nor have much credits to work with (200 per month, around 2 usd). this was luckily the nudge i really needed personally to get out of the vs code paradigm, and i am lowkey glad for it.
overall, we have come full circle where vs code is using a model that one of its fork (cursor) has adapted as the core underlying model for its product.
jokes aside, as someone who has never bought physical games, the landscape for physical ownership in this space was already shrinking.
there is a major chunk of playerbase who only plays online multiplayers, which are tied to always-online mode and constant updates. even if you could buy these titles on a disc, practically speaking they carried very little value of physical ownership.
we are just boiling the frog with little more intensity now. if it is possible to repurpose the bluray reader of ps5 to connect to pc, it might be a nice way to invest in one before they stop selling too.
however, i am glad this blog post exists, even though this is coming from reading the edited version. it might be down to ignorance, but the writeup contradicts the clarification in the bottom. it does seem like the series of events have had a personal impact to the writer. i am happy people can express themselves at their own leisure, and choose how to do so.
to those virtue signalling on language features or personal beliefs, go on a hike! the vast majority of projects that touch our lives are run by opinionated people, whether community-driven or from a for-profit. the more that is shared here about this, the more this seems like a byproduct of this reality.