His program uses quantization, but is very optimised and has builds that can fit into 96GB of memory with great results.
DS4 Flash is usually my go-to for a lot of things these days, and I don't have to worry about a cloud model stopping or telling me it's concerned about my usage.
Modern frontier LLMs know Norwegian. Wouldn't this simply be the job of RAG to do lookups as the user requests for data? Like how Gemini integrates with Google Search.
Seems like they should be building an MCP service rather than training an entirely new LLM...
I’d just plug the ports since things are going wireless and might only need the one usb-c from time to time. Hey StarLabs, perhaps put some nice flush and matching port plugs in the box?
Looks really slick. I'd love to see some more AI oriented mini PCs like the Star Byte but with OSS firmware. Think AMD Ryzen AI Halo form factor with the Gorgon Halo style APU.
Is eBay just a hive of scams now? Try searching for a Mac Studio with 512gb of RAM for example. I know it's a highly sought after item, but there are so many sellers with 0 reviews supposedly selling these at suspiciously low prices. What's going on here?
Many users do like to use scrollback to copy large passages of text, which becomes difficult and cumbersome if they have to use page-up page-down to get at the other parts of it.
Western companies operating outside China are often forced to agree with China's censorship requirements too. Look up the "great cannon" on wikipedia. Many such examples.
Apple is not Apple Inc. in China, it is Apple Computer Trading (Shanghai) Co., Ltd. SuperMicro will have its own subsidiary/subcontractors to handle their operations in China.
As having worked for a subsidiary of a large multinational company in China, I can tell you that a lot goes on that you might find surprising. Middle management and those involved with establishing the deals with subcontractors would often have arrangements to make money through various means, such as through IP transfer or property theft. The subcontractors themselves are Chinese companies.
At our place a lot of shady things were going on and were, thankfully, found after a number of years. The global HQ had to step in and fire around 1/3 of employees working at the China branch.
Now, there is no reason to suggest that this was related to any government policy or request. But it should be clear by now that the CPC are not exactly opposed to shady things happening to foreign companies. My point is that this is an an environment where something like this can happen quite easily, especially when a lot of technology companies have close ties to the state.
So, suppose you're Supermicro. When some CPC official comes around to tell you to make your technology a little easier for the intelligence department to access, you're going to do it.
Companies in China (especially those in the tech sector) have to keep close ties to the government, and most of their leaders are members are of the party. You don't GET to be a multi-billion dollar tech company* in China without toeing the party line [1] [2] [3]
The issues around regulating food safety and vaccines that you mentioned are irrelevant.
* Foreign companies must operate Chinese subsidiaries to run their operations in China.
Anti-China propaganda? These chips were designed by the Chinese military and inserted by PLA agents. Do you have to start calling things propaganda to make it seem like this is baseless criticism of China to those who have not read the article?