The analogy between projects/companies and governments is missing big components though.
- "Benevolent Dictators" of companies or projects have to obey the law
- They can't forbid competition or alternatives
- Every participant can leave at any time
- If they burn the organization to the ground, the worst case scenario is the organization get replaced and people move on
I think it shows that we're using the word "dictator" way too casually in that case.
I'm totally with you on the evolution of motor tech because of drone and also personal mobility (scooters and hoverboard motors are a steal for what they can handle).
While high torque motors got way cheaper, especially with MIT Cheetah "clones" getting easily available, they're still at least 200-500 a pop (depending on the torque needed for each articulation) from what I could find.
I might not know where to search for the real gems though. Where do you search for cheap powerful servomotors?
But Meta is the main company behind Pytorch development. If they make it work and upstream it, this will cascade to all Pytorch users.
We don't have to imagine far, it's slowly happening. Pytorch for ROCm is getting better and better!
Then they will have to fix the split between data-center and consumer GPU for sure. From what I understand, this is on the roadmap with the convergence of both GPU lines on the UDNA architecture.
Transformers can also fetch at any moment any previous information that become useful.
RNN are constantly updating and overwriting their memory. It means they need to be able to predict what is going to be useful in order to store it for later.
This is a massive advantage for Transformers in interactive use cases like in ChatGPT. You give it context and ask questions in multiple turns. Which part of the context was important for a given question only becomes known later in the token sequence.
To be more precise, I should say it's an advantage of Attention-based models, because there are also hybrid models successfully mixing both approaches, like Jamba.
There was a HackadayPrize 2023 competitor that worked on this [0]. He had to rethink the way those devices are built to bring the cost down.
That would be interesting to know if his solution could match the 4k$ in term of usability or if there is some issue like refreshing rate that make the piezo based system necessary for a good user experience.
I'm not a lawyer but from what I understand the process is closer to what you mention for the US.
We have "garde à vue" and "détention provisoire":
- "Garde a vue" is similar to being in police custody and it's limited to 24-48 hours normally, but there is longer duration for specific crime, the maximum being 6 days for terrorism investigations [0].
- Then, a judge can decide that the defendant should stay in "détention provisoire" before a trial. It doesn't have a duration limit but should be motivated and can be re-examined multiple time [1].
0: https://en.wikipedia.org/wiki/Wero_(payment)