Of course, for example, a Civil Engineer learns integrals, so it can learn advanced engineering topics.
It may not often use them often as it uses software, or it may not remember all integrals rule tables, but it understands the concept, it's usefulness, and in case he needs it, he can figure out a way to work it out.
This is the same for Software Engineering and code. You don't need to have written the HTTP protocol library in order to use it.
I haven't written a single line of code since more than an year, but I've made the AI write multiple thousands of lines of code since then.
It's just a calculator. You still need to know how to use the calculator and for what purpose do you use it.
What changed is that you no longer will need to learn all ins and outs of coding.
This is a clear display that we need free trade, sensible economic polices and a common ground of what humans need to thrive. "Sovereignty" is overrated.
For example, for the US to have a chance in the EU, it would first need to fix its YOLO fiscal policy of sustained 5.5% debt/gdp deficits.
We shall see in a few years as US's debt balloons and the average American becomes pseudo-slaves from a few overlords... to see if the EU is really bad as some Americans believe it to be.
But I don't know how long this will go, so I'm investing on getting fit again for random jobs like moving atoms.
Or realizing my life's dream: become a lifeguard in public swimming pool or learn the trades to maintain swimming pools. There's a shortage of them where I live and it's enough money to pay for food etc.
I love swimming and watch people happy enjoying the water, it's such good vibes I'd do this forever.
Our life is mostly suffering and grinding through... but people on swimming pools are always smiling, having a good time & having the basic pleasures of enjoying the water and the moment.
It isn't surprising at all, Microsoft is doing a PE firm playbook with what they buy. You don't need to look much far, let's think about its biggest acquisition to date, Blizzard.
Blizzcon canceled. All of its IP barely got any love.
See what players think about the latest World of Warcraft patch. It's absolutely shit and broken. People say they fired the entire QA department since a few years back and since then the quality has just gone down.
They buy those businesses because they have nothing to do with that free cash flow, and for accounting reasons it makes sense to have them.
They didn't buy those businesses to develop it further and make it worth more.
Github will just become ever more irrelevant.
The key issue is that the US governments let those huge monopolies exist, and then use their money to buy other businesses and enshiftify them.
Unless that changes in the US, this will continue happening.
LLMs for language feels like it's definitely the way to go. I feel like that by just improving it further can definitely reach perfection, if not very close.
My concern is mostly all adjacent fields, like systems thinking, spatial reasoning, "real" human-like reasoning etc or as you put it, "AGI".
Doesn't seen this will take us there at all. I don't feel like we're closer to AGI than we were on the earliest versions of ChatGPT.
Thanks for your perspective from somebody working on the field. I still wonder though: what would the results be if we'd just use a richer dataset + more parameters? Would it be really that different results? (except costs, as MoE def helps with that)
MoE: I assume some people just specialize in working with routing as with that, as by reducing the amount of params and just using a subset, you end up making it less costly. So, AI researchers are only working on optimizations on getting this better?
Same question on Reasoning, so AI researchers are working mostly on optimizations on top of it, like CoT and so on, like mini-optimizations.
So basically, they work on those micro-optimizations, put them together and see a % improvement in a benchmark?
I'm sure this is probably awesome for languages, which if I'm not mistaken, it was the use-case initially used on "All you need is attention" and the entire LLM revolution.
But this seems to be a very clear path to be "taking the car to the carwash by foot" for a long time, isn't it?
It feels like we'll keep "taking the car to the carwash by foot" until somebody optimizes for that prompt, or some pre-training done, and then there'll be another prompt that will show that the AI has real trouble with very basic real-world reasoning and imagination.
Isn't it the case, or do you see any kind of research that could take us from that plateau full of micro-optimizations that get us a few cm higher to the peak?
I've had a similar problem with other hardware, my solution was to lower my expectations of "having a shop" to fix it.
No shop will want to have the expectations to successfully fix a complex GPU, unless it's their main business, as the solution can potentially not be 'reballing the memory modules' and they might just break your GPU in the process, they don't wanna have to pay you back in case they do, otherwise the risk they are undertaking isn't worth the chance of they fixing it and getting your X euros.
Go to hardware communities and ask them if they'd like to have a go at it, find somebody reputable and go with them.
Otherwise based on what you said, you literally will have to trash it, or find a way to constantly cool it down in a very reliable way (Good luck! I tried the same with a CPU with an overheating issue and failed miserably. Hopefully you'll manage it)
If nicbou the builder is having a hard time, that's all the economic downturn data point I need.
I share a similar sentiment about Germany. I mean, we do have a recession for a couple of years already.
As a Software Developer, I've experienced layoffs of International companies just nuking their German team, for both cost and law risks (from people trying to create a worker council and the like).
I'm still employed because of my YOE, my skills & a wide network of people that have seen the quality of my work, but I see even previous CTOs and great engineers without a job.
Maybe in the years ahead, I might need to work doing something else.
I've always wanted to go to trade school and run my own business anyways, just didn't due to software engineering being so fun, interesting, challenging and ofc, well-paid.
I've been practicing my German a lot (C1+), so in worst case scenario I can do other work, maybe become an electrician or something that involves moving atoms, rather than bits.
You can buy mate tea as tea sachets, "Mate leão" has a nice taste blend.
Why not do it with the leaves? This is harder as their taste profile is very uneven.
For the sour taste, add citric acid.
I'm pretty sure that if you toy around with the amount of citric acid, sugar & dillution you'll get a similar taste, or something even more palatable for you.
You should get your website up and running and start writing and tell others not only how you made it, but also why. What you felt in this change in your life etc.
I guess a big part of this is figuring out how to make money doing that. I wonder how did you get there.
I've always had the desire to make soft drinks and I have a similar concern about how we are sitting the entire day...
Love Justinguitar, but I disagree with this approach, this tells you very little how to actually play the guitar, just to know songs and train your ear and transcribing. The main takeway here is that to become an artist you need to get good at copying.
Everybody that plays guitar have tried to transcribe a riff or a song. But not all have become great guitar players.
The way to go is to have an objective. Is it playing a difficult song like Cliffs of Dover? Playing blues? Rock? What is it? Focus on that style or song. COPY. Become a copy machine.
One example is doing bends. There are many ways of doing a bend. Most if not all blue players do it by holding the neck of the guitar in a very specific manner, so if you want to play blues, you need to copy them. It must be a perfect copy.
Playing the guitar is mostly a physical activity where motions and understanding of the body, and how this is wired into your nerves and brain matters.
If you just transcribe and play riffs, you won't be able to play in a high BPM, because in order to do that, you need to be extremely efficient with your movements, understand speed picking... and people have studied and developed those techniques for many years -- you don't invent this over, you watch videos, practice and copy it!
By just playing and transcribing you'll develop terrible habits which at some point will limit your playing, and will feel like it will take an eternity to correct. That's when most of the people stop playing.
And of course, play songs that are at your level, so typically lower speed songs with simpler chords and then from there understand what music style you want to focus on.
A guitar teacher can help you with that because they can easily come up with exercises and songs that would match your skill, but if you want, you can do that yourself.
Once you become advanced in guitar, then you'll for sure know it, and then you can experiment to do bends in a different way, or do something that would make you stand out, but at first, it's mostly about copying. Later you can innovate.
TLDR: best way of learning guitar is focusing on copying everything, the motions of a player being the #1.
Also about privacy-first apps.