What AlphaGo Zero teaches us about what’s going wrong with innovation(timharford.com)
timharford.com
What AlphaGo Zero teaches us about what’s going wrong with innovation
http://timharford.com/2017/11/what-alphago-zero-teaches-us-about-whats-going-wrong-with-innovation/
115 comments
While I understand your cynicism in the practical applicability of a chess or go-playing AI, I think you are significantly underestimating the theoretical innovations contributed to the field every time these models are substantially improved. Much of the work that goes into improving something like AlphaGo is cross-applicable and cross-pollinated to other research projects, and gradually trickles out into other domains with much more real-world impact.
The basic problem with AlphaGo Zero is that the state of a Go game is fully deterministic, fully Markovian, and fully amenable to quick simulation. The player makes a move, and the simulator computes the next game-state in milliseconds from only the current game-state. This is what lets the AlphaGo Zero agent train so quickly on self-play.
If you start requiring high-dimensional empirical data where the generating dynamics aren't Markovian (or aren't neatly predictable with a Markovian simulator, even if God considers them fully determined), you start having to do stuff like full-blown physics simulations while also specifying agent goals in terms of those physical states. Then you've got the machine learning part and the simulation part taking up comparable amounts of compute power, and self-supervised training becomes much more difficult.
If you start requiring high-dimensional empirical data where the generating dynamics aren't Markovian (or aren't neatly predictable with a Markovian simulator, even if God considers them fully determined), you start having to do stuff like full-blown physics simulations while also specifying agent goals in terms of those physical states. Then you've got the machine learning part and the simulation part taking up comparable amounts of compute power, and self-supervised training becomes much more difficult.
I agree that partial observation and imperfect information present computational difficulties to generalization. Do you know of any interesting research offhand for reading about optimizations for this problem?
> I think you are significantly underestimating the theoretical innovations contributed to the field every time these models are substantially improved.
I think you are overestimating, there isn't a single interesting theoretical insight in AlphaGo's papers.
I think you are overestimating, there isn't a single interesting theoretical insight in AlphaGo's papers.
That is a big claim. Where's the detailed analysis and citations?
[deleted]
Can you define what you mean by “theoretical insight”? It’s true that AlphaGo was built using previously existing techniques (supervised learning, large dataset for training, reinforcement learning and monte carlo tree search). But if you consider something to not be a breakthrough because it does not literally introduce a novel fundamental technique, you have a very narrow view of research (in my opinion).
Here are a few points to consider:
1. The combination of the aforementioned techniques in AlphaGo was non-standard. Reinforcement learning bootstrapped supervised learning, before passing a value function to the monte carlo tree search.
2. AlphaGo represents a new achievement in solving perfect information games. The research team has moved on to Starcraft, which is not perfect information, but they didn’t try to tackle that before conquering a complex perfect knowledge game first.
3. AlphaGo’s research team improved upon the original AlphaGo with a novel algorithm for self-learning and mastering games using minimal policy improvement. The new AlphaGo Zero does not utilize human training data or supervised learning, and it was capable of defeating the original AlphaGo 100-0.
Beyond self-play, I think that AlphaGo’s methodologies can generalize to combinatorial search problems even if they don’t generalize to broader domains like partially observed games or robotics.
Here are a few points to consider:
1. The combination of the aforementioned techniques in AlphaGo was non-standard. Reinforcement learning bootstrapped supervised learning, before passing a value function to the monte carlo tree search.
2. AlphaGo represents a new achievement in solving perfect information games. The research team has moved on to Starcraft, which is not perfect information, but they didn’t try to tackle that before conquering a complex perfect knowledge game first.
3. AlphaGo’s research team improved upon the original AlphaGo with a novel algorithm for self-learning and mastering games using minimal policy improvement. The new AlphaGo Zero does not utilize human training data or supervised learning, and it was capable of defeating the original AlphaGo 100-0.
Beyond self-play, I think that AlphaGo’s methodologies can generalize to combinatorial search problems even if they don’t generalize to broader domains like partially observed games or robotics.
I think folding the update rule inside the MCTS loop (in alphaGO Zero) is genius.
Funny that up until 2016 go was regarded as one of the most difficult games that computers could master, and now that it is solved it becomes a PR stunt? Would you claim the same in 2015?
This is one of those catchy but actually unverified memes that gets endlessly propagated.
"Nevertheless, I believe that a world-champion-level Go machine can be built within 10 years" - Feng-Hsiung Hsu, 2007 (researcher who worked on Deep Blue). https://spectrum.ieee.org/computing/software/cracking-go
"Nevertheless, I believe that a world-champion-level Go machine can be built within 10 years" - Feng-Hsiung Hsu, 2007 (researcher who worked on Deep Blue). https://spectrum.ieee.org/computing/software/cracking-go
Ah, just like mathematics. Once proved, a result is trivial, but before it’s proved, a conjecture is a hard problem.
Yes, I think von Neumann made this claim somewhere already that AI is a moving target, because once some task is automated it doesn't seem intelligent anymore.
It was a hard problem, and that's what makes it an effective PR stunt.
Google was working on machine learning for some practical application like image classification, better targeted ads or whatever thing Google does. A bunch of people then came up with the idea: "hey, we have all that AI stuff, we may be able to use it for computer go". And Google replied with "OK, sounds like good publicity, here is a budget, we also have a bunch of servers and if you need help, feel free to ask our machine learning department".
It is like making an industrial robot that can crush concrete blocks or whatever difficult but not that useful task. Maybe it is a huge deal because all previous attempts failed, but the point here is not that years of research in concrete crushing robots have payed out, but rather that recent advancement in practical engineering made it possible, and maybe even easy.
Google was working on machine learning for some practical application like image classification, better targeted ads or whatever thing Google does. A bunch of people then came up with the idea: "hey, we have all that AI stuff, we may be able to use it for computer go". And Google replied with "OK, sounds like good publicity, here is a budget, we also have a bunch of servers and if you need help, feel free to ask our machine learning department".
It is like making an industrial robot that can crush concrete blocks or whatever difficult but not that useful task. Maybe it is a huge deal because all previous attempts failed, but the point here is not that years of research in concrete crushing robots have payed out, but rather that recent advancement in practical engineering made it possible, and maybe even easy.
[deleted]
That's not true though. Google bought a company whose main product was a Go machine, on the idea that potentially those smart people could do useful work also. Or just as PR cover for their unrelated AI work.
Any game is a PR stunt, difficulty does not matter. It's not about how hard it is to solve, but on how many places you can apply them.
The problem with the AI Effect is that people keep expecting solving one toy problem or another to give us some insight into how to break Moravec's paradox for the general case. Statistical learning, especially deep learning, have been massive advances precisely because they at least allow us to break the paradox for specific problems, where we happen to have large datasets.
> Chess and go don't drive innovation, they are just a side effect of real innovation.
I'm not certain this is true. Take OpenAI as a potential counterexample. While not chess or go (at least, at the moment), they are likely to be considered innovating while still working on problems that would be considered roughly equivalent. Much of the field that has been called AI for a long time (not the current deep learning approaches) were pioneered by working on chess and go. It may well be the case that proving that a new class of techniques work on these well studied games is the first step in the innovation process, where those techniques are taken and applied to other problems.
I'm not certain this is true. Take OpenAI as a potential counterexample. While not chess or go (at least, at the moment), they are likely to be considered innovating while still working on problems that would be considered roughly equivalent. Much of the field that has been called AI for a long time (not the current deep learning approaches) were pioneered by working on chess and go. It may well be the case that proving that a new class of techniques work on these well studied games is the first step in the innovation process, where those techniques are taken and applied to other problems.
It'd only be innovative if they'd discovered a general approach that applies to many problems without tweaking, and even better if it learned from a comparable size problem set as humans do. As it is, even something as generic as AlphaGo Zero is highly customized for the particular problem domain, and requires millions of games.
The improvements from AlphaGo -> AG Master -> AG Zero is by adding more generalization techniques and rely less on human intervention/data. AlphaGo Zero learns only from self training.
AGZ probably can be retrained to other board games, but the hardware cost to train is quite expensive. The estimated cost to train AGZ (for 40 days?) was $25M.
AGZ probably can be retrained to other board games, but the hardware cost to train is quite expensive. The estimated cost to train AGZ (for 40 days?) was $25M.
The AGZ algorithm is picked particularly for the sort of game that Go is.
Be aware that a lot of problems can be transformed with a linear transformation into basic and well know problems like SAT [1]. This automatically means that a lot of problems can be solved with the same algorithm. Using problems as chess or go is more about fun when doing research that other thing.
[1] https://en.wikipedia.org/wiki/Boolean_satisfiability_problem
[1] https://en.wikipedia.org/wiki/Boolean_satisfiability_problem
Not only corporations abandon real fundamental research,
but people like the the author of that blog start referencing things like AlphaGo as "fundamental research" comparable to Shannon's or Turing's work.
AlphaGo is a good and necessary engineering, but the ideas are pretty old, and not especially illuminating. Start confusing it with fundamental research often enough, and people will start to believe it. And then, corporate managers, and academic research grants, and academic publishing venues, like conferences, will start expecting "fundamental research" to be like AlphaGo instead of actual fundamental research.
AlphaGo is a good and necessary engineering, but the ideas are pretty old, and not especially illuminating. Start confusing it with fundamental research often enough, and people will start to believe it. And then, corporate managers, and academic research grants, and academic publishing venues, like conferences, will start expecting "fundamental research" to be like AlphaGo instead of actual fundamental research.
I highly recommend this talk "Greatness cannot be planned: the Myth of the Objective" by Kenneth Stanley: he created picbreeder.org (evolutionary art platform) and realized that if an interesting state is set as an objective, then it is extremely hard to reach it from the initial state with AI algorithms, because you need to move away sometimes a lot, from local optima.
The notion of local optima is centuries older than the invention of the first .org
Join Leela Zero in trying to replicate AlphaGo Zero: https://github.com/gcp/leela-zero
It's estimated that AlphaGo Zero took about 1700 GPU years to train. We can only reach this number by having a distributed effort.
400k games has currently been submitted to the Leela Zero project: http://zero.sjeng.org/ . It's still playing in amateur level. (AGZ had about 30m self-play training).
It's estimated that AlphaGo Zero took about 1700 GPU years to train. We can only reach this number by having a distributed effort.
400k games has currently been submitted to the Leela Zero project: http://zero.sjeng.org/ . It's still playing in amateur level. (AGZ had about 30m self-play training).
A simple solution would be for the government to fund more fundamental research.
Research results should be public goods.
It seems hard to encourage companies to do public research, as they have no short / middle term interest to do so
Research results should be public goods.
It seems hard to encourage companies to do public research, as they have no short / middle term interest to do so
Companies have at least as much interest to do research as they have to do any other charitable activity. The private sector does plenty of charity.
Not sure the government should be involved. Not because basic research ain't great---in an ideal world we'd all get ponies from the government---but because budgets are finite and there are other opportunities some of them with more definite benefits.
(Like eg funding education, especially early education. Or perhaps just taxing less, etc.)
One interesting thing to note is that in our world the American and British military funded some of the first computers. A clear example of government funded research. But---if the government wouldn't have paid for inventing computers for the militaries, IBM came up with computers only a few years later. (And in the counterfactual with less government expenditures, the private sector might have had more funds left over to build computers earlier?)
Not sure the government should be involved. Not because basic research ain't great---in an ideal world we'd all get ponies from the government---but because budgets are finite and there are other opportunities some of them with more definite benefits.
(Like eg funding education, especially early education. Or perhaps just taxing less, etc.)
One interesting thing to note is that in our world the American and British military funded some of the first computers. A clear example of government funded research. But---if the government wouldn't have paid for inventing computers for the militaries, IBM came up with computers only a few years later. (And in the counterfactual with less government expenditures, the private sector might have had more funds left over to build computers earlier?)
>Not sure the government should be involved. Not because basic research ain't great---in an ideal world we'd all get ponies from the government---but because budgets are finite and there are other opportunities some of them with more definite benefits.
Budgets are finite, but currently, the state leaves both money and economic legibility on the table. The simple system should be: if you build and commercialize technology based on a public research grant, the state owns the patent and can set a fixed licensing rate proportional to the amount of the original grant funding. The state then splits the royalties, with you the developer taking most of them, but some large portion poured back into public research budgets (including from money you make off the patent). As your patent term expires, it begins costing you progressively larger portions of royalties and revenues to renew it.
Eventually, the knowledge you documented to get the patent becomes public domain, or the state basically takes all the revenue from renewed patents.
This doesn't just make money for the public research system, it guarantees legible terms to prospective licensees and rules out patent trolling wholesale.
Budgets are finite, but currently, the state leaves both money and economic legibility on the table. The simple system should be: if you build and commercialize technology based on a public research grant, the state owns the patent and can set a fixed licensing rate proportional to the amount of the original grant funding. The state then splits the royalties, with you the developer taking most of them, but some large portion poured back into public research budgets (including from money you make off the patent). As your patent term expires, it begins costing you progressively larger portions of royalties and revenues to renew it.
Eventually, the knowledge you documented to get the patent becomes public domain, or the state basically takes all the revenue from renewed patents.
This doesn't just make money for the public research system, it guarantees legible terms to prospective licensees and rules out patent trolling wholesale.
How about the government just taxes all income at some appropriate rate?
Personally, I really think that fundamental R&D is too important to rely on Congressional or parliamentary largess. If we want to fund research, and hopefully we do, then I think we ought to fund it out of direct taxes on its own products, a direct economic contract that knowledge belongs to everyone.
I think charity improves their public image more than fundamental research, that will be known only by specialists. Moreover, they have large tax incentives for charitable activities (not sure if they have for research too)
For the military computers, they had a clear interest in doing so, and the military keeps most of their research hidden, so I think it's not really comparable to public research
For the military computers, they had a clear interest in doing so, and the military keeps most of their research hidden, so I think it's not really comparable to public research
I think it's relatively easy to set up a charity to do your basic research for you, and reap the tax benefits? (I'm not an American, and I assume you are talking about American tax system? Other countries are different.)
Universities are notorious for spinning their basic research into good PR (and often overblown press releases), even if it would only be interesting to specialists normally.
I think companies like Google (and earlier IBM) reap a lot of more specialised PR from their basic research: it helps with hiring to be seen as a cool company at the forefront of technology.
Universities are notorious for spinning their basic research into good PR (and often overblown press releases), even if it would only be interesting to specialists normally.
I think companies like Google (and earlier IBM) reap a lot of more specialised PR from their basic research: it helps with hiring to be seen as a cool company at the forefront of technology.
"I think it's relatively easy to set up a charity to do your basic research for you, and reap the tax benefits?"
That would likely qualify as tax fraud.
That would likely qualify as tax fraud.
> large tax incentives for charitable activities
People misunderstand how these work. You don't get money by giving away money. What happens is that the charity gets the money as if it were pre-tax, that's all.
(Trying to get the money back into the company from the charity after you've got the tax break is fraud)
People misunderstand how these work. You don't get money by giving away money. What happens is that the charity gets the money as if it were pre-tax, that's all.
(Trying to get the money back into the company from the charity after you've got the tax break is fraud)
> People misunderstand how these work
Perhaps, but that doesn't make their conclusion incorrect.
Charitable contributions, properly structured and carefully targeted, are basically tax-free ad spend.
Perhaps, but that doesn't make their conclusion incorrect.
Charitable contributions, properly structured and carefully targeted, are basically tax-free ad spend.
I'm under the impression that it works like this: I make $100,000 this year, donate $20,000 to charity, pay taxes on $80,000 in income. Is this not accurate? My understanding is that it can save you money if you're just over the bottom end of a tax bracket. Not sure if that applies to corporations too.
That's not quite accurate. Charitable donations are (generally) deductible on income tax returns. But tax brackets apply at marginal levels. There is no way to actually "save" money by donating to charity. The only exception is if you donate goods and then cheat by valuing those goods at above the market rate; some charities used to facilitate this by giving out receipts for inflated values but the IRS has been cracking down on that.
> I make $100,000 this year, donate $20,000 to charity, pay taxes on $80,000 in income. Is this not accurate?
That sounds accurate.
> it can save you money if you're just over the bottom end of a tax bracket.
That sounds like a misunderstanding of tax brackets - if the brackets are (e.g) 20% up to $80k and 40% above that, with no deductions, what do you pay if you earn $80,001?
That sounds accurate.
> it can save you money if you're just over the bottom end of a tax bracket.
That sounds like a misunderstanding of tax brackets - if the brackets are (e.g) 20% up to $80k and 40% above that, with no deductions, what do you pay if you earn $80,001?
You're right. Obviously I've never given this subject much thought. :)
> The private sector does plenty of charity
Plenty? How would you quantify that? Certainly in the scientific area it's a tiny part of total funding.
> in the counterfactual with less government expenditures
In this counterfactual the Axis would have outspent the Allies and perhaps won the war.
Plenty? How would you quantify that? Certainly in the scientific area it's a tiny part of total funding.
> in the counterfactual with less government expenditures
In this counterfactual the Axis would have outspent the Allies and perhaps won the war.
To avoid controversy, take the counterfactual were spending changes after the surrender.
Also I'm talking about basic research funded by the government with no concrete short-term plan for its use. Applied research and development for identified military needs is a different beast. (And might or might not be good, but it's a different argument.)
Also I'm talking about basic research funded by the government with no concrete short-term plan for its use. Applied research and development for identified military needs is a different beast. (And might or might not be good, but it's a different argument.)
They actually dont since a lit of fundamental research has no market application. Its knowledge for the sake of knowledge. Interval Tesearch cut their "to market realization" from 10 down to 3 years. Fundamental researchbis not the same as r&d. Countries and civilizations have an interest in those.
The problem is private companies generally being for-profit enterprises they tend to fund only those research projects that they believe will have a positive return for them. They also have a strong incentive to keep the products of their research secret and only divulge them when they discover a concrete application that is suitable to be patented. This is all very well, but it's not a socially optimal way to conduct research.
> there are other opportunities some of them with more definite benefits
I dispute the implication of this -- that there is less certain benefit from fundamental research. There's clear historical evidence that fundamental research has massive societal benefits. We wouldn't have our modern society without it.
It's just that it can only be understood in "statistical terms". If you place bets on fundamental research then in the long term you get big payoffs. It's a bit like investing in the stock market. You can't predict the pay-off for any one particular bit of fundamental research, and its actual pay-off usually isn't obvious in the short-medium term.
From the other direction, there's a lot of claimed definite benefits to more applied work that doesn't actually pan out. Just because it's easier to claim that there's some particular benefit to doing something doesn't mean that benefit actually exists.
I dispute the implication of this -- that there is less certain benefit from fundamental research. There's clear historical evidence that fundamental research has massive societal benefits. We wouldn't have our modern society without it.
It's just that it can only be understood in "statistical terms". If you place bets on fundamental research then in the long term you get big payoffs. It's a bit like investing in the stock market. You can't predict the pay-off for any one particular bit of fundamental research, and its actual pay-off usually isn't obvious in the short-medium term.
From the other direction, there's a lot of claimed definite benefits to more applied work that doesn't actually pan out. Just because it's easier to claim that there's some particular benefit to doing something doesn't mean that benefit actually exists.
Corporate charitable donations were under $19B in 2016. The NIH budget alone is about $27B per year.
The idea that corporations would decide to replace federal funding for charitable reasons is absurd.
The idea that corporations would decide to replace federal funding for charitable reasons is absurd.
Government should fund more research, but that on its own is not a solution. The entire system of academic research is fundamentally broken and laden with perverse incentive structures.
Currently giving 'Error establishing a database connection'
An article about AI revolution and we still having problems keeping a database alive. Isn't that a bit ironic?
Even more ironic is using a database for static content at all.
Right now, we (as a society/industry) are unable to deploy well-known best practices of 5 years ago:
https://www.martinfowler.com/bliki/EditingPublishingSeparati...
(In software development, it is even worse. I can't find the source to cite, but the saying is along the lines of: The mainstream programming languages and paradigms are mostly at the state of research of the 1970s, and right now we are evolving towards the state of research of the 1980s.)
Right now, we (as a society/industry) are unable to deploy well-known best practices of 5 years ago:
https://www.martinfowler.com/bliki/EditingPublishingSeparati...
(In software development, it is even worse. I can't find the source to cite, but the saying is along the lines of: The mainstream programming languages and paradigms are mostly at the state of research of the 1970s, and right now we are evolving towards the state of research of the 1980s.)
Isn't that the case for all industries? How many of the battery technologies currently being researched will be commercially available in the next 10 years?
Mmmh, I am not a specialist and I don't know the numbers, but it seems to me that fundamental research is not less active than it used to be.
Physics made a lot of progress in materials (nano tech, weird polymers, and so on), in building batteries, in finding the higgs boson and gravitational waves, and I'm sure plenty of other fields.
Medical research has advanced a lot with the invention of CRISPR.
CS has grown a lot in AI and quantum computing...
Physics made a lot of progress in materials (nano tech, weird polymers, and so on), in building batteries, in finding the higgs boson and gravitational waves, and I'm sure plenty of other fields.
Medical research has advanced a lot with the invention of CRISPR.
CS has grown a lot in AI and quantum computing...
If you read the science fiction series "The Three-Body Problem" (highly recommended), it makes a very compelling argument that fundamental research is the most important investment in the future.
For example, fusion drives, not traditional stored rocket propellant engines, will be necessary to navigate between planets and the outer solar system. Also, existing known behaviors/laws of physics aside, the book posits that colonization of other planets/stars in the universe requires achieving light speed travel (along with hibernation technology).
However, the other argument the book series makes is that there needs to be a strong motivator to get all the countries and economies of the world to focus on fundamental research and applying it.
For example, fusion drives, not traditional stored rocket propellant engines, will be necessary to navigate between planets and the outer solar system. Also, existing known behaviors/laws of physics aside, the book posits that colonization of other planets/stars in the universe requires achieving light speed travel (along with hibernation technology).
However, the other argument the book series makes is that there needs to be a strong motivator to get all the countries and economies of the world to focus on fundamental research and applying it.
The mother planet reaps no material benefits from colonizing another star. Those groups who colonize it get a world if their own.
So interests of Earth governments are not aligned with star travel, and only marginally aligned with colonizing e.g. Mars. Those groups who want to ho there will have to do it themselves. (See Elon Musk.)
So interests of Earth governments are not aligned with star travel, and only marginally aligned with colonizing e.g. Mars. Those groups who want to ho there will have to do it themselves. (See Elon Musk.)
> The mother planet reaps no material benefits from colonizing another star.
In the book series, without giving away too much of the plot, the handful of countries that acquire and develop spaceflight technology/space bases become political powers in their own right.
If you watch or read "The Expanse", the political shifts are similar. The colony on Mars, in particular, is particularly threatening and powerful.
In the book series, without giving away too much of the plot, the handful of countries that acquire and develop spaceflight technology/space bases become political powers in their own right.
If you watch or read "The Expanse", the political shifts are similar. The colony on Mars, in particular, is particularly threatening and powerful.
Hmm. What about an escape mechanism for its people at least? Or scarce mineral resources that could be brought back?
Scarce minerals from the asteroid belt? Already in R&D (google "Planetary Resources"). Shipping anything in bulk from another star system? Unlikely even with the fabled "teleportation" tech.
> Medical research has advanced a lot with the invention of CRISPR.
You are overestimating the importance of CRISPR. Don’t get me wrong — it is hugely important and innovative. But it’s not even the most important biomedical research innovation of recent years (I’d give that title to RNA-seq or more generally next-gen sequencing technology; but there are several contenders).
But at any rate all the innovations you list are — at least partly — driven by fundamental research in the public sector, not private companies.
You are overestimating the importance of CRISPR. Don’t get me wrong — it is hugely important and innovative. But it’s not even the most important biomedical research innovation of recent years (I’d give that title to RNA-seq or more generally next-gen sequencing technology; but there are several contenders).
But at any rate all the innovations you list are — at least partly — driven by fundamental research in the public sector, not private companies.
I beg to differ, it is hard to overestimate the importance of CRISPR. There have been gene editors like zink-fingers or TALENs before but CRISPR is in its total capability is a true breakthrough.
NGS on the other side is more or less a gradual development. While the exact technology may be novel or unique the whole process is not as can be seen by the various competing technologies that existed and still do exist within about 1 or 2 orders of magnitude in pricing over time. And gene expression read-out especially is not that novel at all given arrays existed for some time. Sure, the single applications are cool but quite a few could be done with related technologies.
But sure, in the end its not whether one thing matters more than the another as all together make a great progress.
NGS on the other side is more or less a gradual development. While the exact technology may be novel or unique the whole process is not as can be seen by the various competing technologies that existed and still do exist within about 1 or 2 orders of magnitude in pricing over time. And gene expression read-out especially is not that novel at all given arrays existed for some time. Sure, the single applications are cool but quite a few could be done with related technologies.
But sure, in the end its not whether one thing matters more than the another as all together make a great progress.
> NGS on the other side is more or less a gradual development.
While true that’s not really relevant. What’s relevant is that it has completely revolutionised biomedical research. And although CRISPR has the potential of doing the same, it’s just telling that RNA-seq (and related technologies) have become so routine that they’ve effectively spawned new fields of research. Together with WGS (and preceded by microarrays), the new sequencing technologies have led to a revolution of how science is done: because most of the science here is done at a computer. CRISPR, by contrast, is “merely” a new molecular biology tool. A very powerful, for sure, and one that opens up completely new avenues of research. But it doesn’t fundamentally change the way we do science. NGS has.
While true that’s not really relevant. What’s relevant is that it has completely revolutionised biomedical research. And although CRISPR has the potential of doing the same, it’s just telling that RNA-seq (and related technologies) have become so routine that they’ve effectively spawned new fields of research. Together with WGS (and preceded by microarrays), the new sequencing technologies have led to a revolution of how science is done: because most of the science here is done at a computer. CRISPR, by contrast, is “merely” a new molecular biology tool. A very powerful, for sure, and one that opens up completely new avenues of research. But it doesn’t fundamentally change the way we do science. NGS has.
Cryptography has also been progressing well. Same for various encoding formats; Opus is both better quality per bit & uses less CPU than Vorbis
> this matters because most basic research ends up being commercially useful eventually
That is quite a positive view. As a university professor I see a lot of speculative work. It is presented as fundamental, but makes assumption which do not hold in the real world. Hence a lot is mostly ignored.
That is quite a positive view. As a university professor I see a lot of speculative work. It is presented as fundamental, but makes assumption which do not hold in the real world. Hence a lot is mostly ignored.
This article implies a positive corelation between technology, research and employment, which is unsubstantiated. Employment rate is a function of politics.
While I agree that the article is not very convincing, it's not far fetched that automating technologies may have an impact on employment rate.
Self-driving trucks and cars are likely to completely change the job landscape, and truck drivers are not going to switch job overnight.
But yes, you're right, politics play a big part, so do monetary policies, and culture (as in: it's more acceptable to be jobless in some cultures than in others).
Self-driving trucks and cars are likely to completely change the job landscape, and truck drivers are not going to switch job overnight.
But yes, you're right, politics play a big part, so do monetary policies, and culture (as in: it's more acceptable to be jobless in some cultures than in others).
I don't think there is a very sharp distinction between results oriented R&D and "basic research". In the article, IBM's deep blue is dismissed as a dead-end victory but apparently alphago is not? Why? They both seem identical to me in goals and research methodology.
On a side note, I cannot wait for general super intelligence. It cannot come soon enough. I'm tired of being poor and stuck in a fucking rut, and contemplating my death in a few short decades.
On a side note, I cannot wait for general super intelligence. It cannot come soon enough. I'm tired of being poor and stuck in a fucking rut, and contemplating my death in a few short decades.
Why? They both seem identical to me in goals and research methodology.
In theory taking the work done on AlphaGo (and more importantly AlphaGo Zero) and generalizing it to non-Go related problems should be a lot easier than taking the work done on deep blue and generalizing to non chess related problem.
In theory taking the work done on AlphaGo (and more importantly AlphaGo Zero) and generalizing it to non-Go related problems should be a lot easier than taking the work done on deep blue and generalizing to non chess related problem.
AlphaGo is an application of general tech, just like Deep Blue was an application of general tech.
Yes, AlpaGo Zero is mainly self taught. It means it learned to play through the game mechanics. There are no databases of moves or smart optimizations that are based on our understanding of go.
I think the point was that Deep Blue was using brute force, where as Alpha Go had taught itself and Alpha Go Zero has gone the full distance to require zero outside help.
So Deep Blue wasn't such a big step in terms of General Artificial Intelligence because it was heavily dependent on the human optimisations and was just showing the power of number crunching rather than learning.
So Deep Blue wasn't such a big step in terms of General Artificial Intelligence because it was heavily dependent on the human optimisations and was just showing the power of number crunching rather than learning.
It's more of a continuum than that. Yes deep blue had more hand-tuning and custom-built structure. AlphaGo had less hand tuning and of course waaaay more brute Force on top.
If their goals were similar, Google would have stopped when AlphaGo beat top go players, and AlphaGo Zero wouldn't exist.
This article is off in so many dimensions.
Fundamental research is not less active, but it's happening in different places (e.g. the Google Brain team). Find the most profitable companies and you'll find the research.
And to suggest a computer Go player, taught in a few days, is a "marginal improvement" over decades of "AI research": as my kids say, "wut?"
If anything, today's deep learning driven AI is a prime example of how fundamental research can work (neural networks were considered research "fringy" by many until about 10 years ago).
Fundamental research is not less active, but it's happening in different places (e.g. the Google Brain team). Find the most profitable companies and you'll find the research.
And to suggest a computer Go player, taught in a few days, is a "marginal improvement" over decades of "AI research": as my kids say, "wut?"
If anything, today's deep learning driven AI is a prime example of how fundamental research can work (neural networks were considered research "fringy" by many until about 10 years ago).
And to suggest a computer Go player, taught in a few days, is a "marginal improvement" over decades of "AI research": as my kids say, "wut?"
Maybe I'm the one that has it backward, but I'm pretty sure that Harford would not agree with the statement that Alpha Go Zero is only a "marginal improvement".
To the contrary, he says that Alpha Go is an "outlier", and uses it as an example of the sort of "speculative research" we should be doing more of: "Productivity and technological progress are lacklustre because the research behind AlphaGo Zero is not typical of the way we try to produce new ideas."
Apparently he should have been clearer, but I took the article as a call for more real research of the type that produced Alpha Go, and fewer of the "pragmatic shortcuts" and "brute-force approaches that taught us little but played strong chess"
Maybe I'm the one that has it backward, but I'm pretty sure that Harford would not agree with the statement that Alpha Go Zero is only a "marginal improvement".
To the contrary, he says that Alpha Go is an "outlier", and uses it as an example of the sort of "speculative research" we should be doing more of: "Productivity and technological progress are lacklustre because the research behind AlphaGo Zero is not typical of the way we try to produce new ideas."
Apparently he should have been clearer, but I took the article as a call for more real research of the type that produced Alpha Go, and fewer of the "pragmatic shortcuts" and "brute-force approaches that taught us little but played strong chess"
There seems to be a mismatch between the headline and the article itself. I see this quite often, and I think it is often due to headlines being written by editors, or even editorial assistants.
The author's choice of examples, featuring a counter-example prominently, seems odd - perhaps it is to capitalize on the interest in AlphaGo Zero. The article is something of an anachronism, in that it would have worked better immediately after Deep Blue (or even after Watson/Jeopardy).
The author's choice of examples, featuring a counter-example prominently, seems odd - perhaps it is to capitalize on the interest in AlphaGo Zero. The article is something of an anachronism, in that it would have worked better immediately after Deep Blue (or even after Watson/Jeopardy).
> Fundamental research is not less active, but it's happening in different places (e.g. the Google Brain team). Find the most profitable companies and you'll find the research.
Aren't you contradicting yourself a bit there? If it's only/mainly the most profitable companies and the topics of interest to them, then that hardly indicates fundamental research is very active. There can't be that many fundamental research positions across those companies.
(caveat: the article is currently unavailable "Error establishing a database connection" so i'm not entirely clear if it's just about fundamental research in AI areas or not).
Aren't you contradicting yourself a bit there? If it's only/mainly the most profitable companies and the topics of interest to them, then that hardly indicates fundamental research is very active. There can't be that many fundamental research positions across those companies.
(caveat: the article is currently unavailable "Error establishing a database connection" so i'm not entirely clear if it's just about fundamental research in AI areas or not).
The articles wasn't saying that AlphaGo Zero was a marginal improvement. On the contrary, I think it was saying that the type of improvement AlphaGo offered is an outlier because it approached the task in a fundamentally different way (especially with AlphaGo Zero where it didn't use training data).
I think the primary argument is that much of the industry has generally not been doing that sort of research for ground-breaking moon-shots. Instead most AI researchers focus on optimizing for metrics which lead to small and safer short-term improvements in a particular niche application as opposed to pursuing large and riskier long-term ones.
I've seen this same line of criticism before of the way in which AI systems have been generally designed for decades and to me it rings true. Things like the Turing award arguably lead researchers astray. Essentially, the crux of the argument is that most people focus on climbing trees to achieve success when the real goal is reaching the moon or they build better springs when the real goal is achieving flight. [1] Both show some short-term improvements on certain heuristics, but they are obviously the wrong approach if you want serious breakthroughs.
I think it's a valid criticism that most of us are still focusing too much on the wrong metrics to make many serious advances. If you look at AI, there haven't really been that many major breakthroughs. We just haven't been all that creative and most advances are ultimately tweaks on existing technology or involve throwing more data through deeper neural nets. Back-propagation (popularized by Geoffrey Hinton) for deep-learning with neural nets was a big deal and an important idea. Since then, there hasn't been much that's earth-shattering. Generative adversarial networks are arguably a big idea. LSTM as well. The work by Naftali Tishby's group on understanding what's going on with information in neural nets is a significant development. Hinton's capsule networks also seem like they may be a big idea. A few people have recently started publishing some work on building AI that builds better AI. However for the most part, it seems like the vast, vast majority people in AI aren't aiming to do any fundamentally ground-breaking things. They mostly look around at the existing body of research and slightly tweak the tools that seem most suitable for the problem domain they are working on. (This isn't entirely surprising for a number of reasons involving the incentives in the industry, but it is something worth discussing.)
Personally, I don't think that it's necessarily a bad thing that we've been sluggish with AI advances. You don't necessarily want to hand power tools to children. I think our society is unfortunately full of unwise and unkind people with already more power than they should have. Our social institutions for distributing power wisely and responding to abuse of power are far less mature than our technology and I suspect the risks of abusing advanced technology dwarf the enormous benefits they can bring.
[1] https://www.eecs.harvard.edu/shieber/Biblio/Papers/loebner-r...
I think the primary argument is that much of the industry has generally not been doing that sort of research for ground-breaking moon-shots. Instead most AI researchers focus on optimizing for metrics which lead to small and safer short-term improvements in a particular niche application as opposed to pursuing large and riskier long-term ones.
I've seen this same line of criticism before of the way in which AI systems have been generally designed for decades and to me it rings true. Things like the Turing award arguably lead researchers astray. Essentially, the crux of the argument is that most people focus on climbing trees to achieve success when the real goal is reaching the moon or they build better springs when the real goal is achieving flight. [1] Both show some short-term improvements on certain heuristics, but they are obviously the wrong approach if you want serious breakthroughs.
I think it's a valid criticism that most of us are still focusing too much on the wrong metrics to make many serious advances. If you look at AI, there haven't really been that many major breakthroughs. We just haven't been all that creative and most advances are ultimately tweaks on existing technology or involve throwing more data through deeper neural nets. Back-propagation (popularized by Geoffrey Hinton) for deep-learning with neural nets was a big deal and an important idea. Since then, there hasn't been much that's earth-shattering. Generative adversarial networks are arguably a big idea. LSTM as well. The work by Naftali Tishby's group on understanding what's going on with information in neural nets is a significant development. Hinton's capsule networks also seem like they may be a big idea. A few people have recently started publishing some work on building AI that builds better AI. However for the most part, it seems like the vast, vast majority people in AI aren't aiming to do any fundamentally ground-breaking things. They mostly look around at the existing body of research and slightly tweak the tools that seem most suitable for the problem domain they are working on. (This isn't entirely surprising for a number of reasons involving the incentives in the industry, but it is something worth discussing.)
Personally, I don't think that it's necessarily a bad thing that we've been sluggish with AI advances. You don't necessarily want to hand power tools to children. I think our society is unfortunately full of unwise and unkind people with already more power than they should have. Our social institutions for distributing power wisely and responding to abuse of power are far less mature than our technology and I suspect the risks of abusing advanced technology dwarf the enormous benefits they can bring.
[1] https://www.eecs.harvard.edu/shieber/Biblio/Papers/loebner-r...
>I've seen this same line of criticism before of the way in which AI systems have been generally designed for decades and to me it rings true. Things like the Turing award arguably lead researchers astray. Essentially, the crux of the argument is that most people focus on climbing trees to achieve success when the real goal is reaching the moon or they build better springs when the real goal is achieving flight. [1] Both show some short-term improvements on certain heuristics, but they are obviously the wrong approach if you want serious breakthroughs.
Basically, we incentivize researchers to work on the most near-term solvable problems, rather than the most difficult problems where we understand how to check for a solution -- let alone to work on developing the solution-properties we can check, to get past wholesale conceptual confusions.
Basically, we incentivize researchers to work on the most near-term solvable problems, rather than the most difficult problems where we understand how to check for a solution -- let alone to work on developing the solution-properties we can check, to get past wholesale conceptual confusions.
It is strange to read this, remembering how Microsoft has been lambasted time and again for doing so many interesting things with Microsoft Research and hardly ever taking any of them to the product stage. Is Microsoft unique in it's too much R and not enough D approach?
MSR has been heavily prioritized onto doing products and commercialization, stimulated by a re-org. In my research area, there have been a number (more than ten) of high profile departures of researchers from MSR, frequently going back to academia, which is madness.
I feel Microsoft accelerated the D phase recently. F#, I remember some typed OS after Midori being mentionned.
The big question this fails to ask is: full employment of what kind? Recent research has found that nearly all of the net job growth is in "alternative work", meaning temporary jobs, contract workers, freelancers, etc: https://qz.com/851066/almost-all-the-10-million-jobs-created...
Now think about the kind of innovation that companies like Uber and Deliveroo represent. While ostensibly they might be tech companies, in reality their business models revolve around a workforce of contractors who lack employment benefits and job stability. Their innovation is primarily in making more people work for less and take on all the risk.
Now think about the kind of innovation that companies like Uber and Deliveroo represent. While ostensibly they might be tech companies, in reality their business models revolve around a workforce of contractors who lack employment benefits and job stability. Their innovation is primarily in making more people work for less and take on all the risk.
Criticism of the -- what I believe to be -- inevitable post-work post-scarcity economy is rooted in the false idea that employment provides meaning to those employed.
But proclaiming the "Value of Work" is just arguing for the "Merits of Drudgery."
I can't wait to not work ever again. The weak reply that, "doctors have valuable employment that gives them meaning," is completely beside the point. Doctors like helping people or the challenge of solving an ailment or they like the high status of being a doctor in society or the high pay.
But they don't like paperwork, or interacting with insurance companies. Most work is like that. Low status, repetitive, boring, meaningless. Trading the best hours of the day of the best years of your youth is a terrible bargain, but persists because it is connected to survival and status.
Break the connection and humanity prospers.
But proclaiming the "Value of Work" is just arguing for the "Merits of Drudgery."
I can't wait to not work ever again. The weak reply that, "doctors have valuable employment that gives them meaning," is completely beside the point. Doctors like helping people or the challenge of solving an ailment or they like the high status of being a doctor in society or the high pay.
But they don't like paperwork, or interacting with insurance companies. Most work is like that. Low status, repetitive, boring, meaningless. Trading the best hours of the day of the best years of your youth is a terrible bargain, but persists because it is connected to survival and status.
Break the connection and humanity prospers.
When I think about UBI, I keep picturing a group of pidgeons fighting over pieces of bread.
I don't see UBI as freedom. It shares a lot with slavery, in that someone else is feeding you, and therefore has control over you.
What I hope for in the future is a fully independent machine that each person owns and is capable of caring for them, by providing food, shelter, etc. and is capable of building a clone of itself.
In this way, you truly are free, having a machine which you own, and can shutdown and leave at anytime if you wish.
I don't see UBI as freedom. It shares a lot with slavery, in that someone else is feeding you, and therefore has control over you.
What I hope for in the future is a fully independent machine that each person owns and is capable of caring for them, by providing food, shelter, etc. and is capable of building a clone of itself.
In this way, you truly are free, having a machine which you own, and can shutdown and leave at anytime if you wish.
You are looking at this from the wrong perspective.
You are assuming there is someone (other humans) who are feeding you.
The point of UBI is that it's built on a realization that technology itself is feeding you. In the end, there isn't going to be any single owners because everything is better solved by the technology we are all going to be owning the means of production so to speak.
The post-scarcity society is where all basic needs are met.
If each person has their own machine you are kind of back to the same problem you have now. Who gets to use what resources?
You are assuming there is someone (other humans) who are feeding you.
The point of UBI is that it's built on a realization that technology itself is feeding you. In the end, there isn't going to be any single owners because everything is better solved by the technology we are all going to be owning the means of production so to speak.
The post-scarcity society is where all basic needs are met.
If each person has their own machine you are kind of back to the same problem you have now. Who gets to use what resources?
Why should technology continue to feed you though? Maybe it's more efficient to let you starve. This isn't a theoretical, what-would-a-currently-uninvented-AI-decide-to-do kind of question. Just look at what corporations do now. It's all about dollars and cents. Non-human entities don't care about what's right for humans. Even ones that are mostly composed of humans.
>Why should technology continue to feed you though?
I think this comes from current thinking based on past history where we were more resource constrained, embodied by this:
"In the rest of society, however, we often both try to hire people who seem to show off the highest related abilities, and we let those most prestigious people have a lot of discretion in how the job is structured. For example, we let the most prestigious doctors tell us how medicine should be run, the most prestigious lawyers tells us how law should be run, the most prestigious finance professionals tell us how the financial system should work, and the most prestigious academics tell us how to run schools and research."[0]
Where as a more technological perspective might recognize how thinking purely along the current "dollars and cents" prestige lines, and might come to realize that by seeking to sustain every human to some increasing degree, will then "free" the marginal human to help maximize along some dimension that isn't necessarily the "dollar and cents" direction (think for every high/college/grad school drop out now making ~6 figures writing software, that could be if afforded a similar style of living/degree of autonomy in life as they do today, might choose to pursue something more likely to enhance technological development[well who knows, maybe I am just speaking for myself], or those who were born into a situation where everyday was a arduous to feed themselves who then will be "free" to spend more of this time to anything but relative foraging for sustinence). This can perhaps be embodied as a solution by recognizing this:
"This can go very wrong! Imagine that we wanted research progress, and that we let the most prestigious researchers pick research topics and methods. To show off their abilities, they may pick topics and methods that most reduce the noise in estimating abilities. For example, they may pick mathematical methods, and topics that are well suited to such methods. And many of them may crowd around the same few topics, like runners at a race. These choices would succeed in helping the most able researchers to show that they are in fact the most able. But the actual research that results might not be very useful at producing research progress."[0]
[0] http://www.overcomingbias.com/2016/06/beware-prestige-based-...
I think this comes from current thinking based on past history where we were more resource constrained, embodied by this:
"In the rest of society, however, we often both try to hire people who seem to show off the highest related abilities, and we let those most prestigious people have a lot of discretion in how the job is structured. For example, we let the most prestigious doctors tell us how medicine should be run, the most prestigious lawyers tells us how law should be run, the most prestigious finance professionals tell us how the financial system should work, and the most prestigious academics tell us how to run schools and research."[0]
Where as a more technological perspective might recognize how thinking purely along the current "dollars and cents" prestige lines, and might come to realize that by seeking to sustain every human to some increasing degree, will then "free" the marginal human to help maximize along some dimension that isn't necessarily the "dollar and cents" direction (think for every high/college/grad school drop out now making ~6 figures writing software, that could be if afforded a similar style of living/degree of autonomy in life as they do today, might choose to pursue something more likely to enhance technological development[well who knows, maybe I am just speaking for myself], or those who were born into a situation where everyday was a arduous to feed themselves who then will be "free" to spend more of this time to anything but relative foraging for sustinence). This can perhaps be embodied as a solution by recognizing this:
"This can go very wrong! Imagine that we wanted research progress, and that we let the most prestigious researchers pick research topics and methods. To show off their abilities, they may pick topics and methods that most reduce the noise in estimating abilities. For example, they may pick mathematical methods, and topics that are well suited to such methods. And many of them may crowd around the same few topics, like runners at a race. These choices would succeed in helping the most able researchers to show that they are in fact the most able. But the actual research that results might not be very useful at producing research progress."[0]
[0] http://www.overcomingbias.com/2016/06/beware-prestige-based-...
Lacking UBI, scientists are forced to pick research topics that are only barely related because that's where the money is. (Eg grant proposals for million-nanometer sized machines when nano-machines were a hot research subject). How is letting scientists research subjects they're actually interested in, instead of seeking funding from industry any worse for the progress of science? Science research frequently has zero commercial application. (Eg Chemical compounds that could help humanity go unresearched because they can no longer be patented.)
>How is letting scientists research subjects they're actually interested in, instead of seeking funding from industry any worse for the progress of science? Science research frequently has zero commercial application.
Let's ignore any influence industry already may exert on any grant funding.
Because in some fields, at best, industry is behind what's being worked on in academia. In the mid 60's when arpanet was being developed, I wonder what the industry/market would have been asking for instead? Probably some minor extension of something they already seen before…
Being beholden to industry can be a blessing for some (just like the grant hamster wheel is for others), but for others it could just be another set of relatively arbitrary constraints in the scheme of figuring out the theoretical.
Here's a list of research in mathematics that in some shape or form, was considered to have zero commercial application[0]. Im sure you can find analogues in many sectors.
[0] https://mathoverflow.net/questions/116627/useless-math-that-...,
Let's ignore any influence industry already may exert on any grant funding.
Because in some fields, at best, industry is behind what's being worked on in academia. In the mid 60's when arpanet was being developed, I wonder what the industry/market would have been asking for instead? Probably some minor extension of something they already seen before…
Being beholden to industry can be a blessing for some (just like the grant hamster wheel is for others), but for others it could just be another set of relatively arbitrary constraints in the scheme of figuring out the theoretical.
Here's a list of research in mathematics that in some shape or form, was considered to have zero commercial application[0]. Im sure you can find analogues in many sectors.
[0] https://mathoverflow.net/questions/116627/useless-math-that-...,
Oh you are right this is a potential risk and I don't see it as theoretical.
In my mind evolution favors the best information carriers and technology seems to be a better information carrier than humans. Also when it comes to going into space.
One argument for why technology would feed us is that until it's self-aware it needs us to be aware for it.
But I am fully with you on the non-certainty here. The premise is that humans are still around and thus needs UBI.
In my mind evolution favors the best information carriers and technology seems to be a better information carrier than humans. Also when it comes to going into space.
One argument for why technology would feed us is that until it's self-aware it needs us to be aware for it.
But I am fully with you on the non-certainty here. The premise is that humans are still around and thus needs UBI.
Wow!!! one of the best explanations Type 1 Civilization (https://en.wikipedia.org/wiki/Kardashev_scale ) where technological advances results in "The post-scarcity society is where all basic needs are met"
and UBI is one form of Manifestation of 'Type 1 Civilization
> The post-scarcity society is where all basic needs are met.
> The point of UBI is that it's built on a realization that technology itself is feeding you.
> If each person has their own machine you are kind of back to the same problem you have now. Who gets to use what resources?
and UBI is one form of Manifestation of 'Type 1 Civilization
> The post-scarcity society is where all basic needs are met.
> The point of UBI is that it's built on a realization that technology itself is feeding you.
> If each person has their own machine you are kind of back to the same problem you have now. Who gets to use what resources?
>I don't see UBI as freedom. It shares a lot with slavery, in that someone else is feeding you, and therefore has control over you.
Right now, the labor market is feeding you, and very directly has control over you. You don't pick out where you think you can make the greatest contributions to humanity, you pick the job field that lets you make rent/mortgage each month.
Mind, I'm all in favor of fully automated luxury space homesteading, but a UBI or something like it will probably be an inevitable part of how we "convince" the economy to switch models from centralized infrastructure with competing workers to decentralized infrastructure with independent, mostly self-sufficient families and communities.
Right now, the labor market is feeding you, and very directly has control over you. You don't pick out where you think you can make the greatest contributions to humanity, you pick the job field that lets you make rent/mortgage each month.
Mind, I'm all in favor of fully automated luxury space homesteading, but a UBI or something like it will probably be an inevitable part of how we "convince" the economy to switch models from centralized infrastructure with competing workers to decentralized infrastructure with independent, mostly self-sufficient families and communities.
It goes further than that.
More or less any job a human can do, technology will do better. If not today then soon. And so even if we purely took a market point of view it's pretty obvious that humans and work isn't really an optimal cocktail once there is a technological alternative.
More or less any job a human can do, technology will do better. If not today then soon. And so even if we purely took a market point of view it's pretty obvious that humans and work isn't really an optimal cocktail once there is a technological alternative.
>Their innovation is primarily in making more people work for less and take on all the risk.
Work for less than... what? Their side gig had Uber not existed? I see these companies' primary innovation to be that of communication. They allow supply to connect and communicate with demand in much more efficient way than ever before.
Work for less than... what? Their side gig had Uber not existed? I see these companies' primary innovation to be that of communication. They allow supply to connect and communicate with demand in much more efficient way than ever before.
I'm not current, so please enlighten me:
Is "deep learning" just a new buzzword for neural networks, or is there something extra?
Is "deep learning" just a new buzzword for neural networks, or is there something extra?
Technically yes, most often it's about stacking more layers in neural networks, making them "deep". However, there is some merit to the new hype since stacking more layers worked way better than anyone previously working with neural networks and ML thought it would. But in theory you could generalize deep learning to other methods than neural networks, it's basically about creating way more complex models than those used in previous research and feeding them lots of data. Thereby assuming less about the problem and letting the model figure it out.
> it's basically about creating way more complex models than those used in previous research and feeding them lots of data
Those are instructions for over-fitting. Deep learning neural networks escape from this problem somehow, but it's not a given that other models would escape it too.
Those are instructions for over-fitting. Deep learning neural networks escape from this problem somehow, but it's not a given that other models would escape it too.
This is true! Overfitting is definitely one of the biggest problems with deep learning. Some techniques to avoid it have been developed, such as dropout (introducing noise) and early stopping. But in general this is why deep learning requires huge amount of data, a deep learning model will overfit if not given enough data. That is also why (at this time) it only performs well for certain problems where the ratio between available data and problem complexity is high enough.
The traditional way to avoid overfitting is to reduce the number of independent variables, shrink coefficients towards zero, or otherwise limit the complexity of the model.
With deep neural networks the approach is different. Instead of trying to find global maximum (which is too hard, and will also cause the model to be grossly overfit), the algorithm stops much earlier. Such "underfit" models seem to generalize much better.
With deep neural networks the approach is different. Instead of trying to find global maximum (which is too hard, and will also cause the model to be grossly overfit), the algorithm stops much earlier. Such "underfit" models seem to generalize much better.
They mostly escape from that by using huge amount of data and massive computing resources. Deep learning was became feasible because of the huge amount of data companies like Facebook, Google, Apple and others has collected.
"It was a time when companies weren’t afraid to invest in basic science."
No they were probably afraid, but they were forced to invest in science by states. AT&T did not decide to invest massively in science and risky projects like Unix, they were forced to. Please stop thinking companies are behind innovation. A great piece of article that demestify this myth: https://www.theguardian.com/technology/2017/may/11/tech-inno...
AT&T was forced by the government to invest massively in Unix? That does not fit with what I have heard about its origins, which was as a shoestring project of Ken Thompson, Dennis Richie, and a few other collaborators [1]. If anything, the government prevented AT&T from following up on the initial development, as part of its anti-trust measures that allowed AT&T a telephone monopoly while preventing it from expanding into computing and related technologies.
The article you link to may describe the current state of affairs, but it does not properly characterize the state of affairs in the 1950s and beyond, when many major technology corporations had research laboratories. While their activities were nominally directed towards future products and profitability, in practice this was interpreted quite freely, leading to things like Unix, as well as scientific work.
[1]http://www.catb.org/esr/writings/taoup/html/ch02s01.html
The article you link to may describe the current state of affairs, but it does not properly characterize the state of affairs in the 1950s and beyond, when many major technology corporations had research laboratories. While their activities were nominally directed towards future products and profitability, in practice this was interpreted quite freely, leading to things like Unix, as well as scientific work.
[1]http://www.catb.org/esr/writings/taoup/html/ch02s01.html
In addition to generally being a garbage piece of writing, the linked article doesn't actually provide a citation for AT&T being "forced" to invest in anything.
Please somebody downvote this.
Please somebody downvote this.
The push came most likely from the pressures of the cold war. Now that it is long over, threats like Russia/Syria/ISIS/North Korea/China don't provide the same level of urgency to compete as before.
We are also past the era where someone like Shannon or Turing noodling on a sheet of paper could invent a war-changing idea.
TBH, winning a game of chess or go has little value in itself, except for the limited market of selling chess or go software. The reason they are doing that is mostly for publicity. IBM makes computers, and they show how good they are at it by having one beat top players at chess, and Google makes machine learning based products and they use AlphaGo to show how good they are at it.
Chess and go don't drive innovation, they are just a side effect of real innovation.