The stack is basic. I develop on an old lenovo laptop and test for a few dozen frames(you can learn a lot without a CUDA GPU) before pushing it to a desktop with a cheap nvidia card. It uses pytorch and pyboy, and the model is just a couple Conv2d expansions and compressions before hitting a Linear layer outputting predicted reward for certain keypresses(basically). The model training is based off of deep Q learning. I'm looking at a pytorch tutorial[1] when I get stuck, but I'm trying to fumble around and try it myself as much as possible before looking at it.
I have an idea to have variable Q training propagation based on the amplitude of the reward so that bigger rewards propagate more, but I haven't got there yet.
Here is a great video on reinforcement learning[2].
It's not monetizable, but I'm playing with reinforcement learning. It's incredible to watch a computer "learn" to play super mario using just input pictures.
Neural nets in general are much less complicated than I thought they would be, at least as a practitioner.
Almost all news and social media site structure is derived from research using the Skinner box[1, scroll down to A Man, a Plan, and a Rat in a Box]. Researching operant conditioning, they found that introducing randomness to some sort of dopamine release would cause habitual behavior of the action that caused dopamine release. This reaction to novelty was then successfully transferred to humans. This is most obvious on Reddit IMO, with "gems" interspersed between vapid, uninteresting posts.
I'm actually making an alternative to Facebook that shows posts chronologically in the feed instead of using machine learning algorithms to make them addictive. I also plan to not include a share button on posts. I think these two changes would make it far less addictive and better for users.
Not to be too spammy, but discovery of such sites is why I'm making Feldot, a social domain aggregation site. There are so many sites available out there like this to browse, but we never see them when using existing search engines.
IMO, the higher barrier to entry is a benefit to this site. Features that would lower friction increase content dilution. From what I understand, this site is not trying to become Reddit.
Re your second case: When economic incentives line up with environmental goals, progress is made. OP should have been transparent, but if someone makes a profit while improving other people's eco-footprints, it's a win-win.
What's seriously making me consider cancelling my subscription is the fact that they autoplay trailers on the kids channel. I don't want my daughter getting addicted through the ML algorithms on the site, period.
For those who don't know, a fiduciary is legally obligated to work in your best financial interests, so it's pretty important that your financial advisor is one.
Large corporations have a Board of Directors composed of people voted into the position by shareholders. This means that large corporations need for the most part to do what shareholders want, or else they will be voted out.
There's also a matter of business competition. If Amazon stops worrying about profits, leverage, and expansion, that leaves areas that competitors can move in _within their domain_. This is why it seems all the big organizations behave sociopathicly: it's required to be on top.
Laws are designed to create limits on corporations to explicitly express how big businesses can behave, and it's not the businesses fault that those laws haven't been keeping up with the times.
I have an idea to have variable Q training propagation based on the amplitude of the reward so that bigger rewards propagate more, but I haven't got there yet.
Here is a great video on reinforcement learning[2].
[1] https://pytorch.org/tutorials/intermediate/mario_rl_tutorial...
[2] https://www.youtube.com/watch?v=93M1l_nrhpQ&t=3381