HackerTrans
TopNewTrendsCommentsPastAskShowJobs

cgreerrun

no profile record

Submissions

How does controlling a robot work? [video]

youtube.com
2 points·by cgreerrun·10 months ago·1 comments

comments

cgreerrun
·9 months ago·discuss
Check out Quoridor
cgreerrun
·10 months ago·discuss
Short explainer for how the control of the SO-100 robot works.
cgreerrun
·last year·discuss
Highly recommend LeRobot.
cgreerrun
·3 years ago·discuss
Depends on game/environment and—since it's using a GBDT and not a NN—how good you are at feature extraction/selection for your problem.

High level, I'd say it's a good way to test a new environment w/out spending time/effort on GPUs until you understand the problem well, and then you can switch to the time/money costly GPU world.
cgreerrun
·3 years ago·discuss
> I came up with a nifty implementation in Python that outperforms the naive impl by 30x, allowing a pure python MCTS/NN interop implementation. See https://www.moderndescartes.com/essays/deep_dive_mcts/

Great post!

Chasing pointers in the MCTS tree is definitely a slow approach. Although typically there are ~ 900 "considerations" per move for alphazero. I've found getting value/policy predictions from a neural network (or GBDT[1]) for the node expansions during those considerations is at least an order of magnitude slower than the MCTS tree-hopping logic.

[1] https://github.com/cgreer/alpha-zero-boosted