HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jumpCastle

no profile record

comments

jumpCastle
·w zeszłym roku·discuss
It was a good benchmark until it entered the training set.
jumpCastle
·w zeszłym roku·discuss
But open source like aider
jumpCastle
·w zeszłym roku·discuss
Deepseek v3 was FP8
jumpCastle
·w zeszłym roku·discuss
It's quite similar to muP

https://github.com/microsoft/mup
jumpCastle
·2 lata temu·discuss
Stock prices cannot go up without if the planet is destroyed
jumpCastle
·2 lata temu·discuss
Attention was invented because Bengio lab had to be disciplined about a black box (google had more compute)
jumpCastle
·2 lata temu·discuss
Aren't services like runpod solve half of these concerns?
jumpCastle
·2 lata temu·discuss
Are the updates really slow?
jumpCastle
·2 lata temu·discuss
Spend more time with my side projects.
jumpCastle
·2 lata temu·discuss
You can try his book. https://www.math.ias.edu/avi/book
jumpCastle
·2 lata temu·discuss
You can use older models with the api.
jumpCastle
·2 lata temu·discuss
Also the parameters are optimized also with loss of future tokens in the sequence.