HackerTrans
TopNewTrendsCommentsPastAskShowJobs

raindear

no profile record

comments

raindear
·8 bulan yang lalu·discuss
There has been a slow progress in computer vision in the last ~5 years. We are still not close to human performance. This is in contrast to language understanding which has been solved - LLMs understand text on a human level (even if they have other limitations). But vision isn't solved. Foundation models struggle to segment some objects, they don't generalize to domains such as scientific images, etc. I wonder what's missing with models. We have enough data in videos. Is it compute? Is the task not informative enough? Do we need agency in 3D?
raindear
·8 bulan yang lalu·discuss
Are dead ReLUs still a pronlem today? Why not?
raindear
·11 bulan yang lalu·discuss
How far can you go by improving the curriculum? Start simple. Find a shorter and shorter sequence of examples that gives you thd best result. What is the shortest sequence to get to some perplexity? Why?