HackerTrans
TopNewTrendsCommentsPastAskShowJobs

rubywilde

no profile record

comments

rubywilde
·il y a 19 jours·discuss
Looks really neat. Though, it does feel like "yet another KM app" without significant innovations.
rubywilde
·il y a 3 ans·discuss
Actually, it is not true. Hilarious

Author compares different encoders: for Facebook's NLLB and GPT2. Where did title came from?

Another point is that OpenAI changed encoders for chat models. Link: https://github.com/openai/openai-cookbook/blob/main/examples...

Now English is less optimized for tokens usage and other languages are much more balanced. E.g. Ukrainian takes only twice as much tokens, before it had 6 times more tokens