HackerTrans
トップ新着トレンドコメント過去質問紹介求人

rubywilde

no profile record

コメント

rubywilde
·19 日前·議論
Looks really neat. Though, it does feel like "yet another KM app" without significant innovations.
rubywilde
·3 年前·議論
Actually, it is not true. Hilarious

Author compares different encoders: for Facebook's NLLB and GPT2. Where did title came from?

Another point is that OpenAI changed encoders for chat models. Link: https://github.com/openai/openai-cookbook/blob/main/examples...

Now English is less optimized for tokens usage and other languages are much more balanced. E.g. Ukrainian takes only twice as much tokens, before it had 6 times more tokens