Our great sponsors
-
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
https://github.com/facebookresearch/fairseq/blob/nllb/LICENS...
The model is CC. Because models aren't software.
Actually, it is not true. Hilarious
Author compares different encoders: for Facebook's NLLB and GPT2. Where did title came from?
Another point is that OpenAI changed encoders for chat models. Link: https://github.com/openai/openai-cookbook/blob/main/examples...
Now English is less optimized for tokens usage and other languages are much more balanced. E.g. Ukrainian takes only twice as much tokens, before it had 6 times more tokens
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
- Sequence-to-Sequence Toolkit Written in Python
- Show HN: LlamaGym – fine-tune LLM agents with online reinforcement learning
- Lightning AI Studios – A persistent GPU cloud environment
- Nvidia's 900 tons of GPU muscle bulks up server market, slims down wallets
- Talk back and forth with AI like you would with a person