Falcon-H1-Arabic
State-of-the-art Arabic LLMs on a hybrid Mamba-Transformer architecture, with attention and SSM running in parallel inside each block. Available in 3B, 7B and 34B, with context windows up to 256K tokens.
- ~75%OALL · 34B, ahead of 70B-class transformers
- 71.7%OALL · 7B, ahead of every ~10B model
- ~62%OALL · 3B, ~10 pts over 4B-class models