AI21: Jamba 1.5 Mini

Jamba 1.5 Mini is the world's first production-grade Mamba-based model, combining SSM and Transformer architectures for a 256K context window and high efficiency. It works with 9 languages and can handle various writing and analysis tasks as well as or better than similar small models. This model uses less computer memory and works faster with longer texts than previous designs.

Jamba 1.5 Mini has a 256,000 token context window.

Jamba Large 1.7 is another text model from AI21.

Jamba 1.5 Mini was released on August 23, 2024. Its knowledge cutoff is March 31, 2024.