AI21 Labs launches Jamba, an AI model that integrates two architectures: transformer and Mamba, which is based on the Structured State Space model (Kyle Wiggers/TechCrunch)

[ad_1]

Kyle Wiggers / TechCrunch:

AI21 Labs launches Jamba, an AI model that integrates two architectures: transformer and Mamba, which is based on the Structured State Space model  —  Increasingly, the AI industry is moving toward generative AI models with longer contexts.  But models with large context windows tend to be compute-intensive.

[ad_2]
Source : http://www.techmeme.com/240328/p32#a240328p32