SambaNova debuts 1 trillion parameter Composition of Experts model for enterprise gen AI
March 5, 2024
SambaNova Systems today announced what could well be one of the largest large language models (LLMs) ever released, with the debut of its one trillion parameter Samba-1.
Samba-1 is not a single model, like OpenAI’s GPT-4, rather it is a combination of more than 50 high-quality AI models put together in an approach that SambaNova refers to as a Composition of Experts architecture. While the…