xAI open sources the base model weights and network architecture of Grok-1, a 314B parameter Mixture-of-Experts model, under the Apache 2.0 license (x.ai)

https://ift.tt/EVi4lzO

x.ai:
xAI open sources the base model weights and network architecture of Grok-1, a 314B parameter Mixture-of-Experts model, under the Apache 2.0 license  —  We are releasing the base model weights and network architecture of Grok-1, our large language model.  Grok-1 is a 314 billion parameter Mixture …

from Techmeme https://ift.tt/sxPrftO