xAI open sources Grok
On March 11th, Elon Musk said xAI would open source its AI chatbot Grok, and now an open release is available on GitHub. This will allow researchers and developers to build on the model and impact how xAI updates Grok in the future as it competes with rival tech from OpenAI, Meta, Google, and others.
A company blog post explains that this open release includes the “base model weights and network architecture” of the “314 billion parameter Mixture-of-Experts model, Grok-1.” It continues saying the model is from a checkpoint last October and hasn’t undergone fine-tuning “for any specific application, such as dialogue.”
As VentureBeat notes, it’s being released under the Apache 2.0 license that enables commercial use but doesn’t include the data used to train it or connections to X for real-time data. xAI said in a November 2023 post that the LLM Grok was “developed over the last four months” and is targeted for uses around coding generation, creative writing, and answering questions.
After Musk bought Twitter (now X), the code behind its algorithms was eventually released, and Musk has openly criticized companies that don’t open-source their AI model. That includes OpenAI, which he helped found but is now suing, alleging the company breached an original founding agreement that it would be open source.
Companies have released open-source or limited open-source models to get feedback from other researchers on how to improve them. While there are many fully open-source AI foundation models like Mistral and Falcon, the most widely used models are either closed-sourced or offer a limited open license. Meta’s Llama 2, for example, gives its research away for free but makes customers with 700 million daily users pay a fee and won’t let developers iterate on top of Llama 2.
On March 11th, Elon Musk said xAI would open source its AI chatbot Grok, and now an open release is available on GitHub. This will allow researchers and developers to build on the model and impact how xAI updates Grok in the future as it competes with rival tech from…
Recent Posts
- The Arc browser just launched and yes, it really is that good
- Microsoft’s billion-dollar OpenAI investment was trigged by Google fears, emails reveal
- Walmart shuts down telehealth service
- Audible tries book recommendations based on your streaming history
- Anthropic finally releases a Claude mobile app
Archives
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- December 2011