Stability AI announces new open-source large language model


Stability AI, the company behind the AI-powered Stable Diffusion image generator, has released a suite of open-source large language models (LLMs) collectively called StableLM. In a post shared on Wednesday, the company announced that its models are now available for developers to use and adapt on GitHub.
Like its ChatGPT rival, StableLM is designed to efficiently generate text and code. It’s trained on a larger version of the open-source dataset known as the Pile, which encompasses information from a range of sources, including Wikipedia, Stack Exchange, and PubMed. Stability AI says StableLM models are currently available between 3 billion and 7 billion parameters, with 15 to 65 billion parameter models arriving later.
While StableLM expands on the open-source language models that Stability AI has already worked on in collaboration with the nonprofit EleutherAI, it also builds on its mission to make AI tools more accessible, as it has done with Stable Diffusion. The company made its text-to-image AI available in several ways, including a public demo, a software beta, and a full download of the model, allowing developers to toy with the tool and come up with various integrations.
We might even see the same happen with StableLM, along with Meta’s open-source LLaMa language model that leaked online last month. As pointed out by my colleague James Vincent, the release of Stable Diffusion has led “to both more good stuff and more bad stuff happening,” and “we’ll likely see a similar dynamic play out once more with AI text generation: more stuff, more of the time.”
You can try out a demo of StableLM’s fine-tuned chat model hosted on Hugging Face, which gave me a very complex and somewhat nonsensical recipe when I tried asking it how to make a peanut butter sandwich. It also suggested that I add a “funny drawing” to a sympathy card. Stability AI warns that while the datasets it uses should help “steer the base language models into ‘safer’ distributions of text, not all biases and toxicity can be mitigated through fine-tuning.”
Stability AI, the company behind the AI-powered Stable Diffusion image generator, has released a suite of open-source large language models (LLMs) collectively called StableLM. In a post shared on Wednesday, the company announced that its models are now available for developers to use and adapt on GitHub. Like its ChatGPT…
Recent Posts
- ICYMI: the week’s 8 biggest tech stories, from the iPhone 16e to Wi-Fi 7 routers and a crackdown on Kindle piracy
- The Handmaid’s Tale season 6: everything we know so far about the hit Hulu show’s return
- Nvidia confirms ‘rare’ RTX 5090 and 5070 Ti manufacturing issue
- I used NoteBookLM to help with productivity – here’s 5 top tips to get the most from Google’s AI audio tool
- Reddit is experiencing outages again
Archives
- February 2025
- January 2025
- December 2024
- November 2024
- October 2024
- September 2024
- August 2024
- July 2024
- June 2024
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- September 2018
- October 2017
- December 2011
- August 2010