Microsoft’s lightweight Phi-3 Mini model can run on smartphones
Microsoft has unveiled its latest light AI model called the Phi-3 Mini designed to run on smartphones and other local devices, it revealed in a new research paper. Trained on 3.8 billion parameters, it’s the first of three small Phi-3 language models the company will release in the near future. The aim is to provide a cheaper alternative to cloud-powered LLMs, allowing smaller organizations to adopt AI.
According to Microsoft, the new model handily outperforms its previous Phi-2 small model and is on par with larger models like Llama 2. In fact, the company says Phi-3 Mini provides responses close to the level of a model 10 times its size.
“The innovation lies entirely in our dataset for training,” according to the research paper. That dataset is based on the Phi-2 model, but uses “heavily filtered web data and synthetic data,” the team states. In fact, a separate LLM was used to do both of those chores, effectively creating new data that allows the smaller language model to be more efficient. The team was supposedly inspired by children’s books that use simpler language to get across complex topics, according to The Verge.
While it still can’t produce the results of cloud-powered LLMs, Phi-3 Mini can outperform Phi-2 and other small language models (Mistral, Gemma, Llama-3-In) in tasks ranging from math to programming to academic tests. At the same time, it runs on devices as simple as smartphones, with no internet connection required.
Its main limitation is breadth of “factual knowledge” due to the smaller dataset size — hence why it doesn’t perform well in the “TriviaQA” test. Still, it should be good for models like that only require smallish internal data sets. That could allow companies that can’t afford cloud-connected LLMs to jump into AI, Microsoft hopes.
Phi-3 Mini is now available on Azure, Hugging Face and Ollama. Microsoft is next set to release Phi-3 Small and Phi-3 Medium with significantly higher capabilities (7 billion and 14 billion parameters, respectively).
This article originally appeared on Engadget at https://www.engadget.com/microsofts-lightweight-phi-3-mini-model-can-run-on-smartphones-100223483.html?src=rss
Microsoft has unveiled its latest light AI model called the Phi-3 Mini designed to run on smartphones and other local devices, it revealed in a new research paper. Trained on 3.8 billion parameters, it’s the first of three small Phi-3 language models the company will release in the near future.…
Recent Posts
- Prime Video movie of the day: Road House is an action-packed remake of the ’80s cult classic
- CBP is interrogating TikTok employees
- The European Union is investigating Meta’s election policies
- Assassin’s Creed Mirage trust falls onto the iPhone this June
- Netflix movie of the day: Baby Driver is an incredible action movie with a stunning soundtrack and 92% on Rotten Tomatoes
Archives
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- December 2011