Microsoft launches smallest AI model Phi-3: Redefining What’s Possible with SLMs
Technology

Microsoft launches smallest AI model Phi-3: Redefining What’s Possible with SLMs

Apr 28, 2024

Microsoft recently unveiled Phi-3, a groundbreaking series of small language models (SLMs) designed to be smaller and more efficient than traditional AI models. This is a significant development with the potential to democratize AI by making it more accessible to a wider range of users. Here’s what Phi-3 brings to the table:

Microsoft introduce Phi-3, a family of open AI models developed by Microsoft. These models redefine what’s possible with small language models (SLMs), offering unparalleled capabilities and cost-effectiveness.

A New Era in AI Models

A groundbreaking family of open AI models developed by Microsoft. These models redefine what’s possible with small language models (SLMs), offering unparalleled capabilities and cost-effectiveness. Let’s dive into the details of this exciting development.

Phi-3 Models: The Power of Small

1. Phi-3-mini: A 3.8B Language Model

  • Context-Length Variants: Phi-3-mini is available in two context-length variants—4K and 128K tokens.
  • Instruction-Tuned: Phi-3-mini is trained to follow different types of instructions, making it ready to use out-of-the-box.
  • Optimized for ONNX Runtime: It supports Windows DirectML and offers cross-platform compatibility across GPU, CPU, and even mobile hardware.
  • NVIDIA NIM Microservice: Phi-3-mini is available as an NVIDIA NIM microservice with a standard API interface that can be deployed anywhere.

2. Performance Metrics

  • Phi-3 models significantly outperform language models of the same and larger sizes on key benchmarks:
    • Massive Multitask Language Understanding (MMLU): Phi-3-mini scores an impressive 69%, showcasing its versatility across various language tasks.
    • Phi-3-mini does better than models twice its size, and Phi-3-small and Phi-3-medium outperform much larger models, including GPT-3.5T.

3. Safety-First Model Design

  • Responsible AI principles guide the development of Phi-3 models, ensuring ethical and safe usage.

Availability and Future Developments

  • Phi-3-mini is now available on Microsoft Azure AI StudioHugging Face, and Ollama.
  • Additional models, including Phi-3-small (7B) and Phi-3-medium (14B), will be added to the Phi-3 family in the coming weeks.
  • Microsoft continues to offer the best models across the quality-cost curve, and Phi-3 expands the selection of state-of-the-art small models.

Final Words

Phi-3 represents a leap forward in AI model design, combining groundbreaking performance with a compact size. As we celebrate 20 years of innovation, Phi-3 opens up new possibilities for generative AI applications. Explore Phi-3-mini on Azure AI Studio and witness the future of AI.

Leave a Reply

Your email address will not be published. Required fields are marked *