Meta Unveils Llama 4 AI Models: Enhancing Multimodal AI Processing

Meta Unveils Llama 4 AI Models: Pushing the Boundaries of Multimodal AI

Meta Platforms has introduced two new models in its Llama 4 series: Llama 4 Scout and Llama 4 Maverick. These models are designed to process and integrate various data formats, including text, video, images, and audio, enhancing their versatility in handling multimodal tasks. ​

Key Features:

• Llama 4 Scout: A compact model optimized to run on a single Nvidia H100 GPU, offering a 10-million-token context window. It outperforms competitors like Google's Gemma 3 and Mistral 3.1 across multiple benchmarks. ​

• Llama 4 Maverick: A larger model that matches the performance of OpenAI's GPT-4o and DeepSeek-V3 in coding and reasoning tasks while utilizing fewer active parameters.

Meta is also developing Llama 4 Behemoth, a model with 288 billion active parameters and a total of 2 trillion, claiming it surpasses models like GPT-4.5 and Claude Sonnet 3.7 on STEM benchmarks. 

Architectural Innovations:

The Llama 4 series employs a "mixture of experts" (MoE) architecture, optimizing resource utilization by activating specialized units for specific tasks. While marketed as open-source, the Llama 4 license imposes restrictions on commercial entities with over 700 million users, a move that has drawn criticism from the Open Source Initiative. ​

Integration and Future Plans:

These models are integrated into Meta's AI assistant across platforms such as WhatsApp, Messenger, Instagram, and the web. Further developments and insights are expected to be discussed at Meta's upcoming LlamaCon conference on April 29, 2025. ​