Tech News
← Home  ·  All topics

Multimodal Model

3 GoKawiil briefs on this topic

Mistral Launches Open-Preview of 1-Trillion-Parameter Multimodal Model

Mistral has announced a public preview of its latest large-scale AI model, ML4, also called 'le Chonk'. The model features 49 billion active parameters and demonstrates high performance across coding, multimodal understanding, and enterprise tasks such as cybersecurity, finance, and law. The weights will be released at the end of the month, with ongoing real-world testing involving cybersecurity experts and authorities.

Mistral Unveils Large 4 Multimodal Model with 49B Parameters

Mistral has announced the Large 4, a multimodal AI model that combines extensive language and vision capabilities. It includes 49 billion active parameters and a vision encoder with 1.6 billion parameters, built on a Mixture-of-Experts architecture. The model is designed for broad, general-purpose applications.

Bonsai 2 27B compresses a 27B model to 5.9GB with 98.2% performance retained

A new ternary-quantized model, Ternary Bonsai 2 27B, has been released, built on Qwen3.8 27B and using {-1,0,+1} weights with FP16 group scaling to shrink the model to about 1.76 effective bits per weight and a 5.9GB footprint. Despite being over 9x smaller than its full-precision counterpart, it retains 98.2% of aggregate benchmark performance across reasoning, coding, vision and agentic tasks, and supports a 262K-token context window under an Apache 2.0 license.