Introducing Moondream 3 Preview on fal
Moondream 3 Preview is now live on fal! The model is designed for real-world vision tasks from drones and robotics to medical imaging and retail.
In this update, Moondream got a larger context window and has become much smarter. The model can now understand more sophisticated prompts and produce longer, more intelligent answers. But it’s still just 2B active parameters – keeping it lightning fast.
Moondream 3 focuses on four pillars:
- Visual Reasoning – interprets and grounds complex real-world queries.
- Trainability – fine-tune easily for specialized vision tasks.
- Speed – near-real-time inference for live use-cases.
- Affordability – massive-scale deployments at minimal cost.
Inside the Architecture
A fine-grained 64-expert MoE (8 active per token) enables precise routing and expert specialization. With a 32K context window, it handles structured, long-form reasoning with ease. Reinforcement-learning post-training further sharpens accuracy and grounding.
Key Capabilities
Object Detection
Moondream 3 Preview goes beyond simple labels (.e.g., "car") and can understand more complex queries. We show results compared to frontier models alongside.
Pointing
It supports pointing as a native skill.
Structured output
With a longer context length, Moondream 3 generates intelligent structured outputs with minimal prompting.
OCR
The model has drastically improved its OCR abilities. Our vision encoder can get tripped up on tiny fonts (working on it), but it's now useful in many real-world cases.
Prompt:
"Convert to markdown."
Result:
| Metal | Reaction | Electrode Potential (V) |
|—|—|—|
| Gold | Au⁺ + e⁻ = Au | +1.692 |
| Silver | Ag⁺ + e⁻ = Ag | +0.7996 |
| Copper | Cu²⁺ + 2e⁻ = Cu | +0.342 |
| Iron | Fe³⁺ + 3e⁻ = Fe | -0.037 |
| Lead | Pb²⁺ + 2e⁻ = Pb | -0.126 |
| Nickel | Ni²⁺ + 2e⁻ = Ni | -0.257 |
| Cadmium | Cd²⁺ + 2e⁻ = Cd | -0.403 |
| Iron | Fe²⁺ + 2e⁻ = Fe | -0.447 |
| Zinc | Zn²⁺ + 2e⁻ = Zn | -0.762 |
| Aluminum | Al³⁺ + 3e⁻ = Al | -1.662 |
Getting Started with Moondream Preview 3
Moondream 3 Preview is now live in fal's Playground.
Test it across real-world vision tasks including:
Stay tuned to our Reddit, blog, Twitter, or Discord for the latest updates on generative media and the new model releases!