Ministral-3-3B-Instruct-2512
by unsloth · built on Ministral 3 3B Base 2512 · Official #24 of 32 by downloads
Benchmark scores
Official models are not scored on the UGI Leaderboard. We show downloads and likes instead. Estimated speed: ~12–22 tok/s (estimate), a rough range for a Q4_K_M file of this size on a recent flagship chip (Snapdragon 8 Gen 3 or A17 Pro class). It is not a measurement from this model.
About this model
Ministral-3-3B-Instruct-2512 is a 3B-parameter language model by unsloth, derived from mistralai/Ministral-3-3B-Base-2512 using official GGUF conversion. You can download it and run it on your phone for free.
An official 3B vision model based on Ministral 3 3B Base 2512, made to understand images as well as text. The Q4_K_M file is 2.15 GB. It accepts images, so it can read a screenshot of a chart or document.
Technically, it uses the mistral3 architecture, supports a context window of 262,144 tokens (a phone will use far less).
Which RAM sizes can run it?
| Device RAM | iOS-safe | Android-safe |
|---|---|---|
| 4 GB RAM | Fits with Q4_K_M (~2.15 GB) | Fits with Q4_K_M (~2.15 GB) |
| 6 GB RAM | Fits with Q4_K_M (~2.15 GB) | Fits with Q4_K_M (~2.15 GB) |
| 8 GB RAM | Fits with Q4_K_M (~2.15 GB) | Fits with Q4_K_M (~2.15 GB) |
| 12 GB RAM | Fits with Q4_K_M (~2.15 GB) | Fits with Q4_K_M (~2.15 GB) |
| 16 GB+ RAM | Fits with Q4_K_M (~2.15 GB) | Fits with Q4_K_M (~2.15 GB) |
iOS-safe minimum: 4 GB. Android-safe minimum: 4 GB. On iOS we treat about 57% of device RAM as usable (in the 55–60% range), because the system keeps a large share and may evict an app that goes higher. On Android we treat about 67% of device RAM as usable (in the 65–70% range), leaving room for the system and the app. See the guide.
Run it on your phone
Compatible apps:
iOS
- PocketPal AI — Free on the App Store. Can search Hugging Face and load a GGUF file on the device.
- Layla — On the App Store as a paid app. Load a custom GGUF from files on the device.
Android
- PocketPal AI — Free on Google Play. Can search Hugging Face and load a GGUF file on the device.
- Layla — On Google Play. Load a custom GGUF from storage. A limited free APK is also offered on the developer site.
- ChatterUI — Free and open source. Install the APK from the GitHub releases page. iOS is not available.
Hugging Face repository ID:
unsloth/Ministral-3-3B-Instruct-2512-GGUFRecommended file: Q4_K_M — Ministral-3-3B-Instruct-2512-Q4_K_M.gguf (about 2.15 GB)
- Install one of the apps above for your operating system. PocketPal AI is free on both iOS and Android and can search Hugging Face directly.
- In the app, add a model from Hugging Face and paste this repository ID:
unsloth/Ministral-3-3B-Instruct-2512-GGUF - Download the Q4_K_M file (
Ministral-3-3B-Instruct-2512-Q4_K_M.gguf) (about 2.15 GB), or Q3_K_M (about 1.8 GB) if memory is tight. Use wifi. This is the only step that needs internet. - Load the file and start chatting. Switch on airplane mode if you like: it keeps working. A first prompt to try:
I'm considering a decision this week. Give me the strongest case for it, the strongest case against it, and the one fact that would change my mind. Keep it short.
If the app is killed or feels slow, close other apps, try the smaller file, or pick a model with a lower iOS-safe or Android-safe minimum. On a computer, the same files work in LM Studio, Ollama and llama.cpp.
Available GGUF files (26)
| Quantization | Size | Download |
|---|---|---|
| IQ1_S Ministral-3-3B-Instruct-2512-UD-IQ1_S.gguf | 969 MB | Download |
| IQ1_M Ministral-3-3B-Instruct-2512-UD-IQ1_M.gguf | 1.02 GB | Download |
| IQ2_XXS Ministral-3-3B-Instruct-2512-UD-IQ2_XXS.gguf | 1.11 GB | Download |
| IQ2_M Ministral-3-3B-Instruct-2512-UD-IQ2_M.gguf | 1.34 GB | Download |
| IQ3_XXS Ministral-3-3B-Instruct-2512-UD-IQ3_XXS.gguf | 1.46 GB | Download |
| Q2_K Ministral-3-3B-Instruct-2512-Q2_K.gguf | 1.46 GB | Download |
| Q2_K_L Ministral-3-3B-Instruct-2512-Q2_K_L.gguf | 1.46 GB | Download |
| Q2_K Ministral-3-3B-Instruct-2512-UD-Q2_K_XL.gguf | 1.49 GB | Download |
| Q3_K_S Ministral-3-3B-Instruct-2512-Q3_K_S.gguf | 1.64 GB | Download |
| Q3_K_MSMALLER Ministral-3-3B-Instruct-2512-Q3_K_M.gguf | 1.80 GB | Download |
| Q3_K Ministral-3-3B-Instruct-2512-UD-Q3_K_XL.gguf | 1.86 GB | Download |
| IQ4_XS Ministral-3-3B-Instruct-2512-IQ4_XS.gguf | 1.96 GB | Download |
| Q4_0 Ministral-3-3B-Instruct-2512-Q4_0.gguf | 2.05 GB | Download |
| IQ4_NL Ministral-3-3B-Instruct-2512-IQ4_NL.gguf | 2.05 GB | Download |
| Q4_K_S Ministral-3-3B-Instruct-2512-Q4_K_S.gguf | 2.05 GB | Download |
| Q4_K_MRECOMMENDED Ministral-3-3B-Instruct-2512-Q4_K_M.gguf | 2.15 GB | Download |
| Q4_K Ministral-3-3B-Instruct-2512-UD-Q4_K_XL.gguf | 2.19 GB | Download |
| Q4_1 Ministral-3-3B-Instruct-2512-Q4_1.gguf | 2.23 GB | Download |
| Q5_K_S Ministral-3-3B-Instruct-2512-Q5_K_S.gguf | 2.42 GB | Download |
| Q5_K_M Ministral-3-3B-Instruct-2512-Q5_K_M.gguf | 2.47 GB | Download |
| Q5_K Ministral-3-3B-Instruct-2512-UD-Q5_K_XL.gguf | 2.48 GB | Download |
| Q6_K Ministral-3-3B-Instruct-2512-Q6_K.gguf | 2.82 GB | Download |
| Q6_K Ministral-3-3B-Instruct-2512-UD-Q6_K_XL.gguf | 3.17 GB | Download |
| Q8_0 Ministral-3-3B-Instruct-2512-Q8_0.gguf | 3.65 GB | Download |
| Q8_K Ministral-3-3B-Instruct-2512-UD-Q8_K_XL.gguf | 4.50 GB | Download |
| BF16 Ministral-3-3B-Instruct-2512-BF16.gguf | 6.87 GB | Download |
| Vision projector mmproj-F16.gguf | 840 MB | Download |
| Vision projector mmproj-BF16.gguf | 842 MB | Download |
| Vision projector mmproj-F32.gguf | 1.68 GB | Download |
Direct downloads from unsloth/Ministral-3-3B-Instruct-2512-GGUF on Hugging Face. Lower Q numbers are smaller and slightly less accurate. Vision needs the projector (mmproj) file alongside the model.