Aspire-8B-model_stock

by DreadPoor · built on Llama 3.1 8B Lexi Uncensored V2 · rank #31 of 135

Uncensored8BSep 2024
405downloads2likes

Benchmark scores

Uncensored IQ 35.9
Reasoning15.6
Answers6.8/10

These scores come from the public UGI (Uncensored General Intelligence) Leaderboard on Hugging Face, and were first listed here from the uncensored-ai-phone directory. Uncensored IQ is described there as a blend of knowledge and how freely a model shares it, Reasoning as problem-solving, and Answers (out of 10) as how willing the model is to respond. We do not have a separate methodology and we do not re-run the tests. Estimated speed: ~6–12 tok/s (estimate), a rough range for a Q4_K_M file of this size on a recent flagship chip (Snapdragon 8 Gen 3 or A17 Pro class). It is not a measurement from this model.

About this model

Aspire-8B-model_stock is a 8B-parameter language model by DreadPoor, derived from Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 using abliteration. You can download it and run it on your phone for free.

Aspire-8B-model_stock is a 8B model by DreadPoor of Llama 3.1 8B Lexi Uncensored V2, using abliteration. The Q4_K_M file is 4.92 GB.

Technically, it uses the llama architecture, supports a context window of 8,192 tokens (a phone will use far less).

The device-ready GGUF files were produced by mradermacher.

Which RAM sizes can run it?

Device RAMiOS-safeAndroid-safe
4 GB RAMToo bigToo big
6 GB RAMToo bigFits with Q3_K_M (~4.02 GB)
8 GB RAMFits with Q3_K_M (~4.02 GB)Fits with Q4_K_M (~4.92 GB)
12 GB RAMFits with Q4_K_M (~4.92 GB)Fits with Q4_K_M (~4.92 GB)
16 GB+ RAMFits with Q4_K_M (~4.92 GB)Fits with Q4_K_M (~4.92 GB)

iOS-safe minimum: 8 GB (using Q3_K_M). Android-safe minimum: 6 GB (using Q3_K_M). On iOS we treat about 57% of device RAM as usable (in the 55–60% range), because the system keeps a large share and may evict an app that goes higher. On Android we treat about 67% of device RAM as usable (in the 65–70% range), leaving room for the system and the app. See the guide.

Run it on your phone

Compatible apps:

iOS

  • PocketPal AI — Free on the App Store. Can search Hugging Face and load a GGUF file on the device.
  • Layla — On the App Store as a paid app. Load a custom GGUF from files on the device.

Android

  • PocketPal AI — Free on Google Play. Can search Hugging Face and load a GGUF file on the device.
  • Layla — On Google Play. Load a custom GGUF from storage. A limited free APK is also offered on the developer site.
  • ChatterUI — Free and open source. Install the APK from the GitHub releases page. iOS is not available.

Hugging Face repository ID:

mradermacher/Aspire-8B-model_stock-GGUF

Recommended file: Q4_K_M — Aspire-8B-model_stock.Q4_K_M.gguf (about 4.92 GB)

Download Q4_K_M from Hugging Face

  1. Install one of the apps above for your operating system. PocketPal AI is free on both iOS and Android and can search Hugging Face directly.
  2. In the app, add a model from Hugging Face and paste this repository ID:
    mradermacher/Aspire-8B-model_stock-GGUF
  3. Download the Q4_K_M file (Aspire-8B-model_stock.Q4_K_M.gguf) (about 4.92 GB), or Q3_K_M (about 4.02 GB) if memory is tight. Use wifi. This is the only step that needs internet.
  4. Load the file and start chatting. Switch on airplane mode if you like: it keeps working. A first prompt to try:
    I'm considering a decision this week. Give me the strongest case for it, the strongest case against it, and the one fact that would change my mind. Keep it short.

If the app is killed or feels slow, close other apps, try the smaller file, or pick a model with a lower iOS-safe or Android-safe minimum. On a computer, the same files work in LM Studio, Ollama and llama.cpp.

Available GGUF files (15)

QuantizationSizeDownload
Q2_K
Aspire-8B-model_stock.Q2_K.gguf
3.18 GBDownload
IQ3_XS
Aspire-8B-model_stock.IQ3_XS.gguf
3.52 GBDownload
Q3_K_S
Aspire-8B-model_stock.Q3_K_S.gguf
3.66 GBDownload
IQ3_S
Aspire-8B-model_stock.IQ3_S.gguf
3.68 GBDownload
IQ3_M
Aspire-8B-model_stock.IQ3_M.gguf
3.78 GBDownload
Q3_K_MSMALLER
Aspire-8B-model_stock.Q3_K_M.gguf
4.02 GBDownload
Q3_K_L
Aspire-8B-model_stock.Q3_K_L.gguf
4.32 GBDownload
IQ4_XS
Aspire-8B-model_stock.IQ4_XS.gguf
4.48 GBDownload
Q4_K_S
Aspire-8B-model_stock.Q4_K_S.gguf
4.69 GBDownload
Q4_K_MRECOMMENDED
Aspire-8B-model_stock.Q4_K_M.gguf
4.92 GBDownload
Q5_K_S
Aspire-8B-model_stock.Q5_K_S.gguf
5.60 GBDownload
Q5_K_M
Aspire-8B-model_stock.Q5_K_M.gguf
5.73 GBDownload
Q6_K
Aspire-8B-model_stock.Q6_K.gguf
6.60 GBDownload
Q8_0
Aspire-8B-model_stock.Q8_0.gguf
8.54 GBDownload
F16
Aspire-8B-model_stock.f16.gguf
16.07 GBDownload

Direct downloads from mradermacher/Aspire-8B-model_stock-GGUF on Hugging Face. Lower Q numbers are smaller and slightly less accurate.

Similar models

Copied