Hugging Face · #498

unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF

unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF is a GGUF text-generation model you can run locally. Run locally: llama-cli -hf unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF or ollama run hf.co/unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF. 141 Hugging Face likes (#498 in this directory).

Model
https://huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF
Author
unsloth
Likes
141
Hub trending
#32 on this snapshot
Downloads (30 days)
71,929
Task
text-generation
Library
—
License
openmdw-1.1
Gated
No
Created
2026-10-23
Last modified
2026-10-24
Base models
nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16
Snapshot
2026-10-29

Run it locally.

Shadowfetch Linux is a Debian testing desktop with KDE Plasma, local AI tools, and ShadowCode. ShadowCode's bundled llama.cpp runs GGUF models; you can also use llama.cpp or Ollama from the terminal.

llama.cpp

llama-cli -hf unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF

Ollama

ollama run hf.co/unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF

llama-cli -hf is Hugging Face's documented llama.cpp path for a Hub GGUF repo. ollama run hf.co/... is the documented Ollama path. Neither command invents a quant filename; the tool picks a file the repo actually publishes.

ShadowCode prompt.

Paste this into ShadowCode after you open Settings › Local models.

In Settings › Local models, add unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF from Hugging Face as a GGUF on this computer. Ask before downloading. Use the repo's published GGUF files; do not guess a quant filename.

Download Shadowfetch Linux — ISO, checksum and signature.

Back to Hugging Face models · Methodology