How to run an AI model on your own computer
Built from LM Studio’s and the model makers’ documentation, checked 11 October 2026. Bright has not tested this on its own hardware.
Primary sources ↓ · Limitations ↓
SHORT ANSWER
Start here.
This documentation-led walkthrough uses desktop LM Studio on Mac or Windows and the documented candidate SmolLM3-3B in GGUF Q4_K_M format. The converted file is listed at 1.92 GB; that is a download size, not its runtime memory requirement or proof that it works on your computer.
- Bright publication
- Source review
- Reading question
- How can I try a downloaded text model, check its reply and remove it afterwards?
1. Check your computer
On Mac, LM Studio documents Apple Silicon M1/M2/M3/M4 and macOS 14 or newer. Intel Macs are unsupported. The app maker suggests 16 GB or more RAM, while noting smaller models and modest context sizes may be usable on 8 GB Macs. On Windows, it documents x64 with AVX2, or ARM on Snapdragon X Elite; it suggests at least 16 GB RAM and 4 GB dedicated GPU memory. These are app-level requirements and suggestions, not verification of this model.
Check your chip, operating system and installed RAM in the computer’s system information. Installed memory differs from memory currently available after the operating system and other apps use some. Keep system RAM and dedicated GPU memory separate. Apple unified memory is one shared pool. Context length, runtime, format and load settings change memory use. Bright does not know this candidate’s speed, runtime memory or output quality on your machine.
Sources: LM Studio: System Requirements · LM Studio: Get started
2. Install desktop LM Studio
Open the official download page and choose the installer for your operating system and processor under “Download LM Studio”. The page also offers Bionic and the headless llmster daemon; this guide follows the desktop chat app. Follow the installer’s instructions and open LM Studio. Record the app version you installed so you can identify it if something changes.
Sources: Download LM Studio · LM Studio: Get started
3. Find the exact model
Open Discover and search for ggml-org/SmolLM3-3B-GGUF, or paste its Hugging Face repository URL. LM Studio documents both search methods. Confirm the publisher is ggml-org and the filename is SmolLM3-Q4_K_M.gguf. This is a quantized conversion of HuggingFaceTB/SmolLM3-3B, not the original full-precision checkpoint. GGUF is the file format; Q4_K_M identifies this quantization.
Sources: LM Studio: Download an LLM · ggml-org: SmolLM3-3B-GGUF files · HuggingFaceTB: SmolLM3-3B model card
4. Download the Q4_K_M file
Select that exact file’s download option. The checked repository lists it at 1.92 GB and identifies Apache 2.0 licensing, also stated by the original model card. Read the linked license before reuse. Allow disk space for the file, the app and any needed runtime. A completed download tells you that you have the artifact; loading and generating are separate steps.
Sources: ggml-org: SmolLM3-3B-GGUF files · HuggingFaceTB: SmolLM3-3B model card · LM Studio: Download an LLM · LM Studio: Offline Operation
5. Load it and send a first prompt
In Chat, open the model loader and select the downloaded SmolLM3 model. Review the load settings, including context length, then load it. Start a new chat and ask: “Rewrite this sentence more clearly: We moved the meeting to Sunday at one.” If loading fails, keep the error and app version rather than interpreting the file size as a compatibility test.
Sources: LM Studio: Get started · LM Studio: Manage chats
6. Check a reply with the picnic exercise
Try Bright’s fictional exercise: “Write a short message to the picnic group using only these fictional notes. Preserve the changed day, time and place. Include who brings what. Flag undecided items rather than inventing a plan. Notes: The picnic moved from Saturday to Sunday. It starts at 1 p.m. at River Park. Lee brings fruit. Sam brings sandwiches. The rain plan is undecided.”
Check the reply against five facts: Sunday; 1 p.m.; River Park; Lee brings fruit and Sam brings sandwiches; rain remains undecided. Mark any omission or invented detail. The exercise is a reader check, not a benchmark or a Bright test result. The maker cautions that generated content can be inaccurate or inconsistent; verify important information yourself.
Sources: LM Studio: Manage chats · HuggingFaceTB: SmolLM3-3B model card
7. Try the downloaded model offline
Finish the model and required runtime downloads first. Then disconnect your network and send another fictional prompt in the local Chat tab. LM Studio documents local chatting without internet connectivity. Model search, new downloads, runtime downloads and update checks need connectivity. Keep this exercise in local chat without connected tools; external integrations have their own data paths. This is a check you can perform, not an offline or privacy test Bright has performed.
Sources: LM Studio: Offline Operation
8. Remove the model to reclaim disk space
Open My Models and identify the exact SmolLM3-Q4_K_M.gguf download. The official download documentation points to My Models for the models directory, and the import documentation describes publisher/model/file folders. The official pages checked here do not establish the current delete-button wording. If your version offers a removal action, read its confirmation carefully.
Alternatively, quit the app and use Finder on Mac or File Explorer on Windows to open the models directory shown by your installation. Remove only the identified GGUF file using your operating system’s normal file deletion. Reclaiming space may require emptying the Trash or Recycle Bin. This file-removal step is Bright’s practical inference from the documented directory structure, not a documented LM Studio button sequence. Deleting the weights does not delete your saved chats.
Sources: LM Studio: Download an LLM · LM Studio: Import Models · LM Studio: Manage chats
What this guide does not establish
- This guide is documentation-led and untested by Bright on Mac or Windows. It reports no hands-on benchmark, generated model reply or measured compatibility.
- Documentation and interface labels may change. Recheck this guide when LM Studio changes major version or its requirements change.
- The worked example is a documented candidate. The listed file size does not establish total runtime memory, supported context length, speed or quality.
- Model licensing, conversion provenance and app terms are separate. Apache 2.0 for the model does not license the LM Studio app or third-party documentation.
Primary sources
LM Studio: System Requirements ↗
Official platform, processor, operating system and memory guidance. Checked 2026-10-11.
Download LM Studio ↗
Official installers. Desktop LM Studio is distinct from Bionic and llmster. Checked 2026-10-11.
LM Studio: Get started ↗
Official install, model loading and Chat workflow. Checked 2026-10-11.
LM Studio: Download an LLM ↗
Official Discover search, quantization and My Models directory guidance. Checked 2026-10-11.
LM Studio: Manage chats ↗
Official new-chat controls and separate conversation-file storage. Checked 2026-10-11.
LM Studio: Offline Operation ↗
Official distinction between local functions and downloads or update checks. Checked 2026-10-11.
LM Studio: Import Models ↗
Official models directory structure. This page does not document a current GUI deletion sequence. Checked 2026-10-11.
ggml-org: SmolLM3-3B-GGUF files ↗
Conversion repository listing SmolLM3-Q4_K_M.gguf at 1.92 GB and Apache 2.0 licensing. Checked 2026-10-11.
HuggingFaceTB: SmolLM3-3B model card ↗
Model maker’s original card, local inference options, Apache 2.0 license and accuracy limitations. Checked 2026-10-11.
Source-reviewed 2026-10-11. Source review means Bright compared this explanation with the linked records; it is not independent replication or expert peer review by Bright.
