Bright

Bright / Starter Shelf

Write and summarize: NVIDIA PC, 16 GB dedicated VRAM

An editorial starting choice with exact setup and explicit evidence limits.

Start here / Editorial starting option

Qwen3.5 4B Q4_K_M

Documentation checked 2026-10-12 · Hardware estimated, not tested

NVIDIA PC, 16 GB dedicated VRAM; separately, at least 32 GB system RAM. Supported x64 OS, processor, CUDA GPU and driver required.

Start at 4096 tokens, one chat. Available memory and runtime memory are not established.

Exact LM Studio searchlmstudio-community/Qwen3.5-4B-GGUF

3.383 GB selected files · Model + matching projector · Source

Apache-2.0: use under its terms. Maker and license

Download size is not runtime memory or proof of compatibility. Speed and available memory are unknown.

Open runtime documentation
Select text to copy manually

Why this starting choice: Qwen3.5 4B is the shared writing starting option because its exact local package and task documentation support one short exercise across these reviewed profiles. A larger download is not a reason to promote another model.

Check this setup scope first.

Reviewed Windows x64 app path, or Ubuntu 20.04+ x64 AppImage. Vendor says Ubuntu versions newer than 22 are not well tested. Exact Windows minimum for this artifact is not established.

x64 CPU with AVX2; integrated-only graphics excluded

NVIDIA GPU and driver compatible with the selected LM Studio CUDA runtime. Exact minimum driver for these artifacts is not established; verify the current engine and actual GPU before loading.

Backend: cuda. Starter context: 4096 tokens; one chat at a time. This is an editorial starting setting, not a measured limit.

  • This is the reviewed setup scope, not hardware detected from your browser and not a promise that the model loads or performs well.
  • Confirm installed and currently available memory separately; use one chat at a time and start with the stated context.
  • At least 32 GB system RAM is an explicit Bright review criterion, separately from 16 GB dedicated VRAM. It does not establish available memory or fit.
  • Record app and runtime/backend versions. Use current stable compatible runtime; historical version examples are not oldest-supported-version guarantees.

The app and engine versions are documented. Support for these exact file hashes is inferred from documented model support and the later engine, not directly tested. LM Studio 0.4.6 documents a Qwen3.5 document-chat template fix, and a maintainer confirms model support in llama.cpp engine 2.5.1. Individual loading problems were also reported. These older examples do not establish the oldest compatible version for this exact file pair.

The exact package.

Publisher: lmstudio-community. Pinned revision: f9f88ac3e234be915e23811a6d28ea287bdb927e. App and model licenses are separate.

Qwen3.5-4B-Q4_K_M.gguf / language model

2,707,513,696 transfer bytes.

SHA-256: 25082a7dd3776cc3c741c6347d3bd04523f05796607b3fbc32fa3a25dfa1418c

Pinned file evidence · Exact artifact download
mmproj-Qwen3.5-4B-BF16.gguf / projector

675,568,768 transfer bytes.

SHA-256: ae08d9d7eceb8f2d0672d61b5e6aa78b611f2942b55ed71d21414980cc454b91

Pinned file evidence · Exact artifact download

Ollama and LM Studio packages may contain different quantizations, projectors or draft models. Their byte amounts are not interchangeable.

Set it up.

  1. Check your machine conditions

    Read the separate OS, processor, backend, system RAM and dedicated VRAM conditions shown in this answer. Installed memory is not available memory. Apple Silicon uses unified memory; never add system RAM and VRAM to establish compatibility.

  2. Install and update LM Studio

    Install the current stable desktop app and update its compatible llama.cpp runtime. The source-check example is LM Studio 0.4.26 Build 4; Build 2 documents runtime 2.50.0. These are documented examples, not exact-artifact success guarantees. Use GGUF with the matching Metal or CUDA backend in your conditions; this answer does not provide an MLX path.

  3. Select the exact reviewed files

    In Discover, search the exact publisher and repository shown above. Match every selected filename and reviewed revision, including any required projector. Do not choose a similarly named curated package. If the listing cannot establish that revision, use the linked pinned files and documented import route, or stop for verification.

  4. Load one model with a short context

    Open Chat and its model loader, then select the downloaded model. Set context to 4096 tokens and use one request at a time. These are Bright editorial starting settings, not maker maxima or measured fit. My Models' settings or the pre-load configuration can set context. Keep the metadata chat template; current GGUF template settings are under Load Parameters > Advanced, but the exact current graphical labels have not been inspected.

  5. Keep Qwen3.5 reasoning settings model-specific

    Do not copy Qwen3 /think or /nothink switches. Qwen3.5 documents the enable_thinking chat-template setting. Keep the supplied metadata template and use an app-supported reasoning control only if available and understood. The exact desktop control and behavior are untested.

  6. Try the fictional task and verify the answer

    Use the exercise below. Compare every claimed fact or quotation with the original input. Stop if loading or extraction fails, memory pressure or swap becomes high, the system becomes unresponsive, or output repeats. Shorten input or choose a smaller reviewed option rather than forcing a fit.

  7. Keep the local-only conditions visible

    After the model files and runtime are installed, local model and document chat are documented to work offline. Search, downloads and updates use the network. Select the installed local model and avoid remote providers, LM Link, cloud services, external tools and plugins for this path. Their behavior is outside this offline claim.

  8. Estimated and untested

    Download bytes do not establish runtime memory or compatibility. Peak memory, speed and exact hardware execution remain untested. Historical application and runtime support examples are not blanket guarantees for these artifacts.

Try this, then check it.

Fictional practice note: The Maple Street club's picnic is Saturday at noon in Riverside Park. Bring your own lunch. If it rains, meet in the community hall. RSVP to the organizer by Thursday. Rewrite this as a friendly invitation of at most 80 words. Then list the four practical facts you preserved. Do not invent an address, contact detail or activity. Compare the day and time, location, rain plan and RSVP deadline with the input. Check the invitation length and remove invented details before using it. Stop or revise the prompt if facts disappear, extra facts appear or output repeats.

No model output is presented as a Bright test result. Stop on failed loading, sustained memory pressure, severe swapping or invented answers; verify the source and settings rather than assuming the file proves compatibility.

Other documented options to inspect

Gemma 4 12B IT Q4_K_M

Optional separately documented dense Gemma alternative on the reviewed higher-memory scope; LM Studio uses a non-draft file pair. No better-quality or speed claim.

Reviewed Windows x64 app path, or Ubuntu 20.04+ x64 AppImage. Vendor says Ubuntu versions newer than 22 are not well tested. Exact Windows minimum for this artifact is not established. · 4096-token editorial starting context.

Exact checkpoint and terms

Sources and unknowns.

  • Documentation-checked and estimated. Bright has not loaded these models or tested these computer configurations. Runtime memory, speed and output quality are unknown.
  • Download bytes are transfer size, not runtime memory. Available memory differs from installed memory. Context, app/runtime, projector, other applications and load settings affect use.
  • System RAM and dedicated VRAM are separate resources. Do not add them or infer compatibility from their sum.
  • Exact oldest compatible version of these pinned artifacts is not established. Current version mapping and historical family support are documentary evidence, not a hardware test.
  • Discover may select newer files. Compare publisher, filenames and recorded revision before treating a changed package as this reviewed option.
  • Start with 4096 tokens for this exercise. The model supports longer contexts, but longer conversations use more memory. This starting setting is not a tested memory limit or the model’s maximum context.

Runtime memory: not measured. Speed: not measured. No hardware test receipt exists for these documentation-led answers.

Keep this answer and its evidence.

Landscape share image · Vertical share image · This answer as JSON · Method and revision history

Local AI updates in Bright Weekly.

The existing weekly newsletter includes Bright’s editorial updates. It does not provide personalized alerts for this answer.