Bright

Bright / Starter Shelf

Ask about an image: NVIDIA PC, 16 GB dedicated VRAM

An editorial starting choice with exact setup and explicit evidence limits.

Start here / Editorial starting option

Qwen3.5 4B Q4_K_M

Documentation checked 2026-10-12 · Hardware estimated, not tested

NVIDIA PC, 16 GB dedicated VRAM; separately, at least 32 GB system RAM. Supported x64 OS, processor, CUDA GPU and driver required.

Start at 4096 tokens, one chat. Available memory and runtime memory are not established.

Exact local Ollama identifierqwen3.5:4b-q4_K_M

3.3GB · Runtime-specific package · Source

Apache-2.0: use under its terms. Maker and license

Download size is not runtime memory or proof of compatibility. Speed and available memory are unknown.

Open runtime documentation
Select text to copy manually

Why this starting choice: Qwen3.5 4B has a separately documented local Ollama vision package. Use the exact recorded tag in a current compatible Ollama runtime and check visible details. This mutable package is not the pinned LM Studio GGUF pair.

Check this setup scope first.

Windows or Linux x64 with supported NVIDIA GPU and current compatible Ollama. Exact OS minimum for this artifact is not established.

x64 CPU supported by the current Ollama distribution; confirm actual hardware support

NVIDIA compute capability 5.0+ with driver 550+; capabilities 5.0 through 6.2 require driver 570+. Check the actual GPU against official support.

Backend: cuda. Starter context: 4096 tokens; one chat at a time. This is an editorial starting setting, not a measured limit.

  • This is the reviewed setup scope, not hardware detected from your browser and not a promise that the model loads or performs well.
  • Confirm installed and currently available memory separately; use one chat at a time and start with the stated context.
  • At least 32 GB system RAM is an explicit Bright review criterion, separately from 16 GB dedicated VRAM. It does not establish available memory or fit.
  • Record app and runtime/backend versions. Use current stable compatible runtime; historical version examples are not oldest-supported-version guarantees.

Official release adds small Qwen3.5 sizes including 4B, fixes GGUF import and mixed CPU/GPU crashes. This establishes family/format support, not compatibility of later tag digests with this old version.

The exact package.

Publisher: Ollama registry. The registry tag is mutable; no full immutable manifest was established. App and model licenses are separate.

Ollama and LM Studio packages may contain different quantizations, projectors or draft models. Their byte amounts are not interchangeable.

Set it up.

  1. Check the separate Ollama conditions

    Use only the exact local Ollama identifier shown in this answer and its reviewed backend conditions. Ollama packages are separate from LM Studio files. Do not substitute a cloud tag, draft package or different quantization.

  2. Start with a short local task

    Use the selected local model with 4096 tokens of context and one request at a time. This is an editorial starting setting, not measured memory fit. Follow the linked Ollama package documentation and supported runtime controls using the exact identifier above. Bright has not verified the current graphical controls or image attachment workflow.

  3. Check the result yourself

    Use the fictional exercise below and compare the answer with the input. Stop if loading fails, the system becomes unresponsive or the answer invents facts. Successful preparation is not proof of successful execution.

  4. Estimated and untested

    Download bytes do not establish runtime memory or compatibility. Peak memory, speed and exact hardware execution remain untested. Historical application and runtime support examples are not blanket guarantees for these artifacts.

  5. Image answers need verification

    An exact model and matching projector are required. Current app association and image controls are untested. Compare descriptions with the image; do not use this starter task for medical, identity or safety decisions.

Try this, then check it.

Describe the two visible shapes and their colors. Separate what you can see from anything uncertain. Do not guess a purpose or add objects. Make your own picture of a red square beside a blue circle and attach it before asking. Compare every assertion with the actual picture. Confidence does not establish accuracy. Do not use this exercise for medical interpretation, identity or safety decisions.

No model output is presented as a Bright test result. Stop on failed loading, sustained memory pressure, severe swapping or invented answers; verify the source and settings rather than assuming the file proves compatibility.

Sources and unknowns.

  • Documentation-checked and estimated. Bright has not loaded these models or tested these computer configurations. Runtime memory, speed and output quality are unknown.
  • Download bytes are transfer size, not runtime memory. Available memory differs from installed memory. Context, app/runtime, projector, other applications and load settings affect use.
  • System RAM and dedicated VRAM are separate resources. Do not add them or infer compatibility from their sum.
  • Tags can change. Recorded Ollama package is a separate build; not asserted identical to LM Studio GGUF. Never substitute a -cloud tag.
  • Short manifest IDs and mutable tags are not immutable artifact pins. LM Studio file hashes and sizes do not establish this package’s bytes or memory.
  • Start with 4096 tokens for this exercise. The model supports longer contexts, but longer conversations use more memory. This starting setting is not a tested memory limit or the model’s maximum context.
  • Use the separately documented Ollama vision package. No user-managed GGUF projector is specified for this path. Image replies may invent details; this exercise does not establish medical or safety interpretation.

Runtime memory: not measured. Speed: not measured. No hardware test receipt exists for these documentation-led answers.

Keep this answer and its evidence.

Landscape share image · Vertical share image · This answer as JSON · Method and revision history

Local AI updates in Bright Weekly.

The existing weekly newsletter includes Bright’s editorial updates. It does not provide personalized alerts for this answer.