{"id":"nvidia-24gb-write-ollama","machineId":"nvidia-24gb","machine":{"id":"nvidia-24gb","label":"NVIDIA PC, 24 GB dedicated VRAM","platform":"nvidia","unifiedMemoryGB":null,"dedicatedVramGB":24,"minimumSystemRamGB":32},"job":"write","jobLabel":"Write and summarize","runtime":"ollama","status":"starting-option","canonicalPath":"/run/nvidia-24gb/write","canonicalUrl":"https://brightaifuture.com/run/nvidia-24gb/write?runtime=ollama","indexable":false,"candidateId":"qwen35_4b_q4","candidate":{"id":"qwen35_4b_q4","name":"Qwen3.5 4B Q4_K_M","makerCheckpoint":"Qwen/Qwen3.5-4B","makerModelCardUrl":"https://huggingface.co/Qwen/Qwen3.5-4B","license":"Apache-2.0","licenseSourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_artifact"],"taskSourceIds":["qwen35_4b_q4_maker"],"jobs":["write","files","image"],"starterContextTokens":4096,"contextProvenance":"Start with 4096 tokens for this exercise. The model supports longer contexts, but longer conversations use more memory. This starting setting is not a tested memory limit or the model’s maximum context.","selectionReason":"Small current multimodal option with a precise community GGUF pair and explicit local Ollama tag.","runtimeEvidence":[{"id":"qwen35_4b_q4_lm-studio_metal","runtime":"lm-studio","exactIdentifier":"lmstudio-community/Qwen3.5-4B-GGUF","publisher":"lmstudio-community","revision":"f9f88ac3e234be915e23811a6d28ea287bdb927e","files":[{"name":"Qwen3.5-4B-Q4_K_M.gguf","role":"language-model","bytes":2707513696,"sha256":"25082a7dd3776cc3c741c6347d3bd04523f05796607b3fbc32fa3a25dfa1418c","listingUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/blob/f9f88ac3e234be915e23811a6d28ea287bdb927e/Qwen3.5-4B-Q4_K_M.gguf","downloadUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/resolve/f9f88ac3e234be915e23811a6d28ea287bdb927e/Qwen3.5-4B-Q4_K_M.gguf"},{"name":"mmproj-Qwen3.5-4B-BF16.gguf","role":"projector","bytes":675568768,"sha256":"ae08d9d7eceb8f2d0672d61b5e6aa78b611f2942b55ed71d21414980cc454b91","listingUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/blob/f9f88ac3e234be915e23811a6d28ea287bdb927e/mmproj-Qwen3.5-4B-BF16.gguf","downloadUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/resolve/f9f88ac3e234be915e23811a6d28ea287bdb927e/mmproj-Qwen3.5-4B-BF16.gguf"}],"transferBytes":3383082464,"listedTransferSize":null,"listedManifestShortId":null,"immutablePin":true,"backend":"metal","appVersion":"0.4.26 Build 2 or later","engineVersion":"llama.cpp 2.50.0 (upstream b11337)","versionExplanation":"The app and engine versions are documented. Support for these exact file hashes is inferred from documented model support and the later engine, not directly tested. LM Studio 0.4.6 documents a Qwen3.5 document-chat template fix, and a maintainer confirms model support in llama.cpp engine 2.5.1. Individual loading problems were also reported. These older examples do not establish the oldest compatible version for this exact file pair.","licenseSourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_artifact"],"taskSourceIds":["qwen35_4b_q4_maker"],"compatibilitySourceIds":["lm_system","lm_runtime","lm_current_runtime","lm_qwen","lm_qwen_rag_fix","lm_qwen_engine_statement"],"evidenceState":"documentation-checked","hardwareTestReceipt":null,"eligibility":"reviewed","limitations":["Exact oldest compatible version of these pinned artifacts is not established. Current version mapping and historical family support are documentary evidence, not a hardware test.","Discover may select newer files. Compare publisher, filenames and recorded revision before treating a changed package as this reviewed option."]},{"id":"qwen35_4b_q4_ollama_metal","runtime":"ollama","exactIdentifier":"qwen3.5:4b-q4_K_M","publisher":"Ollama registry","revision":null,"files":[],"transferBytes":null,"listedTransferSize":"3.3GB","listedManifestShortId":"d8b0f5e9760c","immutablePin":false,"backend":"metal","appVersion":null,"engineVersion":null,"versionExplanation":"Official release adds small Qwen3.5 sizes including 4B, fixes GGUF import and mixed CPU/GPU crashes. This establishes family/format support, not compatibility of later tag digests with this old version.","licenseSourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_ollama"],"taskSourceIds":["qwen35_4b_q4_maker","qwen35_4b_q4_ollama"],"compatibilitySourceIds":["ollama_gpu","ollama_macos","ollama_windows","ollama_context","ollama_qwen_release"],"evidenceState":"documentation-checked","hardwareTestReceipt":null,"eligibility":"reviewed","limitations":["Tags can change. Recorded Ollama package is a separate build; not asserted identical to LM Studio GGUF. Never substitute a -cloud tag.","Short manifest IDs and mutable tags are not immutable artifact pins. LM Studio file hashes and sizes do not establish this package’s bytes or memory."]},{"id":"qwen35_4b_q4_lm-studio_cuda","runtime":"lm-studio","exactIdentifier":"lmstudio-community/Qwen3.5-4B-GGUF","publisher":"lmstudio-community","revision":"f9f88ac3e234be915e23811a6d28ea287bdb927e","files":[{"name":"Qwen3.5-4B-Q4_K_M.gguf","role":"language-model","bytes":2707513696,"sha256":"25082a7dd3776cc3c741c6347d3bd04523f05796607b3fbc32fa3a25dfa1418c","listingUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/blob/f9f88ac3e234be915e23811a6d28ea287bdb927e/Qwen3.5-4B-Q4_K_M.gguf","downloadUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/resolve/f9f88ac3e234be915e23811a6d28ea287bdb927e/Qwen3.5-4B-Q4_K_M.gguf"},{"name":"mmproj-Qwen3.5-4B-BF16.gguf","role":"projector","bytes":675568768,"sha256":"ae08d9d7eceb8f2d0672d61b5e6aa78b611f2942b55ed71d21414980cc454b91","listingUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/blob/f9f88ac3e234be915e23811a6d28ea287bdb927e/mmproj-Qwen3.5-4B-BF16.gguf","downloadUrl":"https://huggingface.co/lmstudio-community/Qwen3.5-4B-GGUF/resolve/f9f88ac3e234be915e23811a6d28ea287bdb927e/mmproj-Qwen3.5-4B-BF16.gguf"}],"transferBytes":3383082464,"listedTransferSize":null,"listedManifestShortId":null,"immutablePin":true,"backend":"cuda","appVersion":"0.4.26 Build 2 or later","engineVersion":"llama.cpp 2.50.0 (upstream b11337)","versionExplanation":"The app and engine versions are documented. Support for these exact file hashes is inferred from documented model support and the later engine, not directly tested. LM Studio 0.4.6 documents a Qwen3.5 document-chat template fix, and a maintainer confirms model support in llama.cpp engine 2.5.1. Individual loading problems were also reported. These older examples do not establish the oldest compatible version for this exact file pair.","licenseSourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_artifact"],"taskSourceIds":["qwen35_4b_q4_maker"],"compatibilitySourceIds":["lm_system","lm_runtime","lm_current_runtime","lm_qwen","lm_qwen_rag_fix","lm_qwen_engine_statement"],"evidenceState":"documentation-checked","hardwareTestReceipt":null,"eligibility":"reviewed","limitations":["Exact oldest compatible version of these pinned artifacts is not established. Current version mapping and historical family support are documentary evidence, not a hardware test.","Discover may select newer files. Compare publisher, filenames and recorded revision before treating a changed package as this reviewed option."]},{"id":"qwen35_4b_q4_ollama_cuda","runtime":"ollama","exactIdentifier":"qwen3.5:4b-q4_K_M","publisher":"Ollama registry","revision":null,"files":[],"transferBytes":null,"listedTransferSize":"3.3GB","listedManifestShortId":"d8b0f5e9760c","immutablePin":false,"backend":"cuda","appVersion":null,"engineVersion":null,"versionExplanation":"Official release adds small Qwen3.5 sizes including 4B, fixes GGUF import and mixed CPU/GPU crashes. This establishes family/format support, not compatibility of later tag digests with this old version.","licenseSourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_ollama"],"taskSourceIds":["qwen35_4b_q4_maker","qwen35_4b_q4_ollama"],"compatibilitySourceIds":["ollama_gpu","ollama_macos","ollama_windows","ollama_context","ollama_qwen_release"],"evidenceState":"documentation-checked","hardwareTestReceipt":null,"eligibility":"reviewed","limitations":["Tags can change. Recorded Ollama package is a separate build; not asserted identical to LM Studio GGUF. Never substitute a -cloud tag.","Short manifest IDs and mutable tags are not immutable artifact pins. LM Studio file hashes and sizes do not establish this package’s bytes or memory."]}],"checkedAt":"2026-10-12"},"runtimeEvidenceId":"qwen35_4b_q4_ollama_cuda","runtimeEvidence":{"id":"qwen35_4b_q4_ollama_cuda","runtime":"ollama","exactIdentifier":"qwen3.5:4b-q4_K_M","publisher":"Ollama registry","revision":null,"files":[],"transferBytes":null,"listedTransferSize":"3.3GB","listedManifestShortId":"d8b0f5e9760c","immutablePin":false,"backend":"cuda","appVersion":null,"engineVersion":null,"versionExplanation":"Official release adds small Qwen3.5 sizes including 4B, fixes GGUF import and mixed CPU/GPU crashes. This establishes family/format support, not compatibility of later tag digests with this old version.","licenseSourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_ollama"],"taskSourceIds":["qwen35_4b_q4_maker","qwen35_4b_q4_ollama"],"compatibilitySourceIds":["ollama_gpu","ollama_macos","ollama_windows","ollama_context","ollama_qwen_release"],"evidenceState":"documentation-checked","hardwareTestReceipt":null,"eligibility":"reviewed","limitations":["Tags can change. Recorded Ollama package is a separate build; not asserted identical to LM Studio GGUF. Never substitute a -cloud tag.","Short manifest IDs and mutable tags are not immutable artifact pins. LM Studio file hashes and sizes do not establish this package’s bytes or memory."]},"editorialReason":"Qwen3.5 4B is the shared writing starting option because its exact local package and task documentation support one short exercise across these reviewed profiles. A larger download is not a reason to promote another model.","conditions":{"platform":"nvidia","unifiedMemoryGB":null,"dedicatedVramGB":24,"systemRamGB":32,"operatingSystem":"Windows or Linux x64 with supported NVIDIA GPU and current compatible Ollama. Exact OS minimum for this artifact is not established.","processor":"x64 CPU supported by the current Ollama distribution; confirm actual hardware support","backend":"cuda","driver":"NVIDIA compute capability 5.0+ with driver 550+; capabilities 5.0 through 6.2 require driver 570+. Check the actual GPU against official support.","starterContextTokens":4096,"concurrency":1,"qualification":["This is the reviewed setup scope, not hardware detected from your browser and not a promise that the model loads or performs well.","Confirm installed and currently available memory separately; use one chat at a time and start with the stated context.","At least 32 GB system RAM is an explicit Bright review criterion, separately from 24 GB dedicated VRAM. It does not establish available memory or fit.","Record app and runtime/backend versions. Use current stable compatible runtime; historical version examples are not oldest-supported-version guarantees."]},"evidenceState":"documentation-checked","hardwareAssessment":"estimated","runtimeMemoryBytes":null,"speedTokensPerSecond":null,"sourceIds":["apache","qwen35_4b_q4_maker","qwen35_4b_q4_artifact","qwen35_4b_q4_ollama","ollama_gpu","ollama_macos","ollama_windows","ollama_context","ollama_qwen_release"],"sources":[{"id":"apache","title":"Apache License 2.0 terms","url":"https://www.apache.org/licenses/LICENSE-2.0","checkedAt":"2026-10-12"},{"id":"qwen35_4b_q4_maker","title":"Qwen3.5 4B Q4_K_M: maker checkpoint and license","url":"https://huggingface.co/Qwen/Qwen3.5-4B","checkedAt":"2026-10-12"},{"id":"qwen35_4b_q4_artifact","title":"Qwen3.5 4B Q4_K_M: exact GGUF publisher metadata","url":"https://huggingface.co/api/models/lmstudio-community/Qwen3.5-4B-GGUF/revision/f9f88ac3e234be915e23811a6d28ea287bdb927e?blobs=true","checkedAt":"2026-10-12"},{"id":"qwen35_4b_q4_ollama","title":"Qwen3.5 4B Q4_K_M: separately documented Ollama package","url":"https://ollama.com/library/qwen3.5:4b-q4_K_M","checkedAt":"2026-10-12"},{"id":"ollama_gpu","title":"Ollama GPU and driver support","url":"https://docs.ollama.com/gpu","checkedAt":"2026-10-12"},{"id":"ollama_macos","title":"Ollama on macOS","url":"https://docs.ollama.com/macos","checkedAt":"2026-10-12"},{"id":"ollama_windows","title":"Ollama on Windows","url":"https://docs.ollama.com/windows","checkedAt":"2026-10-12"},{"id":"ollama_context","title":"Ollama context length and memory use","url":"https://docs.ollama.com/context-length","checkedAt":"2026-10-12"},{"id":"ollama_qwen_release","title":"Ollama 0.17.5: small Qwen3.5 and GGUF support","url":"https://github.com/ollama/ollama/releases/tag/v0.17.5","checkedAt":"2026-10-12"}],"sourceUrls":["https://www.apache.org/licenses/LICENSE-2.0","https://huggingface.co/Qwen/Qwen3.5-4B","https://huggingface.co/api/models/lmstudio-community/Qwen3.5-4B-GGUF/revision/f9f88ac3e234be915e23811a6d28ea287bdb927e?blobs=true","https://ollama.com/library/qwen3.5:4b-q4_K_M","https://docs.ollama.com/gpu","https://docs.ollama.com/macos","https://docs.ollama.com/windows","https://docs.ollama.com/context-length","https://github.com/ollama/ollama/releases/tag/v0.17.5"],"reviewedAt":"2026-10-12","changedAt":"2026-10-12","publishedAt":"2026-10-12","revision":"2026-10-12-r1","history":[{"revision":"2026-10-12-r1","date":"2026-10-12","reason":"Initial documentation-led editorial starting selections. No hands-on hardware tests."}],"setup":[{"title":"Check the separate Ollama conditions","text":"Use only the exact local Ollama identifier shown in this answer and its reviewed backend conditions. Ollama packages are separate from LM Studio files. Do not substitute a cloud tag, draft package or different quantization.","sourceIds":["ollama_gpu","ollama_macos","ollama_windows"]},{"title":"Start with a short local task","text":"Use the selected local model with 4096 tokens of context and one request at a time. This is an editorial starting setting, not measured memory fit. Follow the linked Ollama package documentation and supported runtime controls using the exact identifier above. Bright has not verified the current graphical controls or image attachment workflow.","sourceIds":["ollama_context"]},{"title":"Check the result yourself","text":"Use the fictional exercise below and compare the answer with the input. Stop if loading fails, the system becomes unresponsive or the answer invents facts. Successful preparation is not proof of successful execution.","sourceIds":["ollama_context"]},{"title":"Estimated and untested","text":"Download bytes do not establish runtime memory or compatibility. Peak memory, speed and exact hardware execution remain untested. Historical application and runtime support examples are not blanket guarantees for these artifacts.","sourceIds":["ollama_context"]}],"copyText":"Write and summarize: Qwen3.5 4B Q4_K_M\nNVIDIA PC, 24 GB dedicated VRAM\nRuntime: qwen3.5:4b-q4_K_M\nStarter context: 4096 tokens; one chat\nDocumentation checked 2026-10-12; estimated and untested\nhttps://brightaifuture.com/run/nvidia-24gb/write?runtime=ollama","exercise":"Fictional practice note: The Maple Street club's picnic is Saturday at noon in Riverside Park. Bring your own lunch. If it rains, meet in the community hall. RSVP to the organizer by Thursday. Rewrite this as a friendly invitation of at most 80 words. Then list the four practical facts you preserved. Do not invent an address, contact detail or activity.\nCompare the day and time, location, rain plan and RSVP deadline with the input.\nCheck the invitation length and remove invented details before using it.\nStop or revise the prompt if facts disappear, extra facts appear or output repeats.","alternatives":[],"limitations":["Documentation-checked and estimated. Bright has not loaded these models or tested these computer configurations. Runtime memory, speed and output quality are unknown.","Download bytes are transfer size, not runtime memory. Available memory differs from installed memory. Context, app/runtime, projector, other applications and load settings affect use.","System RAM and dedicated VRAM are separate resources. Do not add them or infer compatibility from their sum.","Tags can change. Recorded Ollama package is a separate build; not asserted identical to LM Studio GGUF. Never substitute a -cloud tag.","Short manifest IDs and mutable tags are not immutable artifact pins. LM Studio file hashes and sizes do not establish this package’s bytes or memory.","Start with 4096 tokens for this exercise. The model supports longer contexts, but longer conversations use more memory. This starting setting is not a tested memory limit or the model’s maximum context."]}