跳转到主要内容

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

bartowski

DeepSeek-Coder-V2-Lite-Instruct-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Model details
text generationLicense: deepseek-license (custom terms)SHA-256 recorded for 24 of 26 filesGGUF

Content controls: not assessed.

The catalog lists this model for having conversations. Catalog sources: tags, task, cardMetadata.pipelineTag.

1 hosted of 26 listed

Hashes recorded. Date not recorded.

File大小SHA-256来源下载
Weights
DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf Default10.4 GB
603bd3f8…57ef0bb8603bd3f8a0281d16571da7c08bd661ee17ff0d1be6fcbd1b42242da257ef0bb8
Hosted下载
DeepSeek-Coder-V2-Lite-Instruct-IQ2_M.gguf6.33 GB
c09685b4…6c3b78bfc09685b4ee1480320382a2aedb9bed19c4af5033ec466f7ff9ce5d596c3b78bf
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-IQ2_S.gguf6.01 GB
1c5a5efd…dd0774bc1c5a5efd2adad07c1161918668554640af31db7e8adbfc0e55ee63aedd0774bc
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-IQ2_XS.gguf5.97 GB
13106ce4…234b46d313106ce47dee9380b03ff27e88c87076604a01c85fea9fab191f827c234b46d3
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-IQ3_M.gguf7.55 GB
08db9312…bf2d91d108db93121a9e6fa3cb4978c4b4e9c37e9407160ceec77f0894c45f43bf2d91d1
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-IQ3_XS.gguf7.12 GB
f459cedf…c7c8188ef459cedf6b8f9186414aa817cbc85ba1d8b81465073855744efbf52fc7c8188e
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-IQ3_XXS.gguf6.96 GB
d3fd8f7c…83cc5c9fd3fd8f7ca9c97f3e424dac63c5c719226e9811f567081e92d747288b83cc5c9f
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-IQ4_XS.gguf8.57 GB
ac0a9967…c4e0706cac0a996714d4e8ed06b4398096bae88a32c349ceab42ffe629c2ddf4c4e0706c
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q2_K.gguf6.43 GB
5e2ac4b3…4879b5d35e2ac4b3477aa11ff460739ec326040ad07a3fc1c42da8e15b0465054879b5d3
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q3_K_L.gguf8.46 GB
be5fd70b…5a07c62cbe5fd70b1ffe99d0fb2d511250d9d02a08b894b04cb5bb2c2c8113ff5a07c62c
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q3_K_M.gguf8.13 GB
30f78fce…e078a2a130f78fce33d19c4bf68c410cd6504d424346dfbe846b4d3df5558e0be078a2a1
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q3_K_S.gguf7.49 GB
508e1ead…08ea89f5508e1ead6515d50a68d3d0f1e0d7f0c29f3ca351404703266793af6708ea89f5
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q4_K_L.gguf10.9 GB
ce11aa91…0cf13ea1ce11aa91f0f0daa9add3ee1c5496a5097a32793f0541b130e9910eba0cf13ea1
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q4_K_S.gguf9.53 GB
2a0c965b…c7b762d22a0c965bf42e1ef3bca38d7503c3a071bec3d9ba46128146a074ff3fc7b762d2
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q5_K_L.gguf12.4 GB
1f8706d2…d189c23a1f8706d261cd44e50219ef0c669e18d4b88adeac2917fc8dcf887472d189c23a
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q5_K_M.gguf11.9 GB
3de21719…e0a4a7353de21719a8ffb4f6acc4b636d4ca38d882e0d0aa9a5d417106f985e0e0a4a735
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q5_K_S.gguf11.1 GB
fe9b55d8…a728dcf8fe9b55d85300769825f0d9d69ce4d259ad0438ab42222d48ee3fdf99a728dcf8
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q6_K.gguf14.1 GB
1ff79f43…b7b864cd1ff79f43ad5728d3179bf8fa7ee2993652f4306d6aeca9c35055f4f5b7b864cd
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q6_K_L.gguf14.6 GB
9d924493…3bd444719d9244931cd48f36764e7c0707c100603e7d4c95cd588d7b18e01db13bd44471
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q8_0.gguf16.7 GB
af12f49d…3bf796fbaf12f49d16dc54f2148af3f6dc3ee5de9461e8586a1d13e279b7e7623bf796fb
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-Q8_0_L.gguf17.1 GB
c41b0dbf…360d773ec41b0dbf1599296ba76343b942c39691a96a20ff382dad8cfc674889360d773e
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-f32.gguf/DeepSeek-Coder-V2-Lite-Instruct-f32-00001-of-00002.gguf39.4 GB
84094402…365a2d6684094402373964af422045f01639f9bdb4180387ecc12db406f3feb6365a2d66
Upstream onlyFile metadata
DeepSeek-Coder-V2-Lite-Instruct-f32.gguf/DeepSeek-Coder-V2-Lite-Instruct-f32-00002-of-00002.gguf23.4 GB
a3325357…75393c92a3325357f0edf29bf67f8f687f578f0e280fd6bda04a710144e64da075393c92
Upstream onlyFile metadata
Tokenizer & config
DeepSeek-Coder-V2-Lite-Instruct.imatrix38.4 MB
711e1da6…71567e4b711e1da645c17a11f7221e8ced8c0b2bc2554a5ab9745a331653adc771567e4b
Upstream onlyFile metadata
Docs
.gitattributes3.61 KB—Upstream onlyFile metadata
README.md9.12 KB—Upstream onlyFile metadata

检查下载文件

In the folder where you saved DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf'
Linux
sha256sum -- 'DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.