Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

QuantFactory

Genstruct-7B-GGUF

QuantFactory/Genstruct-7B-GGUF
generalLicense: apache-2.0Hashes recordedGGUF

Content controls: not assessed.

Model from Hugging Face for llm: QuantFactory/Genstruct-7B-GGUF · transformers

1 hosted of 16 listed

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
Genstruct-7B.Q4_K_M.gguf Default4.37 GB
1bdbcbb3…b98d27861bdbcbb3f96992e3953a7606790227231f3726a833f3373102e4ed56b98d2786
HostedDownload
Genstruct-7B.Q2_K.gguf2.72 GB
fa4c5046…4ed8a7dbfa4c5046ca5074cc317e1de5d024ea7469bca8646f45aef7e45ebf604ed8a7db
Upstream onlyFile metadata
Genstruct-7B.Q3_K_L.gguf3.82 GB
fa65cf29…6c389498fa65cf29578f644a5d8311f3a99af2d5269783556d5fb61d230bbf4b6c389498
Upstream onlyFile metadata
Genstruct-7B.Q3_K_M.gguf3.52 GB
a8ee2e35…a0023700a8ee2e356c36ca876caca1ae8073d66897977752e4e2d124beb08ecba0023700
Upstream onlyFile metadata
Genstruct-7B.Q3_K_S.gguf3.16 GB
c702d1a6…d6b1b30cc702d1a6c3fde148ca2dfe2e6e6f276611a9bddb098799822f44be31d6b1b30c
Upstream onlyFile metadata
Genstruct-7B.Q4_0.gguf4.11 GB
7956c871…96c6e9cb7956c871c91110ee5e0a3c1f3a3fa2e944c44aa61720e2320c46424a96c6e9cb
Upstream onlyFile metadata
Genstruct-7B.Q4_1.gguf4.55 GB
afecdea8…86f1a6fbafecdea8b347a50021ee046ef2e299fa2e05ab23899c531a4784877786f1a6fb
Upstream onlyFile metadata
Genstruct-7B.Q4_K_S.gguf4.14 GB
0876e1a3…64c0c4400876e1a33b1431b193726b686defef835ee7f71ba673a60f092fa2f764c0c440
Upstream onlyFile metadata
Genstruct-7B.Q5_0.gguf5 GB
dfff3e35…159844ecdfff3e35c908ad0efbd97b3791a5b6c0bd9aca47d67ca166f35a48b4159844ec
Upstream onlyFile metadata
Genstruct-7B.Q5_1.gguf5.44 GB
11f8d92c…1c3b1c8f11f8d92cbfe67bdabf503dd88c1dcd79b7a8591e6714b31a588e41b51c3b1c8f
Upstream onlyFile metadata
Genstruct-7B.Q5_K_M.gguf5.13 GB
6649422b…8e300c576649422b1f2054921118d7617f362e473c24a4676778ecc53527124e8e300c57
Upstream onlyFile metadata
Genstruct-7B.Q5_K_S.gguf5 GB
081af4dc…bb5039c6081af4dcff81c23475669e009cdabe5bab8a941840f27a9a50370b0cbb5039c6
Upstream onlyFile metadata
Genstruct-7B.Q6_K.gguf5.94 GB
60a00723…ece509a960a00723834e58e59401bf1ffffa464ff17803d3fc2d7a30f7ebf52dece509a9
Upstream onlyFile metadata
Genstruct-7B.Q8_0.gguf7.7 GB
1f395cb2…93540e9b1f395cb2c96dec80e34936baad9d1a55c10981dffa1031b90961ad5393540e9b
Upstream onlyFile metadata
Docs
.gitattributes2.36 KB—Upstream onlyFile metadata
README.md10.4 KB—Upstream onlyFile metadata

Check a download

In the folder where you saved Genstruct-7B.Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'Genstruct-7B.Q4_K_M.gguf'
Linux
sha256sum -- 'Genstruct-7B.Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'Genstruct-7B.Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.