Skip to main content

AI models that run on this device.

Two small chat models run in a computer’s browser here; every other model is a file you download.

QuantFactory/granite-7b-instruct-GGUF file inventory

Browse hosted and upstream file records for QuantFactory/granite-7b-instruct-GGUF. Check its Run page for complete-kit status.

Hosting
hosted
Hosted files
1
Tool
any

Run status: unknown. These file records do not make a complete run kit.

  • .gitattributes
  • README.md
  • granite-7b-instruct.Q2_K.gguf - sha256 f13ec8b47022ba8aa8d3d6bee11bd9681053f13b9cccff6c012cdd792ac936a8
  • granite-7b-instruct.Q3_K_L.gguf - sha256 f0b82db6bd48d5c1225e143e91ec73fcba7854e9c86a7f53f2c3b92974f5655c
  • granite-7b-instruct.Q3_K_M.gguf - sha256 bfd0be51736aaaae83810e64a4aff611fca656a8ed85968ad649f609a9b8e686
  • granite-7b-instruct.Q3_K_S.gguf - sha256 a77470016ddd5b40d4a4351712031d56777ee132e0d10f519d3091ed8002a925
  • granite-7b-instruct.Q4_0.gguf - sha256 b435fbacde0093568930c8b12f81d924399711caf506788db5c65551db1b4748
  • granite-7b-instruct.Q4_1.gguf - sha256 b1c6a88339c88f88f67534127bf4508dedcbf6bf24348a80c22a430dbed71ca2
  • granite-7b-instruct.Q4_K_M.gguf - sha256 3108ea7a7f4dee219b071c24d3c026d3f5cf062f30b983ad27b3e55e23aa1d8e - download this file
  • granite-7b-instruct.Q4_K_S.gguf - sha256 75b370998043abe7d5e0d3c615e74b88a650e6ff7f28cae55096a8cf91275ca9
  • granite-7b-instruct.Q5_0.gguf - sha256 57bcf2c9cae1c8f396fca3dcf337dd3dd59774375878162eebf7bf85d2ffb093
  • granite-7b-instruct.Q5_1.gguf - sha256 c4a027372ebfba625b7702a63c91f09502af9c04c47e0efc11e3ccd8fc3ad592
  • granite-7b-instruct.Q5_K_M.gguf - sha256 4a88a5adc4fa541181f045416d94bbe916cfac9677c15391b1f86199b5bfd38b
  • granite-7b-instruct.Q5_K_S.gguf - sha256 de2517c6bd428ff7a93071dc3a96e81caf9aff24ccca4c3170a2fd5f1517fb54
  • granite-7b-instruct.Q6_K.gguf - sha256 f647823375e79be896f1baa58a9c669d729af6849a4d145aa6512ae2b1757d8b
  • granite-7b-instruct.Q8_0.gguf - sha256 0aa071352cd40e198bbb0d9d03eb25d7f891fef68208deaa208e2445cd1da3cd

Local kit JSON Trust bundle JSON

Open interactive local kit