unsloth

Llama-3.1-8B-Instruct-GGUF

Chat
What we checked

File: check availability in Files.

Memory: Fit unknown. File size needed to check fit.

Last recorded run: none for this selected file.

License BFiles CRuns F

Recorded checks do not guarantee safety or performance on your computer.

See file checks and sources
Chat & writeGGUFLicense label: llama3.1

Download availability is being checked.

Hashes recorded. Date not recorded.

FileTamanhoSHA-256OrigemBaixar
Weights
Llama-3.1-8B-Instruct-Q4_K_M.gguf4.92 GB
b3bdbf23…aacdc506b3bdbf23b47d7e6bb791c99b206deb169cd5a96362a9e3399028df2faacdc506
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-BF16.gguf16.1 GB
00bea1d0…71e34a6300bea1d086a0bffd8a37e0730124036739d27ac05c455933beb5714771e34a63
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-IQ4_NL.gguf4.68 GB
c76ecbe2…cf0b96d1c76ecbe29adfdb074fc04abf582cd53463c62d6b5f21a36f045616b2cf0b96d1
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-IQ4_XS.gguf4.46 GB
0bfbfeac…d194913f0bfbfeac3e1e589193da037e682ffb76730a30e787278d30a846bddcd194913f
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q2_K.gguf3.18 GB
f2e27796…a49ae17af2e27796f3f8268cc7e79806e69298d29a31104b6428f806e55d9c14a49ae17a
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q2_K_L.gguf3.3 GB
327717f8…9987fe7a327717f89ea7210c87ebedab3eb35ae3b1181fbe9bd4cb5bb31832609987fe7a
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q3_K_M.gguf4.02 GB
71daf406…56c500fd71daf40611ec04009c25d81764dc242abcc2d991c801a60f58c19ad856c500fd
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q3_K_S.gguf3.66 GB
b38d222d…c56374c1b38d222dee6a0df52f3a0dbea33cd6993005ff0b74255147053473ecc56374c1
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q4_0.gguf4.68 GB
88e2c600…47ab0eaa88e2c6002459f892d77c7e5e219868ef08a57c4e92354c7271aaf64f47ab0eaa
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q4_1.gguf5.13 GB
50ebdab3…c8e889a050ebdab3bc5a529daf03b6755ac480042519eb2c3b14b2c4e9901665c8e889a0
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q4_K_S.gguf4.69 GB
7cd71fbe…855cfecb7cd71fbe98af3c5bac978c7b8f8639080cbfada96ef12b6205029208855cfecb
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q5_K_M.gguf5.73 GB
bc945542…a21df949bc945542131dc588ba0b896701311add406a229104125f7ee2786d95a21df949
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q5_K_S.gguf5.6 GB
48b6031f…5a2d0e2748b6031f4760ede34f930305dd57c69e02a90e5d682f4f930a9fc5af5a2d0e27
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-Q6_K.gguf6.6 GB
61feef66…0eb9ae4161feef661e081cbe00f1c8cc0d5565d0884c651491a908bdc1124f580eb9ae41
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-IQ1_M.gguf2.29 GB
d8c907b7…66bb12e2d8c907b73676d40c9e65dad4d6d33f12834ed6ddacab9974c64179c866bb12e2
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-IQ1_S.gguf2.16 GB
9221fc4e…abdb9d429221fc4ea1cec0fd8903833990fdab0d3cf3c8f2ebefb57bc42da76eabdb9d42
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-IQ2_M.gguf3 GB
aac0d1ae…082deed2aac0d1aedd31a6ed2c3d4f5811c4a6a1e0b3715bcd400360809a3bf9082deed2
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-IQ2_XXS.gguf2.5 GB
4379835c…36a3d25e4379835c6b78dae3f61c881ce7f7f8bc2a846108c30571f8aeb6441536a3d25e
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-IQ3_XXS.gguf3.32 GB
41b7486a…3ae2d1f841b7486ae04cd483b26a4f0a8f460efac49bd5b2d1d8164980a262613ae2d1f8
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-Q2_K_XL.gguf3.39 GB
3918c4c8…66b335c13918c4c8d42d9391d78a8aa63bbbd4647926f5bbf907d16aedd6bc0266b335c1
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-Q3_K_XL.gguf4.2 GB
38cbb27f…89aec60938cbb27fbc7a49bccf8becf72b9fd7a1476a316bbb85d82783b49b9a89aec609
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-Q4_K_XL.gguf4.99 GB
5685babd…22fac2e15685babde6e53e95764f4f56ec0a0bbde574c1b4987b6170ee346bdf22fac2e1
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-Q5_K_XL.gguf5.74 GB
526557bb…a2297faa526557bb0fea410882e526542a706539649d200c776404f8f7e69087a2297faa
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-Q6_K_XL.gguf7.33 GB
54217d8e…d8303a8754217d8e02c46ce8ca13cda2ccbcefc0a4d6165ac9f61aa580f54044d8303a87
Download availability is being checked.File metadata
Llama-3.1-8B-Instruct-UD-Q8_K_XL.gguf10.6 GB
956fe7ae…176f6768956fe7ae28b1f406e6418d82e57b7de9710f6a719eb402f9b13a58e0176f6768
Download availability is being checked.File metadata
Tokenizer & config
config.json896 bytes-Download availability is being checked.File metadata
imatrix_unsloth.dat4.99 MB
0bc85986…67e8ff410bc85986c1933b103032eef21f13dc5b28ee919a149ef79547fd968d67e8ff41
Download availability is being checked.File metadata
Docs
.gitattributes3.35 KB-Download availability is being checked.File metadata
README.md33.3 KB-Download availability is being checked.File metadata

Verificar um download

In the folder where you saved Llama-3.1-8B-Instruct-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'Llama-3.1-8B-Instruct-Q4_K_M.gguf'
Linux
sha256sum -- 'Llama-3.1-8B-Instruct-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'Llama-3.1-8B-Instruct-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.

Additional model information
Quick answer: compatibility and sources

Can I run Llama-3.1-8B-Instruct-GGUF on my computer?

It depends on your memory, processor, file format and runtime. A download is not confirmed by the current file evidence; inspect the file record before trying it. A file-size fit is an estimate, not a successful run or speed promise. Read the license before use.

Llama-3.1-8B-Instruct-GGUF is an open-weights language model for text generation. Model weights are learned parameters; a runtime loads them. A hosted file is an individual file Hugging Bay can serve. SHA-256 identifies exact file bytes. The availability date above applies to this file record, not the upstream metadata update date.

As of the recorded file availability check on .

Recorded SHA-256 for Llama-3.1-8B-Instruct-Q4_K_M.gguf: b3bdbf23b47d7e6bb791c99b206deb169cd5a96362a9e3399028df2faacdc506. Exact file evidence · Machine-readable source facts · Run evidence and any recorded receipts. A checksum fingerprints only the named file bytes; it does not prove safety, quality, a complete multi-file selection or a successful run.

Page text updated .

Model metadata: As of at the model source. Popularity counters are source-reported, not measured by Hugging Bay. Availability checked .

Key facts

Catalog record
Summarizes upstream metadata; it is not itself a download or run receipt.
File evidence
Lists exact filenames, availability and any recorded SHA-256 for individual files.
Run evidence
Reports measured results only when a receipt exists for named file bytes and a setup; otherwise unmeasured.
Checksum scope
SHA-256 fingerprints one file’s bytes; it does not prove safety, quality or a multi-file bundle.

Evidence you can inspect (plain text)

  • This page’s quick answer names the file record for hf-model-unsloth-llama-3-1-8b-instruct-gguf.
  • Open /artifact/hf-model-unsloth-llama-3-1-8b-instruct-gguf/files for exact filenames, availability and any recorded SHA-256 for this model.
  • Open /evidence/artifacts/hf-model-unsloth-llama-3-1-8b-instruct-gguf for run-readiness evidence tied to that record; absent receipts stay unmeasured.
  • Open /api/artifacts/hf-model-unsloth-llama-3-1-8b-instruct-gguf/card.md for machine-readable source facts (not a runtime test).
  • A matching checksum on this page fingerprints only the named bytes shown in file evidence.

Unmeasured states are stated explicitly; this page does not invent run scores or compatibility guarantees.

Which date applies to which fact

  • File availability check:
  • Committed page-copy sources:
  • Upstream model metadata: Dates on artifact records when shown; not implied by page-copy revision
  • Run receipts: Only on /evidence pages when recorded; otherwise unmeasured

Page-copy revision (Updated line above) identifies committed text sources, not upstream model edits or test outcomes.