mradermacher

falcon-40b-instruct-i1-GGUF

Chat
Chat & writeGGUF

Download availability is being checked.

Hashes recorded. Date not recorded.

FileSizeSHA-256SourceDownload
Weights
falcon-40b-instruct.i1-Q4_K_M.gguf26 GB
1688d12f…ccdcd30b1688d12f52aec32ce4fea3d4e5d348dc4ef509ae42a14f625ccb4255ccdcd30b
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ1_M.gguf10 GB
394c2e54…eca0ff47394c2e54f20cf2aaaa87bd2fe06db58e8570e99ea5fbde1e8c5ded58eca0ff47
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ1_S.gguf9.71 GB
4bdb9f79…493697134bdb9f797c9f2c07da761744c079add8faf48281254fffb89bb3fd3749369713
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ2_M.gguf15 GB
ab03d739…7ff3e688ab03d739b842c2874c0371b9b2f80fdd5a0bc9fe4ff70f7b429ba0cd7ff3e688
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ2_S.gguf13.9 GB
696ead62…dfb8f5db696ead626d6d9eac282cfd46574f01d347b91ac67e2e4558077c04addfb8f5db
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ2_XS.gguf13.1 GB
084171b2…7d0c18fa084171b2a420d991716bdfec786e022249966bf037706a320057afde7d0c18fa
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ2_XXS.gguf11.9 GB
98902630…64049cea98902630f5a36d7b930066200f73c3e555f0034e6ca044aa5fa7b0bb64049cea
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ3_M.gguf19.7 GB
5ee1844f…ec464c0d5ee1844fd405358895c424620efe914829e7c92c55ba5e82b5f32a38ec464c0d
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ3_S.gguf18.8 GB
d9111b3f…6b8a4fa4d9111b3f9d5f05e7cefd8b8136118721b993947559ab13b42edefb406b8a4fa4
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ3_XS.gguf18.3 GB
10935bb1…e97165e210935bb1793b0ce0b2c3a2c421fc0380bb1090b862854358ec130283e97165e2
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ3_XXS.gguf16.9 GB
f18cb9b3…78b82600f18cb9b31289e4d2206cc16d41954a4895e218444ed3bcdcb6c2fddc78b82600
Download availability is being checked.File metadata
falcon-40b-instruct.i1-IQ4_XS.gguf22.5 GB
d1506b94…a915901dd1506b94ee42410bc965feca334562d2a6625d7df2517f98697d676ba915901d
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q2_K.gguf16.3 GB
1478c8af…76e7cb391478c8afff7cf30214f53b49be7aa3dc386b618cab399f23a6d296d076e7cb39
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q3_K_L.gguf22.1 GB
0310d75e…b6d3a6e40310d75ead7a1cb04fd42210c373794e139d14d2fb5ea2c431a1a2b7b6d3a6e4
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q3_K_M.gguf20.6 GB
41770316…4377a9f24177031605f653b0a626317335dbc44178e51cdcb51d1e49ca69515d4377a9f2
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q3_K_S.gguf18.8 GB
bfe37413…54acbb5bbfe37413a57308dcdb096c273207f31e5d2832ec9a32cf02dba1cb5254acbb5b
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q4_0.gguf23.9 GB
f79b4587…2c55e093f79b45874e7459c26a1ac76907ae4e8556ccfac80e8d8c8d8772bf5e2c55e093
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q4_K_S.gguf24.3 GB
86c33ec0…82b501fd86c33ec0e2cbf5df39ee8ba346c19e9a8b8c23e2b93a75f9c38754a782b501fd
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q5_K_M.gguf31.1 GB
23692d95…4c7c924323692d950ad59a977b24f3d3d017d93bee9b3b166d0db24d2abf0b124c7c9243
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q5_K_S.gguf29.5 GB
3a1b1c87…a0e2dd573a1b1c8773c1ad470950574ba8c76f41eae1493d77b615e074f787d1a0e2dd57
Download availability is being checked.File metadata
falcon-40b-instruct.i1-Q6_K.gguf35 GB
b9132a21…e23a00a9b9132a2108b82793b07943edb02195422acc8233732ed0769f52e941e23a00a9
Download availability is being checked.File metadata
Tokenizer & config
imatrix.dat13.8 MB
1bacb649…f4185f1b1bacb649013c6e1c825608d81f1b4bf3434ef1f6860908fe89276ffaf4185f1b
Download availability is being checked.File metadata
Docs
.gitattributes3.05 KB-Download availability is being checked.File metadata
README.md4.72 KB-Download availability is being checked.File metadata

Check a download

In the folder where you saved falcon-40b-instruct.i1-Q4_K_M.gguf, run:

macOS
shasum -a 256 -- 'falcon-40b-instruct.i1-Q4_K_M.gguf'
Linux
sha256sum -- 'falcon-40b-instruct.i1-Q4_K_M.gguf'
Windows
Get-FileHash -LiteralPath 'falcon-40b-instruct.i1-Q4_K_M.gguf' -Algorithm SHA256

Compare the result with the recorded SHA-256.

Additional model information
Quick answer: compatibility and sources

Can I run falcon-40b-instruct-i1-GGUF on my computer?

It depends on your memory, processor, file format and runtime. A download is not confirmed by the current file evidence; inspect the file record before trying it. A file-size fit is an estimate, not a successful run or speed promise. Read the license before use.

falcon-40b-instruct-i1-GGUF is an open-weights language model for text generation. Model weights are learned parameters; a runtime loads them. A hosted file is an individual file Hugging Bay can serve. SHA-256 identifies exact file bytes. The availability date above applies to this file record, not the upstream metadata update date.

As of the recorded file availability check on .

Recorded SHA-256 for falcon-40b-instruct.i1-Q4_K_M.gguf: 1688d12f52aec32ce4fea3d4e5d348dc4ef509ae42a14f625ccb4255ccdcd30b. Exact file evidence · Machine-readable source facts · Run evidence and any recorded receipts. A checksum fingerprints only the named file bytes; it does not prove safety, quality, a complete multi-file selection or a successful run.

Page text updated .

Model metadata: As of at the model source. Popularity counters are source-reported, not measured by Hugging Bay. Availability checked .

Key facts

Catalog record
Summarizes upstream metadata; it is not itself a download or run receipt.
File evidence
Lists exact filenames, availability and any recorded SHA-256 for individual files.
Run evidence
Reports measured results only when a receipt exists for named file bytes and a setup; otherwise unmeasured.
Checksum scope
SHA-256 fingerprints one file’s bytes; it does not prove safety, quality or a multi-file bundle.

Evidence you can inspect (plain text)

  • This page’s quick answer names the file record for hf-model-mradermacher-falcon-40b-instruct-i1-gguf.
  • Open /artifact/hf-model-mradermacher-falcon-40b-instruct-i1-gguf/files for exact filenames, availability and any recorded SHA-256 for this model.
  • Open /evidence/artifacts/hf-model-mradermacher-falcon-40b-instruct-i1-gguf for run-readiness evidence tied to that record; absent receipts stay unmeasured.
  • Open /api/artifacts/hf-model-mradermacher-falcon-40b-instruct-i1-gguf/card.md for machine-readable source facts (not a runtime test).
  • A matching checksum on this page fingerprints only the named bytes shown in file evidence.

Unmeasured states are stated explicitly; this page does not invent run scores or compatibility guarantees.

Which date applies to which fact

  • File availability check:
  • Committed page-copy sources:
  • Upstream model metadata: Dates on artifact records when shown; not implied by page-copy revision
  • Run receipts: Only on /evidence pages when recorded; otherwise unmeasured

Page-copy revision (Updated line above) identifies committed text sources, not upstream model edits or test outcomes.