Phi-3.5-mini-instruct-GGUF GGUF download | Hugging Bay

Phi-3.5-mini-instruct-GGUF

Try browser chat with a small demo model (a separate model; device support is checked before loading).

QuantFactory/Phi-3.5-mini-instruct-GGUF

Model details

text generationLicense: mitSHA-256 recorded for 14 of 16 filesGGUF

Content controls: not assessed.

The catalog lists this model for working with code. Catalog sources: license, cardMetadata.license, tags, task, cardMetadata.pipelineTag.

View as JSON →

Your next step

Use it from code

This Python snippet downloads the selected file. Running the model needs its own library and setup.

from urllib.request import urlretrieve

urlretrieve(
    "https://huggingbay.xyz/api/downloads/hf-model-quantfactory-phi-3-5-mini-instruct-gguf/Phi-3.5-mini-instruct.Q4_K_M.gguf",
    "Phi-3.5-mini-instruct.Q4_K_M.gguf",
)

Other ways

Run it on your computerOpen in Hugging Bay appSend to a computerMac (Apple silicon) and Linux x86_64 installs are listed on the download page. Windows and Intel Mac are not yet. The app checks this model before you choose to download.

1 hosted of 16 listed · Hashes recorded. Date not recorded.

Selected downloadPhi-3.5-mini-instruct.Q4_K_M.gguf2.39 GB · 1 file Download · 2.39 GB (1 file)

Open-file help

Content controls: not assessed.

Check your download →

Compare your file’s SHA-256 with the recorded hash.

No recent measured run

Fresh signed measurements are unavailable for this file.

Browse other models, or check this page again later for measured results.

Browse models

How we measure

Phi-3.5-mini-instruct-GGUF

No recent measured run

Cookies