{"kind":"answer-pack","schemaVersion":"hugging-bay.answer-pack.v1","generatedAt":"2026-10-12T06:58:16.956Z","slug":"run-llms-on-consumer-gpu","title":"Run LLMs On A Consumer GPU","question":"How do I run open LLMs on a consumer GPU with GGUF quantization?","description":"A plain-language GGUF and quantization guide backed by live catalog rows; file size and format metadata are not runtime guarantees.","answerLead":"On a consumer GPU, start with a live GGUF or quantized LLM row, compare its recorded file size with your usable VRAM, and test the exact runtime and context you plan to use. GGUF is a file format and Q4/Q5/Q8 are quantization labels—not promises of quality, speed, or fit—so use each recorded artifact page and hosted-file inventory as the citable record.","keywords":["run LLM on consumer GPU","GGUF quantization guide","Q4 Q5 Q8 LLM","local GPU model","consumer GPU LLM"],"shortAnswer":"On a consumer GPU, start with a live GGUF or quantized LLM row, compare its recorded file size with your usable VRAM, and test the exact runtime and context you plan to use. GGUF is a file format and Q4/Q5/Q8 are quantization labels—not promises of quality, speed, or fit—so use each recorded artifact page and hosted-file inventory as the citable record. Representative rows: legraphista/glm-4-9b-chat-IMat-GGUF, LiquidAI/LFM2.5-230M-GGUF, LiquidAI/LFM2.5-2.6B-GGUF, AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF, mudler/locate-anything.cpp-gguf. Use each recorded citation URL plus metadata/card endpoints for current license, trust, hosting, and download state.","canonicalUrl":"https://huggingbay.xyz/answers/run-llms-on-consumer-gpu","webUrl":"https://huggingbay.xyz/answers/run-llms-on-consumer-gpu","apiUrl":"https://huggingbay.xyz/api/answers/run-llms-on-consumer-gpu","sourceApiUrl":"https://huggingbay.xyz/api/artifacts?summary=1&limit=12","rankingUrl":null,"recommenderUrl":"https://huggingbay.xyz/api/recommender?useCase=local-llm&limit=12","rows":[{"rank":1,"id":"hf-model-legraphista-glm-4-9b-chat-imat-gguf","repo":"legraphista/glm-4-9b-chat-IMat-GGUF","type":"llm","license":"License: unknown","summary":"Model from Hugging Face for text generation: legraphista/glm-4-9b-chat-IMat-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":29,"downloads":1013638,"stars":5,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: unknown; 1,013,638 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-legraphista-glm-4-9b-chat-imat-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-legraphista-glm-4-9b-chat-imat-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-legraphista-glm-4-9b-chat-imat-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-legraphista-glm-4-9b-chat-imat-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-legraphista-glm-4-9b-chat-imat-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-legraphista-glm-4-9b-chat-imat-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":8262026432,"readinessCheckedAt":"2026-10-12T06:58:16.953Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":2,"id":"hf-model-liquidai-lfm2-5-230m-gguf","repo":"LiquidAI/LFM2.5-230M-GGUF","type":"llm","license":"License: unknown","summary":"Model from Hugging Face for text generation: LiquidAI/LFM2.5-230M-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":15,"downloads":595066,"stars":101,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: unknown; 595,066 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-230m-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-230m-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-230m-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-230m-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-230m-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-230m-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-liquidai-lfm2-5-230m-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-230m-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":153406304,"readinessCheckedAt":"2026-10-12T06:58:16.953Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":3,"id":"hf-model-liquidai-lfm2-5-2-6b-gguf","repo":"LiquidAI/LFM2.5-2.6B-GGUF","type":"llm","license":"License: unknown","summary":"Model from Hugging Face for text generation: LiquidAI/LFM2.5-2.6B-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":15,"downloads":1190232,"stars":345,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: unknown; 1,190,232 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-2-6b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-2-6b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-2-6b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-2-6b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-2-6b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-2-6b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-liquidai-lfm2-5-2-6b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-2-6b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":1674455040,"readinessCheckedAt":"2026-10-12T06:58:16.953Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":4,"id":"hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","repo":"AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for text generation: AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":595751,"stars":4,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: apache-2.0; 595,751 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":5027783648,"readinessCheckedAt":"2026-10-12T06:58:16.954Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":5,"id":"hf-model-mudler-locate-anything-cpp-gguf","repo":"mudler/locate-anything.cpp-gguf","type":"llm","license":"License: unknown","summary":"Model from Hugging Face for object detection: mudler/locate-anything.cpp-gguf · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":9,"downloads":915963,"stars":14,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: unknown; 915,963 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-mudler-locate-anything-cpp-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-mudler-locate-anything-cpp-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-mudler-locate-anything-cpp-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-mudler-locate-anything-cpp-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-mudler-locate-anything-cpp-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-mudler-locate-anything-cpp-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-mudler-locate-anything-cpp-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-mudler-locate-anything-cpp-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":5512244960,"readinessCheckedAt":"2026-10-12T06:58:16.954Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":6,"id":"hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","repo":"unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for llm: unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF · transformers","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":33,"downloads":609270,"stars":318,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: apache-2.0; 609,270 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":18556686752,"readinessCheckedAt":"2026-10-12T06:58:16.954Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":7,"id":"hf-model-ornith-ai-ornith-1-0-35b-gguf","repo":"ornith-ai/Ornith-1.0-35B-GGUF","type":"llm","license":"mit","summary":"Model from Hugging Face for text generation: ornith-ai/Ornith-1.0-35B-GGUF · transformers","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":9,"downloads":3755106,"stars":1055,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: mit; 3,755,106 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-ornith-ai-ornith-1-0-35b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-ornith-ai-ornith-1-0-35b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-ornith-ai-ornith-1-0-35b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ornith-ai-ornith-1-0-35b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-ornith-ai-ornith-1-0-35b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-ornith-ai-ornith-1-0-35b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-ornith-ai-ornith-1-0-35b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ornith-ai-ornith-1-0-35b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/ornith-ai/Ornith-1.0-35B-GGUF","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":21166757760,"readinessCheckedAt":"2026-10-12T06:58:16.954Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":8,"id":"hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","repo":"handy-computer/parakeet-unified-en-0.6b-gguf","type":"llm","license":"cc-by-4.0","summary":"Model from Hugging Face for automatic speech recognition: handy-computer/parakeet-unified-en-0.6b-gguf · transcribe.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":1560031,"stars":7,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: cc-by-4.0; 1,560,031 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-parakeet-unified-en-0-6b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-parakeet-unified-en-0-6b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/handy-computer/parakeet-unified-en-0.6b-gguf","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":477274496,"readinessCheckedAt":"2026-10-12T06:58:16.955Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":9,"id":"hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","repo":"rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF","type":"llm","license":"License: unknown","summary":"Model from Hugging Face for llm: rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF · unknown","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":999338,"stars":5,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: unknown; 999,338 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":1133974368,"readinessCheckedAt":"2026-10-12T06:58:16.955Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":10,"id":"hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","repo":"handy-computer/parakeet-tdt-0.6b-v3-gguf","type":"llm","license":"cc-by-4.0","summary":"Model from Hugging Face for automatic speech recognition: handy-computer/parakeet-tdt-0.6b-v3-gguf · transcribe.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":575259,"stars":6,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: cc-by-4.0; 575,259 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-parakeet-tdt-0-6b-v3-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v3-gguf","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":485425504,"readinessCheckedAt":"2026-10-12T06:58:16.955Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":11,"id":"hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","repo":"handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf","type":"llm","license":"License: unknown","summary":"Model from Hugging Face for automatic speech recognition: handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf · transcribe.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":8,"downloads":1829287,"stars":10,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"Run LLMs On A Consumer GPU; 1 hosted file; License: unknown; 1,829,287 upstream downloads","citationUrl":"https://huggingbay.xyz/artifact/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":495831520,"readinessCheckedAt":"2026-10-12T06:58:16.955Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":12,"id":"hf-model-prism-ml-ternary-bonsai-27b-gguf","repo":"prism-ml/Ternary-Bonsai-27B-gguf","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for text generation: prism-ml/Ternary-Bonsai-27B-gguf · llama.cpp","source":"huggingface","hostingStatus":"blocked","hostedFiles":0,"fileCount":16,"downloads":697666,"stars":1403,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"request-reviewed-mirror","reason":"Run LLMs On A Consumer GPU; external metadata; License: apache-2.0; 697,666 upstream downloads","citationUrl":null,"apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-ternary-bonsai-27b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-ternary-bonsai-27b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/distribution","hostedDownloads":null},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-prism-ml-ternary-bonsai-27b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-ternary-bonsai-27b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/distribution"},"localKitUrl":null,"downloadRowsUrl":null,"mirrorRequestUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/mirror-request","upstreamUrl":"https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf","readiness":"blocked","downloadReady":false,"downloadable":false,"downloadStatus":"BLOCKED","hostedFileCount":0,"mirroredBytes":0,"readinessCheckedAt":"2026-10-12T06:58:16.955Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":false,"publicDownloadableFileCount":0}],"citationTargets":["https://huggingbay.xyz/answers/run-llms-on-consumer-gpu","https://huggingbay.xyz/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf","https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-230m-gguf","https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-2-6b-gguf","https://huggingbay.xyz/artifact/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","https://huggingbay.xyz/artifact/hf-model-mudler-locate-anything-cpp-gguf"],"extractionApis":["https://huggingbay.xyz/api/answers/run-llms-on-consumer-gpu","https://huggingbay.xyz/api/artifacts?summary=1&limit=12","https://huggingbay.xyz/api/recommender?useCase=local-llm&limit=12"],"guidance":["Cite the recorded answer page for the shortlist and individual artifact/download pages for specific claims.","Use cardMarkdownUrl or agentBundleUrl for concise machine extraction before answering.","Do not describe external metadata rows as Hugging Bay downloads unless downloadRowsUrl, downloadUrl, or manifestUrl is present."],"runnableClaimGate":{"tau":0.6,"rowsScanned":12,"overclaimingRows":0},"note":{"summary":"Downloadable doesn't mean tested: this record says whether the exact file can be downloaded now, not that the model is complete or that it runs."}}