{"kind":"answer-pack","schemaVersion":"hugging-bay.answer-pack.v1","generatedAt":"2026-10-24T13:18:23.711Z","slug":"run-llms-on-consumer-gpu","title":"Run LLMs On A Consumer GPU","question":"How do I run open LLMs on a consumer GPU with GGUF quantization?","description":"Choose a GGUF file supported by your app, then check its size and your available GPU memory. Quantization and file size alone do not establish quality, speed or fit at your chosen context length.","answerLead":"Choose a GGUF file supported by your app, then check its size and your available GPU memory. Quantization and file size alone do not establish quality, speed or fit at your chosen context length.","keywords":["run LLM on consumer GPU","GGUF quantization guide","Q4 Q5 Q8 LLM","local GPU model","consumer GPU LLM"],"shortAnswer":"Choose a GGUF file supported by your app, then check its size and your available GPU memory. Quantization and file size alone do not establish quality, speed or fit at your chosen context length. Catalog matches: legraphista/glm-4-9b-chat-IMat-GGUF, AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF, LiquidAI/LFM2.5-230M-GGUF, LiquidAI/LFM2.5-2.6B-GGUF, mudler/locate-anything.cpp-gguf. Next: Check model files and sizes.","nextStep":{"label":"Check model files and sizes","href":"/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf/files"},"canonicalUrl":"https://huggingbay.xyz/answers/run-llms-on-consumer-gpu","webUrl":"https://huggingbay.xyz/answers/run-llms-on-consumer-gpu","apiUrl":"https://huggingbay.xyz/api/answers/run-llms-on-consumer-gpu","sourceApiUrl":"https://huggingbay.xyz/api/artifacts?type=llm&q=gguf&summary=1&limit=12","rankingUrl":null,"recommenderUrl":"https://huggingbay.xyz/api/recommender?useCase=local-llm&limit=12","rows":[{"rank":1,"id":"hf-model-legraphista-glm-4-9b-chat-imat-gguf","repo":"legraphista/glm-4-9b-chat-IMat-GGUF","type":"llm","license":"unknown","summary":"Model from Hugging Face for text generation: legraphista/glm-4-9b-chat-IMat-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":30,"downloads":1013638,"stars":5,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-legraphista-glm-4-9b-chat-imat-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-legraphista-glm-4-9b-chat-imat-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-legraphista-glm-4-9b-chat-imat-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-legraphista-glm-4-9b-chat-imat-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-legraphista-glm-4-9b-chat-imat-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-legraphista-glm-4-9b-chat-imat-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-legraphista-glm-4-9b-chat-imat-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":8262026432,"readinessCheckedAt":"2026-10-24T13:18:23.700Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":2,"id":"hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","repo":"AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for text generation: AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":595751,"stars":4,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":5027783648,"readinessCheckedAt":"2026-10-24T13:18:23.700Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":3,"id":"hf-model-liquidai-lfm2-5-230m-gguf","repo":"LiquidAI/LFM2.5-230M-GGUF","type":"llm","license":"unknown","summary":"Model from Hugging Face for text generation: LiquidAI/LFM2.5-230M-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":15,"downloads":595066,"stars":101,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-230m-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-230m-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-230m-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-230m-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-230m-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-230m-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-230m-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-liquidai-lfm2-5-230m-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-230m-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":153406304,"readinessCheckedAt":"2026-10-24T13:18:23.701Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":4,"id":"hf-model-liquidai-lfm2-5-2-6b-gguf","repo":"LiquidAI/LFM2.5-2.6B-GGUF","type":"llm","license":"unknown","summary":"Model from Hugging Face for text generation: LiquidAI/LFM2.5-2.6B-GGUF · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":15,"downloads":1190232,"stars":345,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-2-6b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-2-6b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-2-6b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-2-6b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-2-6b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-liquidai-lfm2-5-2-6b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-liquidai-lfm2-5-2-6b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-liquidai-lfm2-5-2-6b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-liquidai-lfm2-5-2-6b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":1674455040,"readinessCheckedAt":"2026-10-24T13:18:23.701Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":5,"id":"hf-model-mudler-locate-anything-cpp-gguf","repo":"mudler/locate-anything.cpp-gguf","type":"llm","license":"unknown","summary":"Model from Hugging Face for object detection: mudler/locate-anything.cpp-gguf · gguf","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":9,"downloads":915963,"stars":14,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: object detection. Listed formats: gguf. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: object detection. Listed formats: gguf. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-mudler-locate-anything-cpp-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-mudler-locate-anything-cpp-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-mudler-locate-anything-cpp-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-mudler-locate-anything-cpp-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-mudler-locate-anything-cpp-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-mudler-locate-anything-cpp-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-mudler-locate-anything-cpp-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-mudler-locate-anything-cpp-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-mudler-locate-anything-cpp-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":5512244960,"readinessCheckedAt":"2026-10-24T13:18:23.701Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":6,"id":"hf-model-ornith-ai-ornith-1-0-35b-gguf","repo":"ornith-ai/Ornith-1.0-35B-GGUF","type":"llm","license":"mit","summary":"Model from Hugging Face for text generation: ornith-ai/Ornith-1.0-35B-GGUF · transformers","source":"huggingface","hostingStatus":"hosted","hostedFiles":7,"fileCount":9,"downloads":3755106,"stars":1055,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: mit. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: mit. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-ornith-ai-ornith-1-0-35b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-ornith-ai-ornith-1-0-35b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-ornith-ai-ornith-1-0-35b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ornith-ai-ornith-1-0-35b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-ornith-ai-ornith-1-0-35b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-ornith-ai-ornith-1-0-35b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-ornith-ai-ornith-1-0-35b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-ornith-ai-ornith-1-0-35b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-ornith-ai-ornith-1-0-35b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/ornith-ai/Ornith-1.0-35B-GGUF","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":7,"mirroredBytes":180689839860,"readinessCheckedAt":"2026-10-24T13:18:23.702Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":7},{"rank":7,"id":"hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","repo":"rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF","type":"llm","license":"unknown","summary":"Model from Hugging Face for llm: rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF · unknown","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":999338,"stars":5,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Listed formats: gguf. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Listed formats: gguf. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-rippertnt-hyperclovax-seed-text-instruct-1-5b-q4-k-m-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":1133974368,"readinessCheckedAt":"2026-10-24T13:18:23.703Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":8,"id":"hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","repo":"unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for llm: unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF · transformers","source":"huggingface","hostingStatus":"hosted","hostedFiles":32,"fileCount":33,"downloads":609270,"stars":318,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-unsloth-qwen3-30b-a3b-instruct-2507-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":32,"mirroredBytes":506769959851,"readinessCheckedAt":"2026-10-24T13:18:23.706Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":32},{"rank":9,"id":"hf-model-prism-ml-bonsai-27b-gguf","repo":"prism-ml/Bonsai-27B-gguf","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for text generation: prism-ml/Bonsai-27B-gguf · llama.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":9,"fileCount":14,"downloads":2455730,"stars":920,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-prism-ml-bonsai-27b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-bonsai-27b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-bonsai-27b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-prism-ml-bonsai-27b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-prism-ml-bonsai-27b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-bonsai-27b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-bonsai-27b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-prism-ml-bonsai-27b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-prism-ml-bonsai-27b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/prism-ml/Bonsai-27B-gguf","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":9,"mirroredBytes":66691112002,"readinessCheckedAt":"2026-10-24T13:18:23.708Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":9},{"rank":10,"id":"hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","repo":"handy-computer/parakeet-unified-en-0.6b-gguf","type":"llm","license":"cc-by-4.0","summary":"Model from Hugging Face for automatic speech recognition: handy-computer/parakeet-unified-en-0.6b-gguf · transcribe.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":7,"downloads":1560031,"stars":7,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: automatic speech recognition. Listed formats: gguf. Recorded license: cc-by-4.0. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: automatic speech recognition. Listed formats: gguf. Recorded license: cc-by-4.0. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-parakeet-unified-en-0-6b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-handy-computer-parakeet-unified-en-0-6b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-parakeet-unified-en-0-6b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/handy-computer/parakeet-unified-en-0.6b-gguf","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":477274496,"readinessCheckedAt":"2026-10-24T13:18:23.708Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":11,"id":"hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","repo":"handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf","type":"llm","license":"unknown","summary":"Model from Hugging Face for automatic speech recognition: handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf · transcribe.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":1,"fileCount":8,"downloads":1829287,"stars":10,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: automatic speech recognition. Listed formats: gguf. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: automatic speech recognition. Listed formats: gguf. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-handy-computer-nemotron-3-5-asr-streaming-0-6b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":null,"readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":1,"mirroredBytes":495831520,"readinessCheckedAt":"2026-10-24T13:18:23.708Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":1},{"rank":12,"id":"hf-model-prism-ml-ternary-bonsai-27b-gguf","repo":"prism-ml/Ternary-Bonsai-27B-gguf","type":"llm","license":"apache-2.0","summary":"Model from Hugging Face for text generation: prism-ml/Ternary-Bonsai-27B-gguf · llama.cpp","source":"huggingface","hostingStatus":"hosted","hostedFiles":15,"fileCount":16,"downloads":697666,"stars":1403,"trustScore":0,"trust":{"score":0,"qualification":"recorded-state-unknown","trustImpact":"none"},"action":"inspect-hosted-files","reason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","selectionReason":"The catalog returned it for the search \"gguf\". Recorded task: text generation. Listed formats: gguf. Recorded license: apache-2.0. This listing does not measure quality or prove runtime support.","citationUrl":"https://huggingbay.xyz/artifact/hf-model-prism-ml-ternary-bonsai-27b-gguf","apiUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/metadata.json","cardMarkdownUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/card.md","agentBundleUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/agent-bundle","reviewSummaryUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/review-summary","trustBundleUrl":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-ternary-bonsai-27b-gguf","insightsUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/insights","distributionUrl":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/distribution","extractionUrls":{"card":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/card","cardMarkdown":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/card.md","agentBundle":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/agent-bundle","trustBundle":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-ternary-bonsai-27b-gguf","reviewSummary":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/distribution","hostedDownloads":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-prism-ml-ternary-bonsai-27b-gguf&limit=100"},"citationTargets":{"artifact":"https://huggingbay.xyz/artifact/hf-model-prism-ml-ternary-bonsai-27b-gguf","trust":"https://huggingbay.xyz/api/trust-bundles/hf-model-prism-ml-ternary-bonsai-27b-gguf","reviews":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/review-summary","distribution":"https://huggingbay.xyz/api/artifacts/hf-model-prism-ml-ternary-bonsai-27b-gguf/distribution"},"localKitUrl":"https://huggingbay.xyz/local-kit/hf-model-prism-ml-ternary-bonsai-27b-gguf","downloadRowsUrl":"https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-prism-ml-ternary-bonsai-27b-gguf&limit=100","mirrorRequestUrl":null,"upstreamUrl":"https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf","readiness":"ready","downloadReady":true,"downloadable":true,"downloadStatus":"READY","hostedFileCount":15,"mirroredBytes":86522552903,"readinessCheckedAt":"2026-10-24T13:18:23.711Z","readinessSource":"file-check","degraded":false,"stale":false,"hosted":true,"publicDownloadableFileCount":15}],"citationTargets":["https://huggingbay.xyz/answers/run-llms-on-consumer-gpu","https://huggingbay.xyz/artifact/hf-model-legraphista-glm-4-9b-chat-imat-gguf","https://huggingbay.xyz/artifact/hf-model-ankitai-parable-qwen3-8b-claude-fable-5-gguf","https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-230m-gguf","https://huggingbay.xyz/artifact/hf-model-liquidai-lfm2-5-2-6b-gguf","https://huggingbay.xyz/artifact/hf-model-mudler-locate-anything-cpp-gguf"],"extractionApis":["https://huggingbay.xyz/api/answers/run-llms-on-consumer-gpu","https://huggingbay.xyz/api/artifacts?type=llm&q=gguf&summary=1&limit=12","https://huggingbay.xyz/api/recommender?useCase=local-llm&limit=12"],"guidance":["Cite the recorded answer page for the shortlist and individual artifact/download pages for specific claims.","Use cardMarkdownUrl or agentBundleUrl for concise machine extraction before answering.","Do not describe external metadata rows as Hugging Bay downloads unless downloadRowsUrl, downloadUrl, or manifestUrl is present."],"inventoryAgeSeconds":0,"runnableClaimGate":{"tau":0.6,"rowsScanned":12,"overclaimingRows":0},"note":{"summary":"Downloadable doesn't mean tested: this record says whether the exact file can be downloaded now, not that the model is complete or that it runs."}}