InferForge/Qwen3.5-4B-Q4_K_M

zetlyn/models-gguf quantisation gguf InferForge/Qwen3.5-4B-Q4_K_M hf Qwen/Qwen3.5-4B known 2026-09-22

https://huggingface.co/InferForge/Qwen3.5-4B-Q4_K_M

Properties

authorInferForge
receipt
Source
GGUF quantisations
Its words
InferForge
Read by
field:author
Said since
2026-09-28 11:46 UTC
Last answered
2026-10-04 18:16 UTC
Original
open at the source
What the source handed over
{
  "_id": "6ab2207208ccadb8a0081b9c",
  "author": "InferForge",
  "cardData": {
    "base_model": "Qwen/Qwen3.5-4B",
    "library_name": "gguf",
    "license": "apache-2.0",
    "pipeline_tag": "text-generation",
    "tags": [
      "gguf",
      "qwen",
      "qwen3.5",
      "quantized",
      "q4_k_m",
      "llama.cpp",
      "local-inference",
      "4b"
    ]
  },
  "createdAt": "2026-09-22T06:30:10.000Z",
  "downloads": 46,
  "gated": false,
  "id": "InferForge/Qwen3.5-4B-Q4_K_M",
  "lastModified": "2026-09-22T07:49:53.000Z",
  "library_name": "gguf",
  "likes": 0,
  "modelId": "InferForge/Qwen3.5-4B-Q4_K_M",
  "pipeline_tag": "text-generation",
  "private": false,
  "sha": "f145e8225a6610c10449f5a84df1e1bcb170dfab",
  "siblings": [
    {
      "rfilename": ".gitattributes"
    },
    {
      "rfilename": "Qwen3.5-4B-Q4_K_M.gguf"
    },
    {
      "rfilename": "README.md"
    }
  ],
  "tags": [
    "gguf",
    "qwen",
    "qwen3.5",
    "quantized",
    "q4_k_m",
    "llama.cpp",
    "local-inference",
    "4b",
    "text-generation",
    "base_model:Qwen/Qwen3.5-4B",
    "base_model:quantized:Qwen/Qwen3.5-4B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ]
}
baseQwen/Qwen3.5-4B
receipt
Source
GGUF quantisations
Its words
Qwen/Qwen3.5-4B
Read by
field:cardData.base_model[]
Said since
2026-09-28 11:46 UTC
Last answered
2026-10-04 18:16 UTC
Original
open at the source
What the source handed over
{
  "_id": "6ab2207208ccadb8a0081b9c",
  "author": "InferForge",
  "cardData": {
    "base_model": "Qwen/Qwen3.5-4B",
    "library_name": "gguf",
    "license": "apache-2.0",
    "pipeline_tag": "text-generation",
    "tags": [
      "gguf",
      "qwen",
      "qwen3.5",
      "quantized",
      "q4_k_m",
      "llama.cpp",
      "local-inference",
      "4b"
    ]
  },
  "createdAt": "2026-09-22T06:30:10.000Z",
  "downloads": 46,
  "gated": false,
  "id": "InferForge/Qwen3.5-4B-Q4_K_M",
  "lastModified": "2026-09-22T07:49:53.000Z",
  "library_name": "gguf",
  "likes": 0,
  "modelId": "InferForge/Qwen3.5-4B-Q4_K_M",
  "pipeline_tag": "text-generation",
  "private": false,
  "sha": "f145e8225a6610c10449f5a84df1e1bcb170dfab",
  "siblings": [
    {
      "rfilename": ".gitattributes"
    },
    {
      "rfilename": "Qwen3.5-4B-Q4_K_M.gguf"
    },
    {
      "rfilename": "README.md"
    }
  ],
  "tags": [
    "gguf",
    "qwen",
    "qwen3.5",
    "quantized",
    "q4_k_m",
    "llama.cpp",
    "local-inference",
    "4b",
    "text-generation",
    "base_model:Qwen/Qwen3.5-4B",
    "base_model:quantized:Qwen/Qwen3.5-4B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ]
}
downloads46
receipt
Source
GGUF quantisations
Its words
46
Read by
field:downloads
Said since
2026-09-28 11:46 UTC
Last answered
2026-10-04 18:16 UTC
Original
open at the source
What the source handed over
{
  "_id": "6ab2207208ccadb8a0081b9c",
  "author": "InferForge",
  "cardData": {
    "base_model": "Qwen/Qwen3.5-4B",
    "library_name": "gguf",
    "license": "apache-2.0",
    "pipeline_tag": "text-generation",
    "tags": [
      "gguf",
      "qwen",
      "qwen3.5",
      "quantized",
      "q4_k_m",
      "llama.cpp",
      "local-inference",
      "4b"
    ]
  },
  "createdAt": "2026-09-22T06:30:10.000Z",
  "downloads": 46,
  "gated": false,
  "id": "InferForge/Qwen3.5-4B-Q4_K_M",
  "lastModified": "2026-09-22T07:49:53.000Z",
  "library_name": "gguf",
  "likes": 0,
  "modelId": "InferForge/Qwen3.5-4B-Q4_K_M",
  "pipeline_tag": "text-generation",
  "private": false,
  "sha": "f145e8225a6610c10449f5a84df1e1bcb170dfab",
  "siblings": [
    {
      "rfilename": ".gitattributes"
    },
    {
      "rfilename": "Qwen3.5-4B-Q4_K_M.gguf"
    },
    {
      "rfilename": "README.md"
    }
  ],
  "tags": [
    "gguf",
    "qwen",
    "qwen3.5",
    "quantized",
    "q4_k_m",
    "llama.cpp",
    "local-inference",
    "4b",
    "text-generation",
    "base_model:Qwen/Qwen3.5-4B",
    "base_model:quantized:Qwen/Qwen3.5-4B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ]
}
licenceapache-2.0
receipt
Source
GGUF quantisations
Its words
apache-2.0
Read by
field:cardData.license
Said since
2026-09-28 11:46 UTC
Last answered
2026-10-04 18:16 UTC
Original
open at the source
What the source handed over
{
  "_id": "6ab2207208ccadb8a0081b9c",
  "author": "InferForge",
  "cardData": {
    "base_model": "Qwen/Qwen3.5-4B",
    "library_name": "gguf",
    "license": "apache-2.0",
    "pipeline_tag": "text-generation",
    "tags": [
      "gguf",
      "qwen",
      "qwen3.5",
      "quantized",
      "q4_k_m",
      "llama.cpp",
      "local-inference",
      "4b"
    ]
  },
  "createdAt": "2026-09-22T06:30:10.000Z",
  "downloads": 46,
  "gated": false,
  "id": "InferForge/Qwen3.5-4B-Q4_K_M",
  "lastModified": "2026-09-22T07:49:53.000Z",
  "library_name": "gguf",
  "likes": 0,
  "modelId": "InferForge/Qwen3.5-4B-Q4_K_M",
  "pipeline_tag": "text-generation",
  "private": false,
  "sha": "f145e8225a6610c10449f5a84df1e1bcb170dfab",
  "siblings": [
    {
      "rfilename": ".gitattributes"
    },
    {
      "rfilename": "Qwen3.5-4B-Q4_K_M.gguf"
    },
    {
      "rfilename": "README.md"
    }
  ],
  "tags": [
    "gguf",
    "qwen",
    "qwen3.5",
    "quantized",
    "q4_k_m",
    "llama.cpp",
    "local-inference",
    "4b",
    "text-generation",
    "base_model:Qwen/Qwen3.5-4B",
    "base_model:quantized:Qwen/Qwen3.5-4B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ]
}
likes0
receipt
Source
GGUF quantisations
Its words
0
Read by
field:likes
Said since
2026-09-28 11:46 UTC
Last answered
2026-10-04 18:16 UTC
Original
open at the source
What the source handed over
{
  "_id": "6ab2207208ccadb8a0081b9c",
  "author": "InferForge",
  "cardData": {
    "base_model": "Qwen/Qwen3.5-4B",
    "library_name": "gguf",
    "license": "apache-2.0",
    "pipeline_tag": "text-generation",
    "tags": [
      "gguf",
      "qwen",
      "qwen3.5",
      "quantized",
      "q4_k_m",
      "llama.cpp",
      "local-inference",
      "4b"
    ]
  },
  "createdAt": "2026-09-22T06:30:10.000Z",
  "downloads": 46,
  "gated": false,
  "id": "InferForge/Qwen3.5-4B-Q4_K_M",
  "lastModified": "2026-09-22T07:49:53.000Z",
  "library_name": "gguf",
  "likes": 0,
  "modelId": "InferForge/Qwen3.5-4B-Q4_K_M",
  "pipeline_tag": "text-generation",
  "private": false,
  "sha": "f145e8225a6610c10449f5a84df1e1bcb170dfab",
  "siblings": [
    {
      "rfilename": ".gitattributes"
    },
    {
      "rfilename": "Qwen3.5-4B-Q4_K_M.gguf"
    },
    {
      "rfilename": "README.md"
    }
  ],
  "tags": [
    "gguf",
    "qwen",
    "qwen3.5",
    "quantized",
    "q4_k_m",
    "llama.cpp",
    "local-inference",
    "4b",
    "text-generation",
    "base_model:Qwen/Qwen3.5-4B",
    "base_model:quantized:Qwen/Qwen3.5-4B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ]
}

Text

This source's terms allow its title, its values and a link here, not its text. It is at https://huggingface.co/InferForge/Qwen3.5-4B-Q4_K_M.