---
base_model:
- deepseek-ai/DeepSeek-V3-0324
pipeline_tag: text-generation
---

Mirrored from https://modelscope.cn/models/ApproachingAI2024/DeepSeek-V3-0324-GPU-weight

For inference with `sglang` and `kt-kernel`: https://lmsys.org/blog/2025-10-22-KTransformers/

---

### 当前模型的精度： 非 experts 部分 FP8，experts GPTQ4