demo1984s 的个人博客
PyTorch 2.5.1
Python 3.12
CUDA 12.4
Ollama 0.5.7
Open WebUI 0.5.10(Python 3.11)
deepseek-r1:14b、deepseek-r1:32b和deepseek-r1:70b。RTX 3080x2(20GB)
NAME ID SIZE PROCESSOR UNTIL
deepseek-r1:14b ea35dfe18182 11 GB 100% GPU 4 minutes from now
deepseek-r1:32b 38056bbcbb2d 21 GB 4%/96% CPU/GPU 4 minutes from now
deepseek-r1:70b 0c1615a8ca32 46 GB 56%/44% CPU/GPU 4 minutes from now
RTX 4090D(24GB)
NAME ID SIZE PROCESSOR UNTIL
deepseek-r1:32b 38056bbcbb2d 23 GB 100% GPU 4 minutes from now
deepseek-r1:70b 0c1615a8ca32 45 GB 46%/54% CPU/GPU 4 minutes from now
RTX 4090D(24GB)双卡
NAME ID SIZE PROCESSOR UNTIL
deepseek-r1:70b 0c1615a8ca32 49 GB 100% GPU 4 minutes from now
deepseek-r1:14b:推荐20GB显存,100%由GPU推理,模型回复速度直观较快。deepseek-r1:32b:推荐24GB显存,100%由GPU推理,模型回复速度直观较快。deepseek-r1:70b:推荐48GB显存,100%由GPU推理,模型回复速度直观一般。