Spaces:

codebyam
/

DeepSeek-R1-Distill-Qwen-7B-Demo-GGUF

Running

codebyam commited on 4 days ago

Commit

69e189f

verified ·

1 Parent(s): 72bed90

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -39,7 +39,7 @@ RUN git clone https://github.com/ggerganov/llama.cpp && \
 # Download model
 RUN mkdir -p /models && \
-    wget -O /models/model.q8_0.gguf https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Q8_0.gguf
 # Copy app and startup script
 COPY app.py /app.py

 # Download model
 RUN mkdir -p /models && \
+    wget -O /models/model.q8_0.gguf https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf
 # Copy app and startup script
 COPY app.py /app.py