Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
@@ -269,6 +269,47 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
|
|
269 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-f16.gguf) |  | Maximum accuracy |
|
270 |
|
271 |
💡 **Tip:** Use `F16` for maximum precision when quality is critical
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
272 |
"""
|
273 |
|
274 |
# README'yi güncelle (ModelCard kullanarak)
|
|
|
269 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-f16.gguf) |  | Maximum accuracy |
|
270 |
|
271 |
💡 **Tip:** Use `F16` for maximum precision when quality is critical
|
272 |
+
|
273 |
+
---
|
274 |
+
|
275 |
+
# 🚀 Tools for Running GGUF Quantized LLMs Locally
|
276 |
+
|
277 |
+
## 🖥️ Desktop Applications
|
278 |
+
|
279 |
+
| Application | Description | Download Link |
|
280 |
+
|-----------------|----------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------|
|
281 |
+
| **Llama.cpp** | A fast and efficient inference engine for GGUF models. | [GitHub Repository](https://github.com/ggml-org/llama.cpp) |
|
282 |
+
| **Ollama** | A streamlined solution for running LLMs locally. | [Website](https://ollama.com/) |
|
283 |
+
| **AnythingLLM** | An AI-powered knowledge management tool. | [GitHub Repository](https://github.com/Mintplex-Labs/anything-llm) |
|
284 |
+
| **Open WebUI** | A user-friendly web interface for running local LLMs. | [GitHub Repository](https://github.com/open-webui/open-webui) |
|
285 |
+
| **GPT4All** | A user-friendly desktop application supporting various LLMs, compatible with GGUF models. | [GitHub Repository](https://github.com/nomic-ai/gpt4all) |
|
286 |
+
| **LM Studio** | A desktop application designed to run and manage local LLMs, supporting GGUF format. | [Website](https://lmstudio.ai/) |
|
287 |
+
| **GPT4All Chat**| A chat application compatible with GGUF models for local, offline interactions. | [GitHub Repository](https://github.com/nomic-ai/gpt4all) |
|
288 |
+
|
289 |
+
---
|
290 |
+
|
291 |
+
## 📱 Mobile Applications
|
292 |
+
|
293 |
+
| Application | Description | Download Link |
|
294 |
+
|-------------------|----------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------|
|
295 |
+
| **ChatterUI** | A simple and lightweight LLM app for mobile devices. | [GitHub Repository](https://github.com/Vali-98/ChatterUI) |
|
296 |
+
| **Maid** | Mobile Artificial Intelligence Distribution for running AI models on mobile devices. | [GitHub Repository](https://github.com/Mobile-Artificial-Intelligence/maid) |
|
297 |
+
| **PocketPal AI** | A mobile AI assistant powered by local models. | [GitHub Repository](https://github.com/a-ghorbani/pocketpal-ai) |
|
298 |
+
| **Layla** | A flexible platform for running various AI models on mobile devices. | [Website](https://www.layla-network.ai/) |
|
299 |
+
|
300 |
+
---
|
301 |
+
|
302 |
+
## 🎨 Image Generation Applications
|
303 |
+
|
304 |
+
| Application | Description | Download Link |
|
305 |
+
|-------------------------------------|----------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------|
|
306 |
+
| **Stable Diffusion** | An open-source AI model for generating images from text. | [GitHub Repository](https://github.com/CompVis/stable-diffusion) |
|
307 |
+
| **Stable Diffusion WebUI** | A web application providing access to Stable Diffusion models via a browser interface. | [GitHub Repository](https://github.com/AUTOMATIC1111/stable-diffusion-webui) |
|
308 |
+
| **Local Dream** | A locally running image generation application. | [GitHub Repository](https://github.com/xororz/local-dream) |
|
309 |
+
| **Stable-Diffusion-Android (SDAI)** | An open-source AI art application for Android devices, enabling digital art creation. | [GitHub Repository](https://github.com/ShiftHackZ/Stable-Diffusion-Android) |
|
310 |
+
|
311 |
+
---
|
312 |
+
|
313 |
"""
|
314 |
|
315 |
# README'yi güncelle (ModelCard kullanarak)
|