matrixportal commited on
Commit
fe14ef1
·
verified ·
1 Parent(s): 0c618fe

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +41 -0
app.py CHANGED
@@ -269,6 +269,47 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
269
  | [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-f16.gguf) | ![F16](https://img.shields.io/badge/F16-000000) | Maximum accuracy |
270
 
271
  💡 **Tip:** Use `F16` for maximum precision when quality is critical
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
272
  """
273
 
274
  # README'yi güncelle (ModelCard kullanarak)
 
269
  | [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-f16.gguf) | ![F16](https://img.shields.io/badge/F16-000000) | Maximum accuracy |
270
 
271
  💡 **Tip:** Use `F16` for maximum precision when quality is critical
272
+
273
+ ---
274
+
275
+ # 🚀 Tools for Running GGUF Quantized LLMs Locally
276
+
277
+ ## 🖥️ Desktop Applications
278
+
279
+ | Application | Description | Download Link |
280
+ |-----------------|----------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------|
281
+ | **Llama.cpp** | A fast and efficient inference engine for GGUF models. | [GitHub Repository](https://github.com/ggml-org/llama.cpp) |
282
+ | **Ollama** | A streamlined solution for running LLMs locally. | [Website](https://ollama.com/) |
283
+ | **AnythingLLM** | An AI-powered knowledge management tool. | [GitHub Repository](https://github.com/Mintplex-Labs/anything-llm) |
284
+ | **Open WebUI** | A user-friendly web interface for running local LLMs. | [GitHub Repository](https://github.com/open-webui/open-webui) |
285
+ | **GPT4All** | A user-friendly desktop application supporting various LLMs, compatible with GGUF models. | [GitHub Repository](https://github.com/nomic-ai/gpt4all) |
286
+ | **LM Studio** | A desktop application designed to run and manage local LLMs, supporting GGUF format. | [Website](https://lmstudio.ai/) |
287
+ | **GPT4All Chat**| A chat application compatible with GGUF models for local, offline interactions. | [GitHub Repository](https://github.com/nomic-ai/gpt4all) |
288
+
289
+ ---
290
+
291
+ ## 📱 Mobile Applications
292
+
293
+ | Application | Description | Download Link |
294
+ |-------------------|----------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------|
295
+ | **ChatterUI** | A simple and lightweight LLM app for mobile devices. | [GitHub Repository](https://github.com/Vali-98/ChatterUI) |
296
+ | **Maid** | Mobile Artificial Intelligence Distribution for running AI models on mobile devices. | [GitHub Repository](https://github.com/Mobile-Artificial-Intelligence/maid) |
297
+ | **PocketPal AI** | A mobile AI assistant powered by local models. | [GitHub Repository](https://github.com/a-ghorbani/pocketpal-ai) |
298
+ | **Layla** | A flexible platform for running various AI models on mobile devices. | [Website](https://www.layla-network.ai/) |
299
+
300
+ ---
301
+
302
+ ## 🎨 Image Generation Applications
303
+
304
+ | Application | Description | Download Link |
305
+ |-------------------------------------|----------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------|
306
+ | **Stable Diffusion** | An open-source AI model for generating images from text. | [GitHub Repository](https://github.com/CompVis/stable-diffusion) |
307
+ | **Stable Diffusion WebUI** | A web application providing access to Stable Diffusion models via a browser interface. | [GitHub Repository](https://github.com/AUTOMATIC1111/stable-diffusion-webui) |
308
+ | **Local Dream** | A locally running image generation application. | [GitHub Repository](https://github.com/xororz/local-dream) |
309
+ | **Stable-Diffusion-Android (SDAI)** | An open-source AI art application for Android devices, enabling digital art creation. | [GitHub Repository](https://github.com/ShiftHackZ/Stable-Diffusion-Android) |
310
+
311
+ ---
312
+
313
  """
314
 
315
  # README'yi güncelle (ModelCard kullanarak)