quantize-my-repo / README.md
Brianpuz's picture
Update README.md
0726865 verified
|
raw
history blame
747 Bytes
metadata
title: Quantize My Repo
emoji: 🔶
colorFrom: gray
colorTo: pink
sdk: docker
hf_oauth: true
hf_oauth_scopes:
  - read-repos
  - write-repos
  - manage-repos
pinned: false

About this space

Produced by Antigma Labs Follow Antigma Labs in X https://x.com/antigma_labs Antigma's GitHub Homepage https://github.com/AntigmaLabs

Quantize your model

For now we only support GGUF format

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

To run this space locally:

  1. Login huggingface CLI: huggingface-cli login
  2. Run command: HF_TOKEN=$(cat ~/.cache/huggingface/token) docker compose up