huggingface_hub
torch==2.4.0
torchvision
accelerate
git+https://github.com/huggingface/transformers
numpy<2
sentencepiece
triton
bitsandbytes