fastapi
uvicorn
torch
transformers
accelerate
bitsandbytes