Spaces:

anhvv200053
/

Chatbot

Runtime error

anhvv200053 commited on Sep 13, 2024

Commit

cd4cda2

verified ·

1 Parent(s): 21864a0

Update model_setup.py

Files changed (1) hide show

model_setup.py CHANGED Viewed

@@ -16,7 +16,6 @@ def load_model():
     model = AutoModelForCausalLM.from_pretrained(
         "anhvv200053/Vinallama-2-7B-updated1-instruction-v2",
-        quantization_config=bnb_config,
         device_map={"": 0},
         token = token
     )

     model = AutoModelForCausalLM.from_pretrained(
         "anhvv200053/Vinallama-2-7B-updated1-instruction-v2",
         device_map={"": 0},
         token = token
     )