Hugging Face's logo

Spaces:
sayyid14
/
BioMistralCancer
Runtime error

App Files Community
sayyid14 commited on
Commit
93b4ed7
·
verified ·
1 Parent(s): 46069cf

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +3 -1
app.py CHANGED
@@ -6,7 +6,9 @@ import gradio as gr
6
 
7
  # Memuat model
8
  base_model = AutoModelForCausalLM.from_pretrained(
9
- "BioMistral/BioMistral-7B"
 
 
10
  )
11
  model = PeftModel.from_pretrained(base_model, "sayyid14/BioMistralCancer5epoch")
12
 
 
6
 
7
  # Memuat model
8
  base_model = AutoModelForCausalLM.from_pretrained(
9
+ "BioMistral/BioMistral-7B",
10
+ load_in_8bit=True,
11
+ device_map="auto"
12
  )
13
  model = PeftModel.from_pretrained(base_model, "sayyid14/BioMistralCancer5epoch")
14