llm-demo1-finalfinal

Runtime error

storresbusquets commited on Sep 17, 2023

Commit

78e3464

1 Parent(s): 7962c78

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,7 @@ def greet(text):
     torch_dtype=torch.bfloat16,
     trust_remote_code=True,
     device_map="auto",
-    max_length=512,
     do_sample=True,
     top_k=10,
     num_return_sequences=1,

     torch_dtype=torch.bfloat16,
     trust_remote_code=True,
     device_map="auto",
+    max_length=130,
     do_sample=True,
     top_k=10,
     num_return_sequences=1,