Final_Assignment_Template

Sleeping

wishwakankanamg commited on May 24

Commit

a2e96a6

1 Parent(s): 2ab5a48

assf

Files changed (2) hide show

__pycache__/agent.cpython-310.pyc CHANGED Viewed

Binary files a/__pycache__/agent.cpython-310.pyc and b/__pycache__/agent.cpython-310.pyc differ

agent.py CHANGED Viewed

@@ -344,9 +344,8 @@ def build_graph(provider: str = "huggingface"):
             repo_id="togethercomputer/LLaMA-2-7B-32K",
             provider="auto",
             task="text-generation",
-            max_new_tokens=1000,
-            do_sample=False,
-            repetition_penalty=1.03,
         )
         llm = ChatHuggingFace(llm=llm)

             repo_id="togethercomputer/LLaMA-2-7B-32K",
             provider="auto",
             task="text-generation",
+            max_new_tokens=2000,
         )
         llm = ChatHuggingFace(llm=llm)