Spaces:

yzhuang
/

MixtureOfInputs

Sleeping

yzhuang commited on 19 days ago

Commit

c9e16e4

verified ·

1 Parent(s): 2d7f359

Update server.py

Files changed (1) hide show

server.py CHANGED Viewed

@@ -23,7 +23,8 @@ def launch_vllm_server(beta=1.0):
         "--max-model-len", "2048",
         "--max-seq-len-to-capture", "2048",
         "--max-num-seqs", "1",
-        "--port", "8000"
     ]
     _server_process = subprocess.Popen(cmd, env=env)

         "--max-model-len", "2048",
         "--max-seq-len-to-capture", "2048",
         "--max-num-seqs", "1",
+        "--port", "8000",
+        "--api-key", "EMPTY"
     ]
     _server_process = subprocess.Popen(cmd, env=env)