Spaces:

muryshev
/

saiga-api-cuda-v2

Runtime error

muryshev commited on Dec 8, 2023

Commit

6d97715

1 Parent(s): b8ff7b6

fix

Files changed (1) hide show

llm_backend.py CHANGED Viewed

@@ -70,7 +70,6 @@ class LlmBackend:
     def unload_model(self):
         with self._lock:
             if self._model is not None:
-                self._model.llama_free_model()
                 del self._model
     def generate_tokens(self, generator):

     def unload_model(self):
         with self._lock:
             if self._model is not None:
                 del self._model
     def generate_tokens(self, generator):