AlejandroOlmedo
/

DeepScaleR-1.5B-Preview-8bit-mlx

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

AlejandroOlmedo commited on Feb 12

Commit

11fd884

·

verified ·

1 Parent(s): a24c741

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -26,7 +26,7 @@ tags:
 I simply converted it to MLX format with a quantization of 8-bits for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
-# Alejandroolmedo/DeepScaleR-1.5B-Preview-Q8-mlx
 The Model [Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx](https://huggingface.co/Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx) was converted to MLX format from [agentica-org/DeepScaleR-1.5B-Preview](https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview) using mlx-lm version **0.20.5**.
@@ -39,7 +39,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Alejandroolmedo/DeepScaleR-1.5B-Preview-Q8-mlx")
 prompt="hello"

 I simply converted it to MLX format with a quantization of 8-bits for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
+# Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx
 The Model [Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx](https://huggingface.co/Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx) was converted to MLX format from [agentica-org/DeepScaleR-1.5B-Preview](https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview) using mlx-lm version **0.20.5**.
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx")
 prompt="hello"