Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,18 @@ tags:
|
|
9 |
- OpenArc
|
10 |
---
|
11 |
|
12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
I reccomend starting with **Phi-4-mini-instruct-int4_asym-awq-se-ov**
|
15 |
|
@@ -37,22 +48,6 @@ print("Download complete!")
|
|
37 |
```
|
38 |
|
39 |
|
40 |
-
My Project [OpenArc](https://github.com/SearchSavior/OpenArc), an inference engine for OpenVINO, now supports this model and serves inference over OpenAI compatible endpoints for text to text *and* text with vision!
|
41 |
-
|
42 |
-
We have a growing Discord community of others interested in using Intel for AI/ML.
|
43 |
-
|
44 |
-
[](https://discord.gg/maMY7QjG)
|
45 |
-
|
46 |
-
- Find documentation on the Optimum-CLI export process [here](https://huggingface.co/docs/optimum/main/en/intel/openvino/export)
|
47 |
-
- Use my HF space [Echo9Zulu/Optimum-CLI-Tool_tool](https://huggingface.co/spaces/Echo9Zulu/Optimum-CLI-Tool_tool) to build commands and execute locally
|
48 |
-
|
49 |
-
|
50 |
-
|
51 |
-
|
52 |
-
|
53 |
-
|
54 |
-
|
55 |
-
|
56 |
|
57 |
|
58 |
|
|
|
9 |
- OpenArc
|
10 |
---
|
11 |
|
12 |
+
My Project [OpenArc](https://github.com/SearchSavior/OpenArc), an inference engine for OpenVINO, now supports this model and serves inference over OpenAI compatible endpoints for text to text *and* text with vision!
|
13 |
+
|
14 |
+
We have a growing Discord community of others interested in using Intel for AI/ML.
|
15 |
+
|
16 |
+
[](https://discord.gg/maMY7QjG)
|
17 |
+
|
18 |
+
- Find documentation on the Optimum-CLI export process [here](https://huggingface.co/docs/optimum/main/en/intel/openvino/export)
|
19 |
+
- Use my HF space [Echo9Zulu/Optimum-CLI-Tool_tool](https://huggingface.co/spaces/Echo9Zulu/Optimum-CLI-Tool_tool) to build commands and execute locally
|
20 |
+
|
21 |
+
---
|
22 |
+
|
23 |
+
## This repo contains OpenVINO quantizied versions of Phi-4-mini-instruct.
|
24 |
|
25 |
I reccomend starting with **Phi-4-mini-instruct-int4_asym-awq-se-ov**
|
26 |
|
|
|
48 |
```
|
49 |
|
50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
51 |
|
52 |
|
53 |
|