jbilcke-hf HF Staff commited on
Commit
3e6cbbd
·
1 Parent(s): 56d5816

fix workaround

Browse files
README.md CHANGED
@@ -191,18 +191,16 @@ This is because of flash attention, which is defined in the `requirements.txt` u
191
  ./setup.sh
192
  ```
193
 
194
- ### Degraded installation in local
195
 
196
- If you cannot meet the requirements, you can:
197
 
198
- - solution 1: fix requirements.txt to use another prebuilt wheel
199
- - solution 2: manually build/install flash attention
200
- - solution 3: don't use clip captioning
201
 
202
- Here is how to do solution 3:
203
- ```bash
204
- ./setup_no_captions.sh
205
- ```
206
 
207
  ## Run
208
 
 
191
  ./setup.sh
192
  ```
193
 
194
+ ### macOS is NOT supported
195
 
196
+ Currently macOS is NOT supported due to two separate dependency issues:
197
 
198
+ - issue with flash attention
199
+ - issue with decord
 
200
 
201
+ However, the paradox is that I actually develop and maintain VMS using macOS!
202
+
203
+ So don't be surprised by the presence of "degraded_setup.sh" and all, it's just a workaround for me to be able to at least test the web ui on macOS.
 
204
 
205
  ## Run
206
 
degraded_finetrainers_requirements.txt ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ accelerate
2
+ bitsandbytes
3
+ datasets>=3.3.2
4
+ diffusers>=0.32.1
5
+ transformers>=4.45.2
6
+ huggingface_hub
7
+ hf_transfer>=0.1.8
8
+ peft>=0.13.0
9
+ #decord>=0.6.0
10
+ wandb
11
+ pandas
12
+ torch>=2.5.1
13
+ torchvision>=0.20.1
14
+ torchdata>=0.10.1
15
+ torchao>=0.7.0
16
+ sentencepiece>=0.2.0
17
+ imageio-ffmpeg>=0.5.1
18
+ numpy>=1.26.4
19
+ kornia>=0.7.3
20
+ ruff==0.9.10
requirements_without_flash_attention.txt → degraded_requirements.txt RENAMED
@@ -3,16 +3,6 @@
3
  # For GPU monitoring of NVIDIA chipsets
4
  pynvml
5
 
6
- # eva-decord is missing get_batch it seems
7
- #eva-decord==0.6.1
8
- #decord
9
-
10
- # we are waiting for the next PyPI release
11
- #finetrainers==0.1.0
12
- finetrainers @ git+https://github.com/a-r-r-o-w/finetrainers.git@main
13
- # temporary fix for pip install bug:
14
- #finetrainers @ git+https://github.com/jbilcke-hf/finetrainers-patches.git@fix_missing_sft_trainer_files
15
-
16
  # it is recommended to always use the latest version
17
  diffusers @ git+https://github.com/huggingface/diffusers.git@main
18
 
 
3
  # For GPU monitoring of NVIDIA chipsets
4
  pynvml
5
 
 
 
 
 
 
 
 
 
 
 
6
  # it is recommended to always use the latest version
7
  diffusers @ git+https://github.com/huggingface/diffusers.git@main
8
 
setup_no_captions.sh → degraded_setup.sh RENAMED
@@ -1,6 +1,6 @@
1
  #!/usr/bin/env bash
2
 
3
- echo "if install fails due to python being not found, edit setup_no_captions.sh to replace with another version of python"
4
 
5
  # if you are on a mac, you can try to replace "python3.10" with:
6
  # python3.10
@@ -12,7 +12,14 @@ python3.10 -m venv .venv
12
 
13
  source .venv/bin/activate
14
 
15
- python3.10 -m pip install -r requirements_without_flash_attention.txt
 
 
 
 
 
 
 
16
 
17
  # if you require flash attention, please install it manually for your operating system
18
 
 
1
  #!/usr/bin/env bash
2
 
3
+ echo "Degraded setup for environments where decord cannot be installed"
4
 
5
  # if you are on a mac, you can try to replace "python3.10" with:
6
  # python3.10
 
12
 
13
  source .venv/bin/activate
14
 
15
+ # :(
16
+ python3.10 -m pip install -r degraded_requirements.txt
17
+
18
+ # :((
19
+ finetrainers @ git+https://github.com/a-r-r-o-w/finetrainers.git@main --no-deps
20
+
21
+ # :(((
22
+ python3.10 -m pip install -r degraded_finetrainers_requirements.txt
23
 
24
  # if you require flash attention, please install it manually for your operating system
25
 
setup.sh CHANGED
@@ -4,4 +4,7 @@ python -m venv .venv
4
 
5
  source .venv/bin/activate
6
 
7
- python -m pip install -r requirements.txt
 
 
 
 
4
 
5
  source .venv/bin/activate
6
 
7
+ python -m pip install -r requirements.txt
8
+
9
+ # if flash attention couldn't be installed for your operating system you can try this:
10
+ # python -m pip install wheel setuptools flash-attn --no-build-isolation --no-cache-dir