Spaces:

lucalp
/

blt-entropy-patcher

Running on Zero

App Files Files Community

blt-entropy-patcher / bytelatent

Ctrl+K

Ctrl+K

12 contributors

History: 35 commits

par-meta's picture

Fix rsync to not preserve original permissions, instead use destination (#76)

9bd51df unverified 5 months ago

configs
Remove byte tokenizer and add config args to switch between byte/patch packing (#68) 5 months ago
data
Correctly reset batch iterator at each arrow create_iter call. (#74) 5 months ago
model
Add vocab and seq len abstract fields (#66) 5 months ago
plotting
Add plotting code from paper (#17) 7 months ago
preprocess
Allow ArrowIterator to read from json (#45) 6 months ago
tokenizers
Remove byte tokenizer and add config args to switch between byte/patch packing (#68) 5 months ago
.DS_Store

6.15 kB

Initial commit 8 months ago
__init__.py

96 Bytes

Initial commit 8 months ago
args.py
11.8 kB

Remove byte tokenizer and add config args to switch between byte/patch packing (#68) 5 months ago
base_transformer.py

19.9 kB

Initialize rope embeddings properly for the entropy model (#72) 5 months ago
checkpoint.py
11.1 kB

Update checkpointing to use fsspec (#39) 6 months ago
config_parser.py
2.49 kB

Make it possible to specify multiple config files (#54) 6 months ago
constants.py

141 Bytes

Initial commit 8 months ago
distributed.py
16.2 kB

Add bpb and n_bytes to metric logging (#41) 6 months ago
entropy_model.py
1.41 kB

Changes for training entropy model and correcting attention in local models (#25) 7 months ago
eval.py
8.83 kB

Make it possible to specify multiple config files (#54) 6 months ago
float8.py

4.89 kB

Initial commit 8 months ago
generate.py
17.1 kB

This includes fixes that make checkpointing and reloading work correctly. (#35) 6 months ago
logger.py

4.44 kB

Update checkpointing to use fsspec (#39) 6 months ago
metrics.py
7.11 kB

Add bpb and n_bytes to metric logging (#41) 6 months ago
norms.py

4.34 kB

Fix distributed all reduce grad norm (#40) 6 months ago
optim.py

4.61 kB

Initial commit 8 months ago
print_config.py

263 Bytes

Make it possible to specify multiple config files (#54) 6 months ago
probe.py

24 kB

Initial commit 8 months ago
profiling.py

4.4 kB

Initial commit 8 months ago
stool.py

7.41 kB

Fix rsync to not preserve original permissions, instead use destination (#76) 5 months ago
test_blt.py

16.3 kB

Initial codes and scripts for training entropy model (#34) 6 months ago
test_config_parser.py

5.36 kB

Make it possible to specify multiple config files (#54) 6 months ago
test_entropy_model.py

2.03 kB

Test first batch matches (#53) 6 months ago
train.py
32.6 kB

Fix: Correct model_args usage in parallelize_model call (#69) 5 months ago
transformer.py

7.47 kB

Initialize rope embeddings properly for the entropy model (#72) 5 months ago