InferBench / README.md
davidberenstein1957's picture
chore: update dependencies in pyproject.toml and fix README header formatting
f5f9b38
|
raw
history blame
478 Bytes

InferBench

Evaluate the quality and efficiency of image gen api's.

Install dependencies with conda like that:

conda env create -f environment.yml

Create .env file with all the credentials you will need.

This is how you can generate the images.

python sample.py replicate draw_bench genai_bench geneval hps parti

This is how you would evaluate the benchmarks once you have all images:

python evaluate.py replicate draw_bench genai_bench geneval hps parti