Spaces:

sparse-generative-ai
/

open-moe-llm-leaderboard

Running

chivier commited on May 18, 2024

Commit

a1bb5dd

1 Parent(s): 1934588

sync from github

Files changed (1) hide show

src/leaderboard/read_evals.py CHANGED Viewed

@@ -118,7 +118,7 @@ class EvalResult:
                         multiplier = 1.0
                     if "throughput" in metric:
                         multiplier = 1.0
-                    if "batch_" in metric or "Mem" in metric or "Util" in metric:
                         multiplier = 1

                         multiplier = 1.0
                     if "throughput" in metric:
                         multiplier = 1.0
+                    if "batch_" in metric or "Mem" in metric or "Util" in metric or "mfu" in metric or "mbu" in metric:
                         multiplier = 1