fix validation program
f567a45
Lukas Helff
commited on
Commit History
select last rule
62ba87c
test last rule only
bff577f
rule validation post extraction
bf1b494
fix single eval
78670b1
timer back to 10 sec, remove logging messages
499cdbd
reduce timer back to 5 seconds
a0f954f
typo
7fd2051
increase timeout for parallel
4260a70
allow multiple rules
e4484f6
update reward, prevent reward hacking
88c2435
only accept one rule as a solution, we select the first one. Do not allow groundings
999258b
use multi processing only for 500 or more samples
c8de9ce
make eval config obligatory
0f1c352
Lukas Helff
commited on
make eval config not obligatory
1fe4885
Lukas Helff
commited on
update error message
ac97ee4
Lukas Helff
commited on
extract rule from NL
58596cd
Lukas Helff
commited on