Add batch processing to MMLU and Humaneval evaluation scripts to prevent OOM errors#597

LlamaEnjoyer wants to merge 3 commits intoturboderp-org:masterturboderp-org/exllamav2:masterfrom

LlamaEnjoyer:batched_evalsLlamaEnjoyer/exllamav2:batched_evalsCopy head branch name to clipboard