use eager compilation for benchmark setup

As mandated by code review. However, this shouldn't change any benchmark results since it is just setup code.