[release] Run configure before building tarballs for benchmarks