Bringing Halo Modeling Toward Precision Cosmology