A theoretical framework to understand the diversity of exoplanet atmospheres with current and future observatories