The diversity of population responses to environmental change