What they all said! One note, though... when I was in the best cardio condition several decades ago was when I got the worst altitude sickness. Hauling a heavy pack up 5k feet to a 12k elevation was possible back then. But then I'd be pretty sick by next morning.

Take a lighter pack and do what you said: go slow.