There are a few things that might get you. As mentioned, AMS and anything related to it, and no experience above 11,500'. Many start to wall out as they approach the Trailside Meadow/Consultation Lake area.
Those two can be remedied by replacing one of your hikes with a trip to White Mountain. White is an "easy" 14er...that is, if an alien isn't trying to crawl out of your right eye, you don't have an appetite or... It is 15-miles RT, ~+3,200'. The ascent through marmot valley to the observatory on the way back will get your attention.
Based on your stated fitness level, you should be ok if the AMS and inexperience at these elevations don't get'cha.
