Baldy isn't too far from Orange County. You might consider overnighting up there one night for a couple of weekends before doing Whitney. That's similar to Steve's suggestion, but it won't require nearly the driving.