Never done that, but from what I've seen, it is supposed to be ok. It's called the National Recreation Trail.

Here's a link to the USFS pdf document describing the trail:
  Whitney Portal National Recreation Trail - USDA Forest Service