Both times I've done the whitney trail our group leader tapped out early. We were stopped by a ranger on both trips and asked for our permits. We showed them our individual passes (which we attached to our bags) and explained that our group leader went back down. It was a non-issue. Unless they stopped giving all hikers some sort or pass you should be good. As long as you are respectful they arent going to give you problems. They can't expect everyone to be together at all times.
