(from https://www.fs.usda.gov/main/inyo/passes-permits/recreation) Crossing Park Boundaries Your wilderness permit must be issued via Inyo National Forest if your trip starts from Inyo National Forest, even if the first night of your trip will be spent in an adjacent national park or forest. One permit is valid for the duration of a trip, including traveling through adjacent parks and forests. If you exit the wilderness in Inyo National Forest for more than 24 hours or re-enter at a different location, a new permit is required for the new entry location.
Interesting. Not sure if that applies to Whitney permits or not.