It is probably only too cold during stormy weather, as long as you have enough layers.
And any time will be good in the fall, until there is enough snow on the ground to make progress too slow to make the distance.
I once day hiked Sawtooth Peak in early November, and it was great, since no significant snow had fallen.
