You definitely made the right decision. The last two miles to the summit are arguably even more difficult than the switchbacks. Considering your condition, it's unlikely you would have made and you would have put yourself at risk of AMS.
But getting to Trail Crest is an accomplishment in itself. Topping out at 13,600 feet and 5300 feet of climbing is nothing to sneeze at!