Some anxiety must come from the fact that you are, in fact, physically, starving. Your body doesn't know that you intend to stop at some point - as far as it's concerned, you are OMG, starving to death! Maybe it's tried hunger as a way of stopping the trend and is now trying mental games instead?

OTOH, it's not a problem I've had - I feel more physically powerful and therefore more confident now that I'm not being debilitated by my weight. It can't be just a case of the body trying to protect itself, or I would have it too.