Maybe it's because when you're stressed, you focus less on exercise/etc and more on what you're actually stressed about, so he's like "omg she stopped exercising! must be gaining weight!" -_- ahhah