Yes you need to eat breakfast, I eat two

And like Nightshade said, if your body does not have fuel, it is going to take the stuff that is the heaviest first, being muscle. You definitely need to eat, it will help you out a lot, and I am sure your metabolism will pick up also.