Yes. Penises expand and collapse depending on how much blood is being pumped into them, but the total amount of skin doesn’t change. So the skin folds in when the penis is flaccid (not erect).
At least mine does. I might just have a weird penis that retracts into my body when flaccid.