That money could be put to better use
Clothing and accessories are depreciating assets. They simply are. Sweaters do not go up in value. You could be taking the money you spend on shopping and growing it. Perhaps you could be putting it into a savings account or even spending it on a night class or workshop that would boost your marketable skillset.