Psychology says people who try to save every penny they can aren't always making financial decisions based only on budgeting. Their behavior can be linked to anxiety, fear of uncertainty, past financial experiences, a scarcity mindset, loss aversion, and a need to feel control and safety.