For many retirement savers, the 401(k) is a sacred, long-term nest egg that’s off limits until retirement.
But in an era of high home prices and tight household budgets, that line is starting to blur. When a house is often a family’s largest asset, the temptation to tap retirement savings for a down payment can seem like a good idea.
Bernard Carter isn’t convinced.
Mr. Carter, CEO of Carter Wealth Strategy, an affiliate of Fragasso Financial Advisors, has spent 25 years in wealth management, including 13 years at Morgan Stanley and 12 years at the Hapanowicz wealth management firm. He launched his own firm in the Strip District in April 2025, and has grown it to $65 million in assets under management.
His take on raiding a 401(k) to buy a house?
It rarely makes financial sense.
Read More
Money pulled from retirement accounts loses its most powerful advantage — time. Dollars that would have compounded for decades instead get rerouted into a single illiquid asset. Over time, he said, that can mean a dramatically smaller retirement balance.
And because a home already tends to dominate a family’s net worth, using retirement savings to buy one can potentially leave families house-rich, but cash poor.
In the Post-Gazette’s latest “In Conversation With” Q&A, Mr. Carter breaks down the financial tradeoffs and the rare circumstances where raiding a retirement account to buy a house could be justified.
This interview has been lightly edited for length and clarity.

Post-Gazette: The conventional wisdom is never to touch retirement savings before age 59½. Are there situations where breaking that rule actually makes financial sense?
Mr. Carter: There are tax loopholes for certain early retirement savings withdrawals, such as for first-time home buyers or educational expenses. While advantageous, these exceptions still leave behind the problem of a smaller sum of money that is compounding for you for retirement.
When you repurpose retirement funds to other goals — such as purchasing a home — it can create a hole in your retirement plan that is difficult to repair.
While tapping your retirement savings before 59½ rarely makes financial sense, in certain cases it may make lifestyle sense. For instance, tapping your retirement savings might enable you to buy a new home that would cut your work commute by 90 minutes. You might conclude that the extra hours with your family are worth the financial penalty.
PG: How should buyers think about homeownership as part of their overall investment and diversification strategy?
Mr. Carter: Homeownership can diversify a total portfolio that includes CDs, stocks, bonds and other investments.
Homeownership also offers “forced savings” benefits. A portion of a mortgage payment is the interest due, but the remainder goes to paying down principal. Thus, by paying your mortgage — which you are strongly incentivized to do to keep a roof over your head — you are “forced” to save and build equity in your home.
The home is often a large part of overall family net worth. This can create a concentrated risk within a single illiquid asset. My parents bought their home in 1963 for $26,000. They sold it 45 years later for $19,000. Bad location. Thankfully, from a retirement perspective, things turned out OK for them as they each had generous pension and Social Security benefits.
In the financial plans we prepare for clients, we distinguish between “portfolio assets” such as stocks and bonds, and non-income-producing real estate assets, such as the family home. In these plans, portfolio assets are seen as the primary driver of asset-based income in retirement. Equity in the home is viewed only as a backup if needed.
Be careful not to allow your home to leave you cash-poor. A good rule of thumb is that your total housing cost should be no more than roughly 30% of your gross income.
PG: What are the biggest long-term risks of using retirement funds for a down payment that people tend to underestimate?
Mr. Carter: Short-term there is the immediate damage to your personal balance sheet due to taxes and penalties.
The long-term risks, however, can be even more damaging.
There is the loss of compounding growth that will result from removing these funds from your portfolio. A $30,000 withdrawal today could result in a $100,000 reduction to your retirement nest egg.
If you plan to take a 401(k) loan to fund a down payment, consider that if you lose your job, the loan may become payable within a short period of time. If you do not have the funds to repay the loan, it will be re-characterized as a distribution, resulting in taxes and potential penalties.
Once you’ve tapped your retirement account for a non-retirement expense, mentally you may be more likely to then view that bucket as a source of cash for other non-retirement goals. Once the genie is out, it can be hard to get it back into the “retirement only” bottle.
PG: How much does the interest rate environment matter when deciding whether to use retirement money to buy a home?
Mr. Carter: The mortgage interest rate you will pay is a big input into the decision on whether or which home to buy. All else equal, a lower rate can make buying a home much more affordable.
On the other hand, a higher rate may make it impossible to afford the type of home you are looking for.
That said, using retirement savings to buy a home is almost always a bad idea, whatever the interest rate environment may be.
You can try to make the case that using retirement funds to buy a home may make sense in a high-rate environment because a larger down payment will have a greater impact on lowering interest costs when rates are high.
The combined costs, however, of the loss of compounding in the retirement account, taxes, and potential penalties will normally outweigh any gains that might come from interest savings on the mortgage.
Want to see an “In Conversation With” Q&A with a local business figure? Send suggestions to business@post-gazette.com.






Comments
Welcome to Post-Gazette subscriber-only commenting community. Please review our community guidelines.