Key Takeaways
- A Gold IRA is not the same as owning physical gold outright. It is a self-directed IRA that holds IRS-approved bullion inside a third-party depository, with a custodian managing the account and a dealer setting the purchase price.
- The full annual cost of a Gold IRA. Setup fee, custodian fee, storage fee, and dealer markup over spot. Routinely runs 1.5% to 3%+ of the account value before gold moves a dollar. A low-cost gold ETF inside a standard IRA gets the same price exposure for roughly 0.10% to 0.40% per year.
- The IRS prohibits storing IRA-owned physical gold at home. Doing so is treated as a distribution, triggering ordinary income tax plus a 10% early-withdrawal penalty if you are under 59½. ‘Home storage IRA’ pitches are an IRS red flag.
- Buying physical gold outright (outside an IRA) gives you direct ownership with no custodian or depository fees, but you lose the tax-advantaged wrapper. And dealer markups and secure storage costs still apply.
- Compare Gold IRA companies and fees
What You’re Actually Choosing Between
A Gold IRA and physical gold are not interchangeable products. One is a tax-advantaged retirement account that holds metal on your behalf inside a regulated depository. The other is an outright purchase of metal you own directly. The fee stacks are different, the tax treatment is different, the liquidity is different, and the IRS rules governing each are different.
If you’re deciding which one makes sense for your situation, the question is not which one has more gold in it. Both can. The question is what you pay to hold that gold, how the IRS treats the gains, and whether the tax-advantaged wrapper justifies the fee structure.
How a Gold IRA Actually Works
A Gold IRA is a self-directed IRA. That part is important. Standard IRAs at Fidelity, Schwab, or Vanguard do not allow physical precious metals. They offer mutual funds, ETFs, and individual stocks. To hold physical gold inside an IRA, you need a self-directed custodian approved by the IRS, and the metal itself must sit in an IRS-approved depository. You cannot take personal delivery. You cannot store it in a home safe. You cannot put it in a bank safe-deposit box and call it your IRA.
The IRS position is not ambiguous on this. Under IRS Publication 590-A and the rules governing IRAs, taking possession of IRA-owned metal is a distribution in the year it occurs. A distribution means ordinary income tax on the full value, plus a 10% early-withdrawal penalty if you’re under 59½. The phrase ‘home storage Gold IRA’ you may have seen in certain ads describes a structure that does not survive contact with an IRS audit.
The metal that qualifies is also specific. Under IRC §408(m), IRAs cannot hold collectibles. Gold qualifies as an IRA asset only when it meets purity thresholds. Bullion at 0.995 fineness or better, or coins that meet the statutory exception. The American Gold Eagle qualifies under that exception even though its purity is below 0.995. Proof coins and numismatic coins generally do not qualify, and many custodians simply decline to handle them to avoid the classification question. If a dealer is pushing you toward proof coins for your IRA, the first question is whether your custodian will actually accept them.
The Fee Stack You Need to See Before You Sign Anything
Every Gold IRA involves at least three entities: the dealer (the company that sells you the metal and whose name is probably in the ad you clicked), the custodian (the IRS-approved self-directed IRA company that holds the account), and the depository (the vault where the metal physically lives). Each one charges fees.
Here is how a typical fee stack reads:
- Setup fee: $50 to $300 one-time charge to open the account
- Annual custodian fee: $75 to $300 per year for account maintenance and IRS reporting
- Annual storage fee: $100 to $300 per year, or 0.10% to 0.50% of asset value
- Dealer markup over spot: 2% on the low end for common bullion; 5% to 15% or more on specialty coins
The dealer markup is the one that almost never shows up as a line item. The custodian agreement will disclose the annual fee. The depository agreement will disclose the storage fee. What the agreements typically do not do is itemize the spread. The difference between the spot price of gold and what you actually paid per ounce. That spread is baked into the purchase price and shows up only if you compare the fill price to the spot price on the day of the transaction. On a $100,000 initial purchase at a 7% spread, you start $7,000 behind spot on day one. The gold has to appreciate 7% before you’re even.
Running the annual carry cost: on a $100,000 Gold IRA with a $200 custodian fee and a $200 storage fee, you’re paying $400 a year minimum, or 0.4% of assets, before counting the amortized setup fee. Add the initial spread and spread on future purchases, and all-in annual equivalent cost routinely runs 1.5% to 3% or more. A gold ETF. GLD, IAU, GLDM. Inside a standard Roth or traditional IRA runs roughly 0.10% to 0.40% in expense ratio per year, with the same IRS contribution limits, the same tax treatment, and full liquidity on any trading day.
That gap is not a minor rounding difference. On $100,000 held for 20 years with flat gold prices, a 2% annual cost drag versus a 0.25% ETF expense ratio leaves you roughly $40,000 shorter on the Gold IRA side. Paid to custodians, depositories, and dealers for the privilege of holding the same underlying commodity.
What Owning Physical Gold Outside an IRA Actually Looks Like
Buying physical gold directly. Coins, bars, ETF shares you can take delivery of, or metal held at a dealer. Means you own the asset outright, no custodian, no depository fee if you store it yourself, no contribution limit, no IRS-mandated account structure. You buy it when you want, sell it when you want, and store it how you choose.
The tradeoffs are real. You lose the tax-advantaged wrapper. Gains on physical gold held more than one year are taxed at the collectibles rate, capped at 28% under current law. Not the 15% or 20% long-term capital gains rate that applies to most stock and ETF positions. For someone in the top bracket, that 28% cap matters. For someone in the 22% bracket, it may not.
Dealer markups still apply. When you buy gold coins or bars from a reputable dealer, you pay above spot. When you sell, you receive below spot. The spread is your entry and exit cost, and it’s unavoidable. Reputable bullion dealers. Those with established pricing and transparent spread disclosure. Will show you the spot price and the offered price side by side. The ones who won’t show you that comparison are the ones to walk away from.
Secure storage is another line item. A bank safe-deposit box runs $50 to $200 a year. Private vault storage costs more. Storing metal at home carries its own risks and may require supplemental homeowner’s insurance to cover it. None of these are catastrophic costs, but they belong in the comparison.
The Clause in the Custodian Agreement Nobody Reads
Every self-directed IRA custodian agreement has a section covering transaction authorization, and buried in it is typically language that places responsibility for verifying the eligibility of the asset on the account holder, not the custodian. The custodian will process the transaction you authorize. It will not tell you that the proof coins you’re about to buy are almost certainly collectibles under IRC §408(m) and probably disqualifying. That’s your problem.
Some custodian agreements also include language specifying that they serve as a passive custodian only. They hold assets, they don’t evaluate them. That matters because a disqualifying asset in the IRA (a numismatic coin, for example, or metal stored anywhere other than an IRS-approved depository) can trigger a deemed distribution of the entire account value. Not just the bad asset. The whole account. The tax bill on that is significant.
Read the custodian agreement before you fund the account. Specifically look for: (1) the list of assets the custodian will and will not hold; (2) language about who is responsible for verifying asset eligibility; (3) the fee schedule and whether it is a flat fee or percentage-based (percentage-based schedules get expensive as your balance grows); and (4) the termination provisions, which govern what happens to your account if you want to move to a different custodian.
Who Should Actually Consider a Gold IRA
A Gold IRA is worth the cost and complexity for a specific type of investor: someone who wants legal title to specific, identifiable physical metal (not just price exposure), wants it inside a tax-advantaged account, is comfortable with the illiquidity of a depository-held asset, and has done the math on the fee stack and found it acceptable relative to alternatives.
That’s a narrower group than the marketing suggests. For most retirement savers who want gold exposure inside their IRA, a low-cost gold ETF accomplishes the same tax-deferred or tax-free growth with a fraction of the fees and no custodian or depository logistics. For savers who want direct ownership of physical metal, buying outright outside the IRA avoids the account structure entirely, though at the cost of the tax wrapper.
For a balanced view of how gold fits a retirement portfolio. And which providers have the most transparent fee structures. The best gold IRA companies comparison is worth going through before you commit to any specific dealer or custodian arrangement. If you’re unsure whether physical gold belongs in your retirement allocation at all, a fee-only fiduciary advisor can run that math against your actual portfolio, with no incentive to sell you the product either way. The best financial advisors page covers how to find and vet one.
How to Compare Your Options Without Getting Sold
Before any conversation with a Gold IRA company, get three numbers from them in writing: the spread over spot on the specific coins or bars they’re proposing, the total annual custodian and storage fee in dollars at your anticipated account balance, and the name of the custodian and depository. If they won’t give you those three numbers before the account is open, that’s your answer.
Then compare the all-in annual cost against the expense ratio on IAU or GLDM held inside your existing IRA. If the Gold IRA’s annual cost is five or ten times the ETF cost, the ETF is doing more of the work your account can do.
Physical gold outside an IRA deserves the same scrutiny on the spread. A reputable bullion dealer shows you the spot price and the ask price in real time. The markup should be visible, not something you discover after the wire clears.
Gold doesn’t pay a dividend. It doesn’t compound. The return is entirely price appreciation minus costs. Keeping costs near the floor is not optional math for gold. It’s the whole math.
