It's not just a matter of having to pay the IRS more money.