Only by death is the guilt of sin removed. That can be the death of the sinner himself (Isaiah 22:14) if he burns in the lake of fire. Or it can be the death of our Creator, who became a man and carried our sins to His cross. His blood atones for sins. (Hebrews 1:3)
But in that last sentence, atonement is payment. That is how the word is used in Romans 5, the only NT use of "atonement" in the KJV.
That contrasts significantly with atonement in the Old Testament. There atonement is made for fungal infected homes, bleeding women, lepers, open wounds, for buildings, and in this passage, it is made by means of a cash payment.
It is evident that atonement in the Old Testament means "cleansing" rather than "payment for sin." The phrase "make an atonement for him and he will be clean," is typical of these usages. Leviticus 14:20
And this explains Exodus 30 where money spares men from plagues (v. 12). This is not remission for sins. It involves no repentance or change of heart. And this passage can't be used to justify indulgences or male-only salvation.
So briefly, in its one NT use, atonement is payment for sin, and so atonement was finished at the cross. It is used this way many times in the OT also.
But in the 70+ OT uses of this word, atonement is often cleansing and making things right, and even once it is making Noah's ark seaworthy. It is often similar to "cleansing" and in these usages it is not payment for guilt.
For a more robust and nuanced answer from me, see my article: https://bibledoc.org/the-day-of-cleansing-2/