It's more than that. You stopped short of the full quote.
Was the atonement incomplete?
1 John 2:2 NIV
He is the atoning sacrifice for our sins, and not only for ours but also for the sins of the whole world.
1 John 2:1-3 KJV
1) My little children, these things write I unto you, that ye sin not. And if any man sin, we have an advocate with the Father, Jesus Christ the righteous:
2) And he is the propitiation for our sins: and not for ours only, but also for the sins of the whole world.
3) And hereby we do know that we know him, if we keep his commandments.
John 1:29 KJV
The next day John seeth Jesus coming unto him, and saith, Behold the Lamb of God, which taketh away the sin of the world.
John 3:3 KJV
Jesus answered and said unto him, Verily, verily, I say unto thee, Except a man be born again, he cannot see the kingdom of God.
John 3:18-19 KJV
18) He that believeth on him is not condemned: but he that believeth not is condemned already, because he hath not believed in the name of the only begotten Son of God.
19) And this is the condemnation, that light is come into the world, and men loved darkness rather than light, because their deeds were evil.
Jesus removed the sin of the world, but even so, you must be born again. If you don't believe in Him, you remain condemned.