An atomic operation is effectively executed as a single step, no other process can read or modify the internal state while the atomic operation is executed.
Sources:
NIST IR 8459