traceability – Can simply not spending the dust thwart dusting attacks?

I have an address where small dust amounts have been deposited in 3 or 4 transactions by unknown senders.

I did some research and found it’s a “dusting attack”.

The articles also mention that simply not touching the dust UTXOs will thwart the attack.
Is this really true?

Can’t the attacker simply trace the non-dust UTXOs of that address?