Adding more walls without deleting objects

Having the collision off when moving objects creates weird anchor points that can cause objects very far away to be deleted when creating walls despite them not being in the way.

I would like it if creating walls (or new rooms next to furnished ones) wouldn't delete objects. That's what the object deletion brush is for.