Leaving the Location of the building is the difference.Then what is the difference from moving out of the building and then moving back in. Rowhouse Bypass states that you spend one to "bypass" in the hex it is leaving where it would be attacked by any OBA/Residual‑FP and two to enter the building), You are no longer in the building so therefore would lose control
You aren't leaving any location of the building hex.