Correct, you cannot rout ADJACENT vs adjacent, there is a real difference between the two, to a melee. In fact, you cannot even Rout ADJACENT to Broken units.
From A10.51 DIRECTION: A routing unit may never rout toward a Known armed
enemy unit (even if that enemy unit is broken or disrupted)...