Slow Charm activating when in a party POE 2

When playing in a party when a party member enters and exits a portal to go back to town, my slow charm will proc. We cannot figure out why this happens as we both have nothing the increases move speed for allies or minions in presence or the like. Very minor but interesting. Couldn't find this already posted.