Stuck in hideout

So having equipped an invalid spectre gem, my character cant load into the game, it just auto crashes. If i could get into a town instead, maybe the pet wouldnt try to spawn and I could delete this gem that has me trapped. I know you can shortcut to town/hideout, but Im already in my hideout, so I was wondering of there could be a way to escape this problem.