Spell totem

Hi all my skills are bind to the 1st weapon set, except for spell totem. It just refuse to set to 1st i can only cast on myself or secondary weapon set. Except i don't use a secondary weapon set no skills assifn to it nor weapon. It wont let me bind it to the fiest set.