Rite of passage charm is not working

Hi, I was wondering if someone can help with this issue. I have saved up and bought rite of passage wolf and I am killing rare and unique monster and the charm is not working.
If anyone can help guide me to the right direction would be great.

Do you have the Oasis keystone?
Do you have something increasing the amount of charges your charms use? Check your belt.