Blasphemy not working with Unarmed? Enough spirit, INT, both weapons set active

I could not make blasphemy works with unarmed even it was activated. Yes, I have it working on my other lich.

I use temporal chain so I could easily see if it worked.

Checklist.

- 60 Spirit

- Enough INT for both Blasphemy and Curse

- Both Blasphemy and Curse set to active on both weapons set

Anything else I'm missing or is it just a bug?