Elemental Hit Question

Hello lovely people,

I have made this Elemental Hit build in path of building : https://pastebin.com/RvfXEyhW

And I was wondering something about Elemental Hit.
If you convert all your damage to fire by using avatar of fire, you use no combat focus jewels, does it end up only hitting once every 3 attacks. By that I mean the fire damage attack ?

Would be kind of you if you can clarify this to me.

Thanks in advance.