Infusion Mechaincs are poorly thought through in comparison to Charges

Honestly, I've just linked Living Bomb to Spellslinger, and it clears up a lot of the issues.

Since the Living Bombs are attached to things and always detonate when the enemy is killed, unless you're killing stuff behind you there's no need to backtrack; the infusions are just right there. Of course, for bosses, this will mean playing a bit closer up, but it typically isn't a hassle either.

In most cases, one fast casting spell is more than enough to keep the Invocation Charges stocked up for Spellslinger, and using it with Ritual Cadence reduces the need for paying much attention to it outside of recasting it every ~30 seconds. Or go without it if you're a fan of the numlock trick I guess?

Add Elemental Equilibrium into the mix (unless you only want Fire Infusions), and you have a battery for all three types to be generated consistently.

This also works with other non-Invocation Meta Gems too, like Cast On Crit. These tend to be a little less stable for general use, but CoC in particular goes crazy on bosses with high cast speeds, or spells like Firestorm.

For another option without meta gems at all, which works exceptionally well with any high cast speed spell, Orb of Storms. Between Unleash, Overabundance (or Multiplying Squalls for Stormweavers specifically), and the Secrets of the Orb Notable, you get 3 instant orbs that can be depleted very quickly for Infusions.

So there are a good number of ways to spawn them without having to also go out of the way to pick them up.

auto-attacking deadeye that doesn't have to deal with picking up anything + their insane movespeed vs infusion collecting stormweaver is night and day difference. for this reason, i'm out.