Crossbow defaults back to normal bolts after dismounting Rhoa

I am running a Spear+Shield/Crossbow build (spear in weapon set 1 and crossbow in weapon set 2). For spear I am using Lightning Spear + Rhoa Mount and I am using Glacial Bolts on the crossbow. When I am not on the Rhoa, I can swap back and forth between LS and GB and it remembers what is loaded in the crossbow. I can bind LS to LMB and GB to RMB and it works seamlessly while I'm just walking around. However, every time I dismount the Rhoa it forgets what bolts are loaded in the crossbow and I have to hit the load button again. This means I have to press 2 buttons to switch from mounted LS to walking GB: space bar to dismount and another to load GB. One button is fine to dismount (getting unexpectedly dismounted is lethal, so I get that this should be a conscious choice), but reloading my GB feels bad. Thanks!