Can’t use fishing rod

Maybe I am missing something but I have managed to get myself a fishing rod, just can’t seem to figure out how to use it. Users on PC mention that they “right-click” to start fishing but there is no option for that on an Xbox controller…. ??? Tried the regular melee standard attack but that doesn’t seem to do anything either. Tried a few different locations and also reset my instance many times… nothing happens.

Do you have a fishing skill gem?

LOL :)

Did you equip bait?