Disable mouse in menu when using controller?

[wiibur]

My xbox one s controller works well once loaded into the game (mouse gets disabled), but I think having both the mouse and the controller enabled in the menu makes the controller act buggy. Sometimes it has to move starting at the bottom and going up, sometimes certain directions don't work, and if the mouse is highlighting something you can't get it off that with the controller.