Is it a bluetooth controller? This was an issue in batocera 29. Try updating to the beta 1 of batocera 30, that fixed the issue for me atleast. My bluetooth controller was also able to be used wired and that worked without problems. Try it with a wired controller also if you have any.