The raspberry pi 3 will actually overheat even on regular settings right now. It’s not because of the OC.
This has been an issue for years at this point. The solution: buy a heatsink. Or just downgrade to a much older version of Batocera. Or install Recalbox, they tend to focus on SBCs more than Batocera does.