Min/maxing can also be a really cool way of adding flaws to the character, not just mechanically

Sounds like you're just objectively bad at your job