“I don't want to be mean, but …”
Stop right there. You’re about to be mean. If you want to say whatever’s coming after the word “but” then lose “I don’t want to be mean.” You’re being mean. Own it.
If you really don’t want to be mean, then “I don’t want to be mean so I’ll stop now.”