I'm largely with you on this, though I've been educated that it *does* make a difference if the character has a marginalized appearance (different skin color, body size, etc.), because many readers will automatically envision a character as non-marginalized unless they receive periodic textual nudges to remind them otherwise. But if one only describes the marginalized characters, there's a problem. So I try to be balanced.