Grownups have a tendency to talk themselves out of things, saying it will never work, but kids are fabulously optimistic.
Those who write may think they know their target market. They may even feel they can shape the work to fit it. If this is true of you, you have more control over your creative process than I do. Even so, I humbly submit that you try letting your writing shape your target market instead and see what happens.
As authors, we all have to learn not to be reactive to public statements about our books. It's really not our business what each reader thinks of them.
The world I live in is not all white people, not all straight people, and it's not all people who have their acts together, either.
When I write, my goal is to delve deeply enough into the human experience to find a sort of universality. Once you dig down underneath surface differences, we are all human beings. And all human beings want essentially the same things at our core. We want to love and be loved. We want to be safe. We want our loved ones to be safe.