You should do exactly what you want to do, the same as everyone else. Some people like optical sights, some people like flashlights on a firearm, some people like: [Your Idea Here] and there is someone who doesn't like them to match.
It's your gun. Do what makes you happy and move on. Lots of people want them, lots of people don't. That's why there is an optic cut on the slide and that's why there is a piece of steel filling the slot up when it's not used.
FYI, I do have an optic on my 1911 and love it.