I tape over the LED power indicator on my monitor, I have the screen disabled when not in use on my microwave oven, I disable the charging light on android devices, and I even cover the indicator on my refrigerator that tells you whether it's going to dispense ice or water.
Everything you’ve described are lights that can shine in the dark. But that’s not what the TouchBar is. The TouchBar can only be seen when the laptop screen can be seen, and is really dim (certainly dimmer than the laptop screen). The TouchBar can’t ever be a light shining in the darkness because it would always be drowned out by the laptop screen.
The LED power indicator on my monitor is absolutely equivalent. When the monitor is off it doesn't produce light because I press the button. It only shines when the monitor is on, and I still find the need to cover it.
Trust me, for me, it's not an unfounded concern.