Some fair points, but it’s not something to write off as “only juniors would share that opinion”.
I agree that they probably shouldn’t be touching the code at all, but I feel much more at ease when decision makers and/or leaders have had their humble beginnings as a developer. They often “get” stuff that non-technical managers don’t, and have the ability to empathize with internal development concerns. Things like technical debt, sustainable pace, investing up-front in best practices instead of banging out bug-laden code as fast as possible.
Non-technical managers can have an arrogance to them when they don’t know how things work and expect results without caring about the details. In extremes, as much to think we’re all interchangeable and dispensable. Or brute force thinking, like adding more developers without addressing internal productivity problems will get things done faster.
Not all non-technical managers are bad, but technical managers can be your greatest allies.