That’s interesting, I would for sure need some empirical evidence to be fully convinced, but the only problem I have with your argument is “severely limiting your ability to do or improve in anything language related”.
The word “severe” implies a great difference between people who listen to music, and those who don’t. I think such a difference would be apparent, and my anecdotal personal experience doesn’t correlate with it.
Musicians would have to near incoherent to talk to, considering how much music they listen to.
That is the problem I have with your argument: not listening to music only gives an “edge”. This edge, for now, lies in the realm of anecdotal evidence. You can say “I have seen this person who didn’t listen to music and he was good at verbal reasoning” and I can i say “I have seen this person who did listen to music and he was good at verbal reasoning” and this won’t prove anything really.
To have such claims you need empirical evidence to base your assumptions on. For example this study reached an opposite conclusion that music instead helps speech-related problems, and learning music can help train your brain.