I would just agree with the lawyer comment. You want to talk to your OWN lawyer representing you. Their lawyer rerpesents them, and can say whatever they want, but it won't help you.
You certainly can't hold your former employer as an example of things. That is, they knew they were highering you under a non-compete, but they highered you anyway and YOU (not them) got lucky. They are under no requirement, legally, or otherwise, to not persue you should you go after their customer base in some manner.
I'm not in sales, but the concept is clear enough... You signed a non-compete and it sounds like you fully intend to violate it. If the law is written such that this is illegal, then you should be held liable for breach of contract.
I'm not saying I agree with it, but it does seem that you are fully aware of your own situation, and if you have worries, then your best course of action is a few hundred dollars of legal time for peace of mind.
I know in my signed non-compete I crossed out a portion of it before I was willing to sign it. I run my own A/V business and made them aware of that before I was highered. I do resi-work and they do commercial so out paths do not cross, but if they enter the resi side of A/V, then they would be competing with me and my non-compete would need to be readdressed at that point, but I would not be in the wrong at any point.
Sounds like you know you may be stepping into the wrong in some manner and you should get legal council before you make any significant life decisions.