Dunno, I'm not LEO.
But if you're licensed and concealing -- great. If you then stop concealing (exposure) and then go back to concealing, you've pretty much violated what you're licensed for.
I'd think most cops would simply question you, find out you're legit with your CPL and then let you on your way -- probably talking to you about keeping your gun concealed. I don't know of any crime on the books though.
Maybe Boz will chime in.
But for instance, today I received a notice from my son's school. There was some police activity near the campus due to shots fired. It was resolved without incident, but let's say it wasn't. Let's say the person responsible wasn't located. Then a person sees me getting into my car, but when I take my jacket off they see a gun. They call 911, the cops arrive, I'm detained, gun confiscated and become a person of interest. Until it gets cleared up, I could imagine my CPL would be suspended...