I go often for vacation (we have a condo there) and doubt you will see "a lot" of M cars or BMW enthusiasts. From what I gather, most would be people just like yourself with Military ties. Just as mark896 said, however, you will certainly see some nice exotics. Last time I was down a guy was pulling out in a yellow Ferrari Enzo. Needless to say, I pulled off the road just to hear it go by
Regardless, its a great place to have the M3. I love taking mine down there!
Yours is absolutely perfect BTW.