We love to stop in at Goatfeathers in Seagrove Beach or Blue Mountain Beach for fresh seafood whenever possible. Great, fresh seafood is expensive though...
If shopping for shrimp at Publix, I just get the bag of frozen, to use when making chowder or pasta dishes. I've picked up fresh shrimp there, but with very mixed results.