Flood zone "X" does not mean that area will
never flood. It means it has a
low probability of flooding and is the best flood zone to be in.
FEMA considers X to be "moderate to low risk" for floods.
I consider the odds that your insurance company will consider hurricane water damage to be "flooding" and refuse to pay for it to be "high". If it's a nominal cost, I say get flood insurance.
I find it odd that the home is elevated on pilings if it is really in Zone X.

How high is the first floor off the ground?
Just because a realtor, appraiser, or an insurance company says your house is in Zone X does not mean it is - even if they say so in writing.
Unless you have a FEMA map (and know how to read it properly) or a survey by a licensed surveyor specifically stating it is in Zone X, assume it isn't.
I can't emphasize that enough - it seems like an easy enough thing, but it can be a real cluster of misread maps, false info, honest mistakes, or outright lies.