If you remove the antenna and put a short on the jack, do you still have the noise? Then the noise is external to the radio. Do you still have the noise when NOT in FM mode? Is this in all modes? All frequencies?
Finding the source may be difficult, since the info claims the external antenna is for FM use only.
-Mike.