Remove the old vacuum breaker
Many older outdoor spigots are equipped with an “add-on” hose connection vacuum breaker (HCVB), and if water is spraying out it means the rubber gasket inside has failed. The vacuum breaker prevents water from flowing backward into the house. (Vacuum breakers are built into newer frost-proof water valves.) The bottom portion of the breaker unscrews, but it's almost impossible to find replacement gaskets. You can find new HCVBs near the brass valves in the plumbing section at any home center.
The vacuum breaker screws onto the water valve and locks into place with a tamper-proof setscrew. To remove the faulty vacuum breaker, you'll first have to remove the setscrew(s). Use a small drill bit and drill down next to the setscrew. The brass is soft, so go slowly and be careful not to drill into the valve threads. Then use a larger bit and drill at an angle to demolish the setscrew. Install the new HCVB and you won't have to run away from a spritzing hose spigot.