The pump should be air tight allright from the outside.
Inside there are 2 one way-valves controling the flow at each stroke.
Result is overpressure on the carb side and underpressure on the tank side.
So if there is a defect you may have petrol coming back from the overpressure area producing hissing.
Or it is a air leaking hose
Or a not properly seating float needle.
