Firefighters from three appliances were called to the street about 3.30pm after receiving a report of a gas leak.
A Fire Service spokesman said firefighters, working with staff from Nova Gas, were able to identify the source, believed to be an old gas main.
Residents were allowed back into their homes just after 5pm.
There were no injuries, he said.
The street was cordoned off from Andersons Bay Rd to Cashel St. All homes in that area, including a block of 16 flats, were evacuated.
Mrs McCormick, who lives in one of the flats, said a man came around and said she had to leave.
She just had time to grab her dog. Police said a contractor alerted emergency services after smelling gas while working on the road. A St John ambulance was sent to the street as a precaution. About 100m of the road was closed to the public.
Firefighters wearing breathing apparatus could been seen using water to suppress the gas.
