The 25-year-old Picton world champion and his double sculls partner Nathan Cohen, 26, surged from fourth to first in the final 500m of last night's race to win by a nail-baiting 1.13s.
Sullivan celebrated the victory by flinging his arms into the air, leaning back into his teammate's lap and shaking hands with Cohen before standing up in the boat.
There were also scenes of jubilation at Oxleys Hotel in Picton, where more than 100 locals and members of the local Picton Rowing Club gathered to watch the race.
Sullivan's grandfather Michael Sullivan said it was "a great sensation" as the noisy crowd cheered the duo on while they surged towards the finish line.
"You couldn't hear yourself think, especially when he was last and then he started to go through," he told APNZ.
"He got down to the last 500m and he just shot through the whole lot of them."
Mr Sullivan said it was a very proud moment.
"I knew he'd do it. I've always said that he would."
Mr Sullivan said he was looking forward to seeing the gold medal.
"I don't know how big they are, but they look huge"
Mr Sullivan had not spoken to his grandson yet - although there was an excited message on his answerphone which he couldn't understand because people were "talking over one another".
It could be that the message was from Sullivan and his parents Mike and Elaine, who travelled to London to support their son to victory.
Picton Rowing Club member Colin Timms said there had been a great atmosphere in the "packed" Oxleys Hotel in Picton last night, where most of the club was gathered.
"It was a good crowd and we all yelled and cheered," he said.
"It was a bloody good effort - unbelievable."
Mr Timms said the crowd was quiet at first but there was "hooting and howling" as the boys surged ahead.
"They just rode through them, it was just great."
Mr Timms admitted he had "a bit of a headache" this morning after last night's celebrations - but said the mood would carry on in Picton today.
"There'll be some jubilant people around. It'll be great for Picton, for sure," he said.
The win was great news for the club, and Mr Timms hoped more people would want to join up now they had an Olympic hero in their midst.
"Picton has always had a pretty strong background in rowing, and hopefully young fellas will look at it and take it up."
