The former All Black and Otago hooker was there in Cardiff in 2007, when the All Blacks' World Cup dreams were shattered by France in the quarterfinal, and provided the most memorable quote of the tournament when he referred to the "smell of death" in the changing room.
Back in New Zealand for a brief break from his studies at Cambridge University, Oliver is excited to be part of the buzz surrounding the tournament.
He caught up with his old mates at the team hotel after the All Blacks' quarterfinal victory over Argentina at Eden Park.
"The guys are genuinely ecstatic to be past the quarterfinal stage. That's where their heads are, and that's great to see, because we weren't there four years ago," Oliver said yesterday.
"I think we talked all the right things last time but I don't think we actually believed them.
One game at a time, that sort of thing. Possibly we actually did think we were going to beat France.
"I think Graham [Henry] genuinely is thinking one game at a time now.
"And I think, irrespective of the results, the NZRU made the right decision in sticking with him. You have to say he and the other two have done a remarkable job."
Oliver has been impressed with Henry's demeanour in recent days, as the All Blacks have come to terms with their injury crisis at first five.
Losing Dan Carter was a major blow but a player like Aaron Cruden was coming in with nothing to lose.
"I think they've responded well to the injury problems. It's been wonderful, really.
"Look at Graham Henry. He's being very positive and he's really leading from the front. I think everyone feels his sense of optimism and can-do attitude."
Oliver does not believe the All Blacks will be particularly worried about the fact previous World Cup semifinals between the transtasman rivals had gone the way of Australia.
They would be more concerned about having lost to the Wallabies this year, though that would provide motivation, not doubt.
He was at Eden Park for the quarterfinal against the Pumas and got a reminder of how All Black fans can be gripped by an extra layer of tension during a World Cup.
"People were worried we weren't playing well. There's this huge anxiety, and I know where it comes from. It comes from the last four World Cups, because we've failed to win.
"There's a vast reservoir of anxiety there that is difficult for us Kiwis to get over. We desperately want to believe we can win but we're hugely scarred by the past."
Oliver has been delighted at the success of the tournament. It had provided opportunities for New Zealanders to experience new cultures, and also to watch test rugby without fear or expectation.
"I think we've learned from teams like Ireland and Argentina and Italy and the Welsh, who want to have a good time," he said.
"I think they've given us permission to turn up to a game and smile and jump around and enjoy it.
"That's particularly the case when the All Blacks haven't been playing. A bunch of Kiwis have been able to go along without the anxiety of their own team being there, and they can just enjoy sport for what it is supposed to be."
Oliver was an All Black for 12 years, and finished on 59 caps.
He remains in close contact with All Black captain Richie McCaw and departing fullback Mils Muliaina. Their collection of 100 caps was "astonishing" and the manner in which the milestones were marked was heart-warming.
"You've seen people being a bit vulnerable. The average Kiwi rugby male is sort of emotionally restricted. We lack the courage to put our heart on our sleeve sometimes.
"But then you see Jock Hobbs twice coming out in public. He's visibly a very unwell man, but he's just got on the front foot and decided he has a job to do. That's the definition of both vulnerable and courageous in one."
Oliver has been staying in Blenheim with family, and has also been doing some work with TVNZ leading up to World Cup games.