Smith will join French outfit Pau after the World Cup but has plenty to achieve before the move, starting with Saturday's Rugby Championship decider in Sydney.
The Wallabies are joint top of the Rugby Championship with the All Blacks, after both sides beat South Africa and Argentina in their opening two games.
Saturday night's game at ANZ Stadium will be the last game Smith plays in Australia for the All Blacks.
The Wallabies held the All Blacks to a 12-12 draw in Sydney in August of last year's Rugby Championship, but Smith didn't play because of the birth of his first child.
"It will be something I miss," said Smith. "They're our brothers across the ditch and it's a pretty unique rivalry. I've grown to enjoy the games a lot and everything that comes with these games.
"There's something special about the Bledisloe games. Australia are the team we love to hate. It's a different rivalry with Australia and I'm sure they'd be the first to admit that themselves.
"You're always against an Australian side that's very passionate and they play really well there. I think back to the games I've had there and they're always particularly tough.
"They always start well at their home base and that's a factor we can prepare for.
"There's obviously a bigger picture around this year but it's the Bledisloe Cup and we want to hold on to it. We know how desperate they are to get it off us."
Australia last won the Rugby Championship in 2011 when it was formerly the Tri-Nations and Argentina had yet to join the competition.
That same year was World Cup year and the Wallabies will be hoping to emulate their achievements from that campaign, when they beat the All Blacks 25-20 in a decider in Brisbane.
Smith played in that game and revealed he was intimidated by the Australian crowd early into his All Blacks career when he was a substitute in Sydney.
"On one of my early tests I was on the bench and I've never been heckled quite like it. I had long hair at the time and they were saying, 'get a haircut' and 'who are ya' and all sorts.
"I look back now and I laugh but I know at the time, it was quite intimidating. It still sticks in my mind."
Despite the abuse that rained down him on that occasion, Smith says it's something he's enjoyed throughout his career and with the opposing players, too.
"I enjoy playing them and I enjoy the banter, particularly with the guys I've played against like Adam Ashley-Cooper. I suppose it's like all sports when you play Australians.
"There's plenty of niggle and the supporters love ribbing you more when you play in Sydney than what you get in Jo'Burg. It's all part of it and it makes it enjoyable."
