Muhammed Rizalman bin Ismail pleaded guilty to the charge in December 2016 and was sentenced to nine months' home detention on February 4 this year.
The sentence ended yesterday.
Today a police spokeswoman confirmed he was escorted from Wellington to Kuala Lumpur by two New Zealand police officers last night.
A spokesman for Justice Minister Amy Adams said Adams issued a removal order to send Rizalman back to Malaysia under the Extradition Act.
On May 9, 2014 Rizalman entered a young woman's bedroom with his pants and underwear down.
He was charged over the incident, but left New Zealand before further court proceedings began.
After public backlash, Rizalman was extradited to New Zealand on October 24, 2014.
He admitted to defacting outside her Brooklyn house, but his reason for doing so was disputed in court.
Rizalman said in the 30-40 minutes he waited outside Billingsley's house he had a bathroom emergency.
However, the Crown argued he believed in black magic and was attempting to put a spell on Billingsley to make her fall in love with him.
The victim, Tania Billingsley, waived her right to privacy to speak out about the traumatising experience, calling it the "most horrible moment" of her life.
