Police have urged the public not to approach Storm Hughes, 33, who fled from a work party outside the Springhill Prison in north Waikato yesterday.
Hughes had a "significant history" of violence in Australia, police said.
His escape came three weeks after Arai Hema fled from an outside work party at Auckland Prison at Paremoremo on January 21. Hema remains at large.
Mrs Collins said in Parliament yesterday the escapes were unacceptable.
"Not one escape is acceptable and that is why this minister is going to hold people to account for their actions and inactions," she said.
"I am confident that the department understands that my expectations are significantly higher than those of the previous minister."
Police hunting for Hughes have warned residents of Huntly, Mercer, Te Kauwhata, Pukekohe, Pokeno and nearby areas to lock their cars, homes and outside buildings.
They also warned farmers to call them immediately if they noticed any intruders on their farms. Signs he was around could include spooked stock or barking dogs.
Escaped prisoners often hid during the day and tried to break into buildings or vehicles at night, police said.
Hughes is a Caucasian, of medium build, 171cm tall with short blond hair and tattoos on his arms and back.
He was last seen dressed in a blue denim jacket, grey shirt and grey trousers.
Hughes has lived in Tokoroa and has links to the Turangi and Taumarunui areas.
