The Sydney Olympic Park building experienced a concrete panel collapse on Monday which triggered the evacuation of the tower and the surrounding areas.
While most residents were allowed back into the building within 24 hours, on Thursday the construction company responsible for the building called for it to be emptied.
Julian Doyle, the NSW director of building company Icon, said the building was not at risk of collapsing, but the fastest way for the issue to be dealt with was to remove all residents from the tower.
"I think ultimately the building will be as it was designed to be," he said.
An angry resident confronted Mr Doyle during his press conference at the base of the tower, demanding better temporary accommodation and a clearer timeline of when they would be allowed back home.
Mr Doyle could not guarantee residents would be able to move back in after 10 days.
